-- Logs begin at Tue 2022-03-08 14:47:29 UTC, end at Tue 2022-03-08 15:59:39 UTC. -- Mar 08 15:18:43.823348 dv-cinder-830097-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 08 15:18:43.830590 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 15:18:43 2022] *** Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: nodename: dv-cinder-830097-2-iscsi Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: machine: x86_64 Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: clock source: unix Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: pcre jit disabled Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: detected number of CPU cores: 4 Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: current working directory: / Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: detected binary path: /usr/bin/uwsgi-core Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: your processes number limit is 47680 Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: your memory page size is 4096 bytes Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: detected max file descriptor number: 2048 Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: lock engine: pthread robust mutexes Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: thunder lock: enabled Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 08 15:18:43.834782 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 15:18:43.880249 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: Python main interpreter initialized at 0x5632c11569c0 Mar 08 15:18:43.880249 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: python threads support enabled Mar 08 15:18:43.880249 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: your server socket listen backlog is limited to 100 connections Mar 08 15:18:43.880249 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: your mercy for graceful operations on workers is 90 seconds Mar 08 15:18:43.880633 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 15:18:43.880710 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: *** Operational MODE: preforking *** Mar 08 15:18:43.880944 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: *** uWSGI is running in multiple interpreter mode *** Mar 08 15:18:43.880944 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: spawned uWSGI master process (pid: 79741) Mar 08 15:18:43.881146 dv-cinder-830097-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 08 15:18:43.882520 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: spawned uWSGI worker 1 (pid: 79756, cores: 1) Mar 08 15:18:43.882520 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: spawned uWSGI worker 2 (pid: 79757, cores: 1) Mar 08 15:18:43.882520 dv-cinder-830097-2-iscsi devstack@keystone.service[79741]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 15:18:49.656295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 15:18:49.656295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: from cryptography.utils import int_from_bytes Mar 08 15:18:49.657063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 15:18:49.657063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: from cryptography.utils import int_from_bytes Mar 08 15:18:49.657474 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 15:18:49.657474 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: from cryptography.utils import int_from_bytes Mar 08 15:18:49.657590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 15:18:49.657590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: from cryptography.utils import int_from_bytes Mar 08 15:18:49.702368 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 15:18:49.702562 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 15:18:49.702752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] command line args: [] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 15:18:49.702852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 15:18:49.702940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 15:18:49.703018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 15:18:49.703132 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] command line args: [] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 15:18:49.703216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ================================================================================ {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 15:18:49.703400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 15:18:49.703487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] admin_token = **** {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.703564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ================================================================================ {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 15:18:49.703645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] config_dir = [] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.703816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] admin_token = **** {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.703901 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.703984 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] config_source = [] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.704061 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] config_dir = [] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.704178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] debug = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.704270 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.704389 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.704685 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] config_source = [] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.704896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.704985 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] debug = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.705104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.705210 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.705350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.705436 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.705549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.705631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.705795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.705880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] list_limit = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.706049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.706136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] log_config_append = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.706239 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.706312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] list_limit = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.706418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] log_dir = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.706497 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] log_config_append = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.706604 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] log_file = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.706684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.706779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] log_dir = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.706851 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.706956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] log_file = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.707089 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.707194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.707346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.707446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.707602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.707699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.707773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.707949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.708025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.708128 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.708217 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.708334 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.708460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.708583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.708691 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.708830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.708928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.709064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.709168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.709298 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.709404 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.709532 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.709654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.709766 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.709905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.710013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.710185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.710259 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.710527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.710693 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.710879 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] publish_errors = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.711025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.711417 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.711509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] publish_errors = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.711637 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.711719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.711792 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.711857 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.711857 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.712047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.712047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.712316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.712316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.712460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] standard_threads = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.712531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] standard_threads = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.712656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.712727 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.712797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.712924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.713005 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.713083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] use_journal = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.713205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.713290 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] use_json = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.713367 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] use_journal = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.713495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] use_stderr = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.713578 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] use_json = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.713700 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] use_syslog = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.713776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] use_stderr = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.713899 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.713981 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] use_syslog = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.713981 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 15:18:49.714167 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.714255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.714335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.714464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.714542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.714734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.714817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.714976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.715064 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.715216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.715341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.715454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.715533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.715699 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.715776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.715935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.716018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.716210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.716303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.716463 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.716542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.716698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.716775 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.716923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.716997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.717168 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.717248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.717405 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.717487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.717653 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.717738 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.717901 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.717986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.718142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.718220 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.718400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.718479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.718648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.718730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.718889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.718979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.719125 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.719211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.719381 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.719466 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.719645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.719732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.719896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.719979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.720131 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.720277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.720390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.720475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.720622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.720697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.720850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.720931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.721088 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.721174 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.721335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.721417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.721569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.721646 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.721801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.721890 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.722034 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.722119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.722284 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.722396 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.722519 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.722634 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.722767 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.722877 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.722982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.723078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.723216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.723347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.723474 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.723556 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.723672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.723754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.723891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.723981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.724120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.724261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.724373 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.724451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.724613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.724707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.724853 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.724988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.725073 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.725150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.725310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.725388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.725543 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.725626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.725773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.725860 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.726007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.726084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.726242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.726323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.726479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.726596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.726710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.726789 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.726946 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.727032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.727180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.727263 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.727418 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.727532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.727655 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.727780 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.727891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.728013 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.728122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.728293 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.728385 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.728536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.728614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.728776 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.728853 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.729009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.729102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.729273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.729363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.729511 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.729589 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.729743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.729833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.729981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.730065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.730216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.730295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.730484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.730569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.730723 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.730806 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.730972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.731049 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.731215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.731300 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.731451 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.731536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.731687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.731763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.731921 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.732013 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.732196 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.732295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.732425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.732514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.732661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.732738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.732903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.732989 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.733139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.733222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.733371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.733448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.733606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.733692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.733840 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.733917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.734074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.734158 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.734337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.734415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.734581 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.734660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.734823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.734902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.735059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.735144 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.735298 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.735382 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.735533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.735610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.735767 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.735847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.736001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.736077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.736253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.736333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.736483 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.736562 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.736713 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.736791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.736947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.737024 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.737177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.737257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.737414 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.737491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.737648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.737725 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.737896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.737981 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.738132 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.738209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.738387 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.738463 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.738646 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.738725 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.738886 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.738963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.739117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] auth.external = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.739193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] auth.external = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.739347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.739425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.739639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.739748 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.739873 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.739959 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.740102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] auth.password = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.740197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] auth.password = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.740358 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] auth.token = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.740440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] auth.token = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.740600 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.740677 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.740832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.740910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.741078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.741158 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.741306 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.741383 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.741554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.741633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.741801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.741882 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.742030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.742110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.742262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] credential.caching = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.742346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] credential.caching = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.742494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.742569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.742746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.742826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.742996 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.743074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.743229 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.743309 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.743469 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.743547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.743703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.743781 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.744246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.744330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.744504 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.744592 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.745256 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.745340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.745513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.745594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.745797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.745877 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.746038 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.746127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.746300 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.746380 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.746539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.746616 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.746797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.746874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.747033 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] federation.caching = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.747113 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] federation.caching = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.747269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.747343 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.747514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.747591 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.747761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.747842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.747990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.748068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.748297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.748431 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.748539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.748621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.748794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.748874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.749033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.749120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.749288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.749368 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.749524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.749604 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.749773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.749862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.750012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.caching = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.750102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.caching = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.750262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.750340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.750513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.750625 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.750750 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.750834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.750984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.751063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.751233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.751318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.751462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.751540 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.751697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.751774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.751947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.752032 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.752218 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.752302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.752455 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.752535 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.752686 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.752772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.752917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.752995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.753158 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.753235 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.753405 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.753491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.753653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.753731 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.753908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.753986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.754154 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.754240 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.754426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.754505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.754668 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.754745 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.754903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.754992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.755133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.755211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.755368 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.755446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.755596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.755683 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.755830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.755910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.756068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.756158 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.756332 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.756427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.756583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.756661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.756814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.756891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.757064 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.757144 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.757312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.757390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.757548 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.757625 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.757795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.757875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.758043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.758127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.758272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.758352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.758509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.758589 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.758739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.758816 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.758975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.759052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.759209 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.759289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.759449 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.759526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.759684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.759760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.759919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.759998 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.760184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.760267 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.761003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.761092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.761242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.761331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.761477 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.761556 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.761730 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.761808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.761981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.762063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.762219 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.762297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.762453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.762530 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.762686 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.762766 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.762915 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.762993 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.763155 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.763232 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.763416 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.763496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.763646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.763729 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.763892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.763970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.764138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.764232 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.764408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.764485 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.764649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.764728 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.764879 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.764960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.765112 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.765196 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.765345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.765423 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.765579 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.765665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.765809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.765886 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.766057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.766135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.766304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.766384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.766548 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.766625 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.766793 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.766870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.767038 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.767119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.767268 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.767345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.767508 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.767585 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.767742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.767821 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.767976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.768053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.768233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.768315 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.768468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.768548 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.768710 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.768787 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.768954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.769031 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.769189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.769268 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.769439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.769517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.769667 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.769743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.769907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.769986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.770139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.770216 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.770372 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.770449 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.770609 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.770690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.770853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.770930 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.771092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.771169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.771324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.771403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.771557 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.771634 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.771796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] resource.caching = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.771873 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] resource.caching = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.772045 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.772125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.772317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.772397 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.772552 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.772630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.772805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.772886 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.773052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.773129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.773286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.773372 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.773533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.773638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.773770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.773878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.774010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.774120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.774247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] role.caching = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.774356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] role.caching = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.774499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] role.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.774607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] role.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.774732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.774844 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.774982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.775093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.775232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.775381 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.775481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.775644 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.775725 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.775944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.776027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.776315 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.776398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.776578 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.776659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.776832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.776910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.777065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.777142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.777310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.777390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.777558 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.777635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.777810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.777889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.778061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.778142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.778363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.778462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.778702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.778826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.778957 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.779086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.779212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.779364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.779464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.779629 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.779717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.779883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.779962 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.780160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.780241 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.780435 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.780517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.780678 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.780755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.780913 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.780991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.781147 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.781228 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.781382 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.781460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.781617 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.781694 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.781865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.781947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.782112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.782189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.782351 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.782429 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.782589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.782676 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.782822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.782901 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.783058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] token.caching = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.783136 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.783295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.783375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.783535 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] token.caching = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.783613 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.783773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.783852 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.784023 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.784104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.784284 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.784365 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.784531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.784608 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.784779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.784860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.785016 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.785094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.785262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.785340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.785498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.785577 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.785738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.785816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.785971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.786049 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.786210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.786291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.786445 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.786525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.786675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.786752 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.786920 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.787000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.787147 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.787224 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.787429 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.787508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.connection = **** {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.787703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.787880 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.787961 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.788198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.788279 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.connection = **** {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.788445 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.788536 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.788683 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.788763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.788919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.789000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.789154 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.789233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.789389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.789466 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.789628 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.789709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.789860 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.789938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.790096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.790173 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.790330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.790410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.790564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.790641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.790801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.790878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.791037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.791117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.791264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.791342 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.791505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.791603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.791748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.791828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.791925 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 15:18:49.792003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.792233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.792472 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 15:18:49.792647 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 15:18:49.824008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.824184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.824261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.824398 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.824503 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.824626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.833133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.833227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.861229 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.861460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.861545 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.861713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.914950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.915878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.965256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.965487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.966087 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:49.966322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.030944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.031172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.031395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.031616 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.031705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.031833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.031915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.032043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.032126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.032315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.032534 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.032779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.056525 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.056765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.056982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.057828 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.057985 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.058090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.058214 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.058295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.058434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.058514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.058650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.058863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.059072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.059281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.069648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.070368 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.082181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.082412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.082630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.082712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.082844 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.082938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.083057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.083138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.083267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.083347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.083477 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.083566 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.083684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.083895 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 15:18:50.100424 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.100632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 15:18:50.100971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.101143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.101227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 15:18:50.101356 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 15:18:50.101436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.101673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.101754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.101877 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 15:18:50.101956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.102148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.102227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.102410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.102665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.102917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.113417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.113691 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.113954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.114036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.114230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.114312 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.114505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.114786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.123122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.123658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.126338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.126618 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.126871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.127009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.127149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.127292 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.127430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.127581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.127713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.127858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.128000 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.128115 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.128289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.128382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.128557 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.128642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.128827 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.128908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.129098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.129188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.129371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.129634 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.155166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.156784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.157065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.159535 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.161149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.161431 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.162196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.162473 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.162749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.167197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.167435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.167715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.170392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.170676 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.175026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.175157 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.175309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.175484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.175703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.175983 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.176285 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.176560 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.176830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.177098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.179692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.180004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.180292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.180590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.180865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.181135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.181400 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.181665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.195911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.196206 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.200352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.200630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.200755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.204254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.204547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.205051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.208600 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.208893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.209460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.213113 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.213942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.216712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.217009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.217301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.217472 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.217610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.217843 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.218138 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.220993 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.221288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.221570 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.221850 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.222123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.222399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.237269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.237550 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.237814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.238084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.241759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.242048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.242310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.242569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.246575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.248249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.248529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.251056 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.251491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.251776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.252056 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.252361 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.252641 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.252779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.253010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.256090 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.256457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.256745 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.257031 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.257312 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.265714 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.265991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.266270 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.266547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.266833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.267112 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.267391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.270275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.270554 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.270834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.271113 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.271388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.271673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.271945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.286117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.289338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.289637 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.293069 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.293376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.294636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.296256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.296535 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.296659 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.296822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.298150 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.301159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.301447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.301727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.309685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.311312 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.314589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.314884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.315164 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.315434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.405804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.407411 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.410629 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.410917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.411198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.411473 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.421238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.421475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.421753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.424266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.424572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.424855 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.429380 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.429659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.429935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.430211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.430477 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.430742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.431012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.431313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.431578 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.431947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.432263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.432534 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.432659 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 15:18:50.432806 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.432944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.433089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.433222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.433341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.433607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.433874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.434300 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.434690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.434983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.435254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.435521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.435786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.436047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.436340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 15:18:50.470225 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5632c11569c0 pid: 79757 (default app) Mar 08 15:18:50.473685 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36132216-f852-4857-bf08-6a6696de7e20 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:18:50.473905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5632c11569c0 pid: 79756 (default app) Mar 08 15:18:50.473987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36132216-f852-4857-bf08-6a6696de7e20 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:18:50.474249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36132216-f852-4857-bf08-6a6696de7e20 None None] PATH_INFO: `/v3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:18:50.478379 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Tue Mar 8 15:18:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:18:59.497621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba17598-1579-45e9-9c90-5827aeac661f None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:18:59.498152 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba17598-1579-45e9-9c90-5827aeac661f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:18:59.498152 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba17598-1579-45e9-9c90-5827aeac661f None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:18:59.503133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:18:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:18:59.508364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffb898-fd2e-4839-8016-33109fcce780 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:18:59.508796 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffb898-fd2e-4839-8016-33109fcce780 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:18:59.508931 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffb898-fd2e-4839-8016-33109fcce780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:18:59.538906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG oslo_db.sqlalchemy.engines [None req-eeffb898-fd2e-4839-8016-33109fcce780 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 15:18:59.723130 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG passlib.handlers.bcrypt [None req-eeffb898-fd2e-4839-8016-33109fcce780 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79757) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 08 15:18:59.723558 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG passlib.handlers.bcrypt [None req-eeffb898-fd2e-4839-8016-33109fcce780 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79757) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 08 15:18:59.779755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-eeffb898-fd2e-4839-8016-33109fcce780 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:18:59.781333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-eeffb898-fd2e-4839-8016-33109fcce780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:18:59.901983 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:18:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 08 15:19:00.043657 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba17598-1579-45e9-9c90-5827aeac661f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:00.076533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG oslo_db.sqlalchemy.engines [None req-3ba17598-1579-45e9-9c90-5827aeac661f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 15:19:00.206462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba17598-1579-45e9-9c90-5827aeac661f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:00.210731 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81310f25-87e5-4ab1-bf5b-6ac54227488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:00.211394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81310f25-87e5-4ab1-bf5b-6ac54227488f admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:00.211682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81310f25-87e5-4ab1-bf5b-6ac54227488f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:00.211964 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81310f25-87e5-4ab1-bf5b-6ac54227488f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:00.219944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81310f25-87e5-4ab1-bf5b-6ac54227488f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:00.283418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.common.rbac_enforcer.enforcer [None req-81310f25-87e5-4ab1-bf5b-6ac54227488f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 08 15:19:00.283766 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81310f25-87e5-4ab1-bf5b-6ac54227488f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:00.293579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Mar 8 15:19:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:19:00.299512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffb898-fd2e-4839-8016-33109fcce780 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:00.314206 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffb898-fd2e-4839-8016-33109fcce780 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:00.318651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d2e5b-8ab1-4bb8-8c2d-3952b8d52019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:00.319748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d2e5b-8ab1-4bb8-8c2d-3952b8d52019 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:00.320039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d2e5b-8ab1-4bb8-8c2d-3952b8d52019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:00.320355 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d2e5b-8ab1-4bb8-8c2d-3952b8d52019 admin admin] PATH_INFO: `/v3/projects/8327b1557fad4b78a6361ee1a7f6b2e4` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:00.321882 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d2e5b-8ab1-4bb8-8c2d-3952b8d52019 admin admin] RBAC: Authorizing `identity:get_project(project_id=8327b1557fad4b78a6361ee1a7f6b2e4)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:00.373611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d09d2e5b-8ab1-4bb8-8c2d-3952b8d52019 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 08 15:19:00.373960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d2e5b-8ab1-4bb8-8c2d-3952b8d52019 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:00.378544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Mar 8 15:19:00 2022] GET /identity/v3/projects/8327b1557fad4b78a6361ee1a7f6b2e4 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:02.603408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be7ca6-1c2a-4e02-a523-6509b3ebbfa9 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:02.603896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be7ca6-1c2a-4e02-a523-6509b3ebbfa9 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:02.603896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be7ca6-1c2a-4e02-a523-6509b3ebbfa9 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:02.608513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:02.613904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a77640-c9c0-417c-83ac-b7167acbe292 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:02.614312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a77640-c9c0-417c-83ac-b7167acbe292 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:02.614476 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a77640-c9c0-417c-83ac-b7167acbe292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:02.633613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-04a77640-c9c0-417c-83ac-b7167acbe292 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:02.635741 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-04a77640-c9c0-417c-83ac-b7167acbe292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:02.643595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 08 15:19:02.665102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be7ca6-1c2a-4e02-a523-6509b3ebbfa9 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:02.677040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be7ca6-1c2a-4e02-a523-6509b3ebbfa9 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:02.681132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664628da-7aea-401d-9348-3ef31ce7a1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:02.682283 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664628da-7aea-401d-9348-3ef31ce7a1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:02.682566 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664628da-7aea-401d-9348-3ef31ce7a1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:02.682839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664628da-7aea-401d-9348-3ef31ce7a1a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:02.690252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664628da-7aea-401d-9348-3ef31ce7a1a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:02.692004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664628da-7aea-401d-9348-3ef31ce7a1a7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:02.701038 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Mar 8 15:19:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:19:02.706072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a77640-c9c0-417c-83ac-b7167acbe292 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:02.714884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a77640-c9c0-417c-83ac-b7167acbe292 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:02.719231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d70f8a-ec1b-4775-b4b7-03346ae50a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:02.720074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d70f8a-ec1b-4775-b4b7-03346ae50a77 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:02.720389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d70f8a-ec1b-4775-b4b7-03346ae50a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:02.720670 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d70f8a-ec1b-4775-b4b7-03346ae50a77 admin admin] PATH_INFO: `/v3/users/bbb6b460327949a18b1de23a04493ec0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:02.722056 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d70f8a-ec1b-4775-b4b7-03346ae50a77 admin admin] RBAC: Authorizing `identity:get_user(user_id=bbb6b460327949a18b1de23a04493ec0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:02.723878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d70f8a-ec1b-4775-b4b7-03346ae50a77 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:02.725452 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Tue Mar 8 15:19:02 2022] GET /identity/v3/users/bbb6b460327949a18b1de23a04493ec0 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:05.029688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a55d8-378b-4860-9b16-5492ad1dbdf3 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:05.030222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a55d8-378b-4860-9b16-5492ad1dbdf3 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:05.030313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a55d8-378b-4860-9b16-5492ad1dbdf3 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:05.031963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:05.037189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9087a-329f-4696-9f97-e965106593d9 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:05.037621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9087a-329f-4696-9f97-e965106593d9 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:05.037761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9087a-329f-4696-9f97-e965106593d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:05.054134 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b7a9087a-329f-4696-9f97-e965106593d9 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:05.055299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b7a9087a-329f-4696-9f97-e965106593d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:05.091784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc59a3-423d-4c32-bc06-021ae368c210 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:05.092074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc59a3-423d-4c32-bc06-021ae368c210 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:05.092603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc59a3-423d-4c32-bc06-021ae368c210 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:05.094457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:05.099944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbc591-f59b-4860-9cbc-91a3390a90fd None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:05.100259 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbc591-f59b-4860-9cbc-91a3390a90fd None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:05.100539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbc591-f59b-4860-9cbc-91a3390a90fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:05.132295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:05.140859 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG passlib.handlers.bcrypt [None req-e3bbc591-f59b-4860-9cbc-91a3390a90fd None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79756) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 08 15:19:05.141284 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG passlib.handlers.bcrypt [None req-e3bbc591-f59b-4860-9cbc-91a3390a90fd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79756) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 08 15:19:05.156304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9087a-329f-4696-9f97-e965106593d9 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:05.187752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-e3bbc591-f59b-4860-9cbc-91a3390a90fd None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:05.189360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e3bbc591-f59b-4860-9cbc-91a3390a90fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:05.251376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9087a-329f-4696-9f97-e965106593d9 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:05.283818 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe5562-8bbf-4982-9fa4-c240f50bf5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:05.283991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:19:05.284574 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe5562-8bbf-4982-9fa4-c240f50bf5f8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:05.284864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe5562-8bbf-4982-9fa4-c240f50bf5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:05.285145 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe5562-8bbf-4982-9fa4-c240f50bf5f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:05.295943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe5562-8bbf-4982-9fa4-c240f50bf5f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:05.302801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-68fe5562-8bbf-4982-9fa4-c240f50bf5f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:19:05.303995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:19:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:05.305636 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbc591-f59b-4860-9cbc-91a3390a90fd None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:05.309429 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe5562-8bbf-4982-9fa4-c240f50bf5f8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:05.400945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbc591-f59b-4860-9cbc-91a3390a90fd None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:05.403155 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe5562-8bbf-4982-9fa4-c240f50bf5f8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:05.432492 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffababb-87e4-40ac-9920-52caf4583481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:05.433379 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffababb-87e4-40ac-9920-52caf4583481 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:05.433666 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffababb-87e4-40ac-9920-52caf4583481 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:05.433947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffababb-87e4-40ac-9920-52caf4583481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:05.436503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd45727-7c9e-4fff-8da2-c89e699ebb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:05.437159 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd45727-7c9e-4fff-8da2-c89e699ebb3d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:05.437448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd45727-7c9e-4fff-8da2-c89e699ebb3d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:05.437731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd45727-7c9e-4fff-8da2-c89e699ebb3d None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:05.438482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd45727-7c9e-4fff-8da2-c89e699ebb3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:05.438795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd45727-7c9e-4fff-8da2-c89e699ebb3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:05.440200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd45727-7c9e-4fff-8da2-c89e699ebb3d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:05.451772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:05.457156 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd45727-7c9e-4fff-8da2-c89e699ebb3d None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:05.499794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffababb-87e4-40ac-9920-52caf4583481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:05.501346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffababb-87e4-40ac-9920-52caf4583481 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:05.549449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd45727-7c9e-4fff-8da2-c89e699ebb3d None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:05.581111 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69abba8-9c71-4d1f-9535-2f0c34bdf487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:05.581965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69abba8-9c71-4d1f-9535-2f0c34bdf487 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:05.582247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69abba8-9c71-4d1f-9535-2f0c34bdf487 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:05.582522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69abba8-9c71-4d1f-9535-2f0c34bdf487 None admin] PATH_INFO: `/v3/users/bbb6b460327949a18b1de23a04493ec0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:05.583732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69abba8-9c71-4d1f-9535-2f0c34bdf487 None admin] RBAC: Authorizing `identity:get_user(user_id=bbb6b460327949a18b1de23a04493ec0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:05.585233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69abba8-9c71-4d1f-9535-2f0c34bdf487 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:05.586817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 9/16] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:05 2022] GET /identity/v3/users/bbb6b460327949a18b1de23a04493ec0 => generated 247 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:05.592005 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69abba8-9c71-4d1f-9535-2f0c34bdf487 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:05.592431 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 8/17] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:05.597541 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffababb-87e4-40ac-9920-52caf4583481 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:05.688812 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffababb-87e4-40ac-9920-52caf4583481 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:05.689237 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69abba8-9c71-4d1f-9535-2f0c34bdf487 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:05.719929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f836db3-2fb3-4483-9619-e702ccbc41f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:05.720740 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f836db3-2fb3-4483-9619-e702ccbc41f5 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:05.721025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f836db3-2fb3-4483-9619-e702ccbc41f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:05.721302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f836db3-2fb3-4483-9619-e702ccbc41f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:05.721585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8d557-bd2f-40b5-99c7-b4167b4a50b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:05.722354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8d557-bd2f-40b5-99c7-b4167b4a50b6 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:05.722634 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8d557-bd2f-40b5-99c7-b4167b4a50b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:05.722906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8d557-bd2f-40b5-99c7-b4167b4a50b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:05.724066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8d557-bd2f-40b5-99c7-b4167b4a50b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:05.725528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8d557-bd2f-40b5-99c7-b4167b4a50b6 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:05.727106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 10/18] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:05.732784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8d557-bd2f-40b5-99c7-b4167b4a50b6 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:05.739326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f836db3-2fb3-4483-9619-e702ccbc41f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:05.740833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f836db3-2fb3-4483-9619-e702ccbc41f5 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:05.758111 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-3f836db3-2fb3-4483-9619-e702ccbc41f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:19:05.759358 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 9/19] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:05.765433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f836db3-2fb3-4483-9619-e702ccbc41f5 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:05.827146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8d557-bd2f-40b5-99c7-b4167b4a50b6 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:05.857564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f836db3-2fb3-4483-9619-e702ccbc41f5 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:05.857984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97e3e2-6707-4ef8-ab22-015a9e7b2a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:05.858632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97e3e2-6707-4ef8-ab22-015a9e7b2a20 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:05.858917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97e3e2-6707-4ef8-ab22-015a9e7b2a20 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:05.859191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97e3e2-6707-4ef8-ab22-015a9e7b2a20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:05.860016 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97e3e2-6707-4ef8-ab22-015a9e7b2a20 None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.domain.id=default, user.id=bbb6b460327949a18b1de23a04493ec0) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:05.860348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97e3e2-6707-4ef8-ab22-015a9e7b2a20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:05.861790 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97e3e2-6707-4ef8-ab22-015a9e7b2a20 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:05.868513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Mar 8 15:19:05 2022] GET /identity/v3/role_assignments?user.id=bbb6b460327949a18b1de23a04493ec0&scope.domain.id=default&role.id=24a7898c863141f1911792647b5274e3 => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:05.893779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164b2b5-d14a-4480-ae2a-970be63bd085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:05.894471 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164b2b5-d14a-4480-ae2a-970be63bd085 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:05.894757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164b2b5-d14a-4480-ae2a-970be63bd085 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:05.895038 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164b2b5-d14a-4480-ae2a-970be63bd085 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:05.895794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164b2b5-d14a-4480-ae2a-970be63bd085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:05.896109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164b2b5-d14a-4480-ae2a-970be63bd085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:05.897672 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164b2b5-d14a-4480-ae2a-970be63bd085 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:05.917294 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 10/21] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:08.739088 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176c69-89c4-4cd0-b1cc-f2a8176c4d43 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:08.739593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176c69-89c4-4cd0-b1cc-f2a8176c4d43 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:08.739690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48176c69-89c4-4cd0-b1cc-f2a8176c4d43 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:08.742254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:08.747594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00946c-0cd6-4e72-8f14-b22b0f0e1521 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:08.748023 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00946c-0cd6-4e72-8f14-b22b0f0e1521 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:08.748208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00946c-0cd6-4e72-8f14-b22b0f0e1521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:08.770747 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-9b00946c-0cd6-4e72-8f14-b22b0f0e1521 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:08.771950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9b00946c-0cd6-4e72-8f14-b22b0f0e1521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:08.854794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:08.897682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48176c69-89c4-4cd0-b1cc-f2a8176c4d43 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:09.017313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48176c69-89c4-4cd0-b1cc-f2a8176c4d43 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:09.064883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660e5c8-9786-40ba-8f89-8d454f70d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:09.065575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660e5c8-9786-40ba-8f89-8d454f70d8e9 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.065870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660e5c8-9786-40ba-8f89-8d454f70d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.066154 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660e5c8-9786-40ba-8f89-8d454f70d8e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.066923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660e5c8-9786-40ba-8f89-8d454f70d8e9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:09.068375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660e5c8-9786-40ba-8f89-8d454f70d8e9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:09.131913 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44239ab-67a0-4dd0-8de4-9fdc5c3ef6e6 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.132250 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44239ab-67a0-4dd0-8de4-9fdc5c3ef6e6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.132522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44239ab-67a0-4dd0-8de4-9fdc5c3ef6e6 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.134856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:09.145047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11a8f2-3c25-4919-9cff-2ea97eca09c1 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.145636 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11a8f2-3c25-4919-9cff-2ea97eca09c1 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.146122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11a8f2-3c25-4919-9cff-2ea97eca09c1 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.148482 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 13/25] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:09.149756 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2252676-8c26-4952-b450-c6b097d1cd61 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.150204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2252676-8c26-4952-b450-c6b097d1cd61 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.156391 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2252676-8c26-4952-b450-c6b097d1cd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.173076 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c2252676-8c26-4952-b450-c6b097d1cd61 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:09.174416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c2252676-8c26-4952-b450-c6b097d1cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:09.295189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 14/26] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:09.296520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eac30a-2404-4cdb-a667-8a2333283b3c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.296814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eac30a-2404-4cdb-a667-8a2333283b3c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.297099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eac30a-2404-4cdb-a667-8a2333283b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.314793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 13/27] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Mar 8 15:19:08 2022] POST /identity/v3/roles => generated 219 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:19:09.323340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-92eac30a-2404-4cdb-a667-8a2333283b3c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:09.324615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-92eac30a-2404-4cdb-a667-8a2333283b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:09.341310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660e5c8-9786-40ba-8f89-8d454f70d8e9 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:09.409080 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 15/28] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:09.436749 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eac30a-2404-4cdb-a667-8a2333283b3c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:09.513774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660e5c8-9786-40ba-8f89-8d454f70d8e9 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:09.580412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca078b96-49ec-4209-8055-78e2a2f7d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:09.581468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca078b96-49ec-4209-8055-78e2a2f7d97d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.581899 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca078b96-49ec-4209-8055-78e2a2f7d97d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.582320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca078b96-49ec-4209-8055-78e2a2f7d97d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.596056 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca078b96-49ec-4209-8055-78e2a2f7d97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:09.597953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca078b96-49ec-4209-8055-78e2a2f7d97d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:09.609284 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eac30a-2404-4cdb-a667-8a2333283b3c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:09.617149 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-ca078b96-49ec-4209-8055-78e2a2f7d97d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:19:09.619203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 14/29] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:09.620976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff013714-f7d6-40ea-ba89-b22904384f4e None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.621504 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff013714-f7d6-40ea-ba89-b22904384f4e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.622006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff013714-f7d6-40ea-ba89-b22904384f4e None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.623913 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 15/30] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:09.626255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff013714-f7d6-40ea-ba89-b22904384f4e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:09.656132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc76432-d334-4db7-91dc-fcc886fa0b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:09.657378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc76432-d334-4db7-91dc-fcc886fa0b9d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.657919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc76432-d334-4db7-91dc-fcc886fa0b9d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.658396 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc76432-d334-4db7-91dc-fcc886fa0b9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.672919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc76432-d334-4db7-91dc-fcc886fa0b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:09.682835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-7bc76432-d334-4db7-91dc-fcc886fa0b9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:19:09.682835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 16/31] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:19:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:09.683266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52445288-8bb0-422f-a081-d5a46b6276a3 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.683555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52445288-8bb0-422f-a081-d5a46b6276a3 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.683838 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52445288-8bb0-422f-a081-d5a46b6276a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.703319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-52445288-8bb0-422f-a081-d5a46b6276a3 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:09.704615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-52445288-8bb0-422f-a081-d5a46b6276a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:09.741087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff013714-f7d6-40ea-ba89-b22904384f4e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:09.778674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40524440-35c7-4104-973f-4b5972c29a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:09.779383 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40524440-35c7-4104-973f-4b5972c29a2c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.779659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40524440-35c7-4104-973f-4b5972c29a2c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.779913 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40524440-35c7-4104-973f-4b5972c29a2c None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.780697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40524440-35c7-4104-973f-4b5972c29a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:09.781024 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40524440-35c7-4104-973f-4b5972c29a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:09.782402 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40524440-35c7-4104-973f-4b5972c29a2c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:09.783010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 17/32] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:09.784654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52445288-8bb0-422f-a081-d5a46b6276a3 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:09.801132 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 16/33] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:09.802586 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c213c-f5aa-4f9a-b388-4e8f61492cc4 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.802884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c213c-f5aa-4f9a-b388-4e8f61492cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.803168 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c213c-f5aa-4f9a-b388-4e8f61492cc4 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.805460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 17/34] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:09.808444 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c213c-f5aa-4f9a-b388-4e8f61492cc4 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:09.889736 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52445288-8bb0-422f-a081-d5a46b6276a3 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:09.913105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c213c-f5aa-4f9a-b388-4e8f61492cc4 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:09.923660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac23040-e971-43e5-9c1a-ccf8a2ba8967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:09.924630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac23040-e971-43e5-9c1a-ccf8a2ba8967 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.924914 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac23040-e971-43e5-9c1a-ccf8a2ba8967 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.925190 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac23040-e971-43e5-9c1a-ccf8a2ba8967 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.925942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac23040-e971-43e5-9c1a-ccf8a2ba8967 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:09.926248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac23040-e971-43e5-9c1a-ccf8a2ba8967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:09.927636 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac23040-e971-43e5-9c1a-ccf8a2ba8967 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:09.939591 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 18/35] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:09.941003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e982-6762-42b4-b909-eeacfddb61be None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.941298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e982-6762-42b4-b909-eeacfddb61be None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.941575 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5e982-6762-42b4-b909-eeacfddb61be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.957007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f09d6c-2c04-4ec6-89a2-7a88d3859668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:09.957769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09d6c-2c04-4ec6-89a2-7a88d3859668 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:09.958036 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09d6c-2c04-4ec6-89a2-7a88d3859668 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:09.958312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f09d6c-2c04-4ec6-89a2-7a88d3859668 None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:09.958618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-d4f5e982-6762-42b4-b909-eeacfddb61be None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:09.959033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f09d6c-2c04-4ec6-89a2-7a88d3859668 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:09.959813 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d4f5e982-6762-42b4-b909-eeacfddb61be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:09.960516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f09d6c-2c04-4ec6-89a2-7a88d3859668 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:10.024550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 19/36] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:10.025965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5e982-6762-42b4-b909-eeacfddb61be None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:10.047992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:19:09 2022] POST /identity/v3/projects => generated 301 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:19:10.049231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f09d6c-2c04-4ec6-89a2-7a88d3859668 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:10.171625 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5e982-6762-42b4-b909-eeacfddb61be None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:10.176197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f09d6c-2c04-4ec6-89a2-7a88d3859668 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:10.209835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f4562-e2f0-4d2d-8a74-5b0382658470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:10.210228 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593aab2-30d8-4e43-8500-bd10195da5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:10.210524 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f4562-e2f0-4d2d-8a74-5b0382658470 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:10.210812 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f4562-e2f0-4d2d-8a74-5b0382658470 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:10.211038 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593aab2-30d8-4e43-8500-bd10195da5c8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:10.211128 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f4562-e2f0-4d2d-8a74-5b0382658470 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:10.211329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593aab2-30d8-4e43-8500-bd10195da5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:10.211612 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593aab2-30d8-4e43-8500-bd10195da5c8 None admin] PATH_INFO: `/v3/users/bbb6b460327949a18b1de23a04493ec0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:10.211846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f4562-e2f0-4d2d-8a74-5b0382658470 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:10.213449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593aab2-30d8-4e43-8500-bd10195da5c8 None admin] RBAC: Authorizing `identity:get_user(user_id=bbb6b460327949a18b1de23a04493ec0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:10.213852 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f4562-e2f0-4d2d-8a74-5b0382658470 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:10.214942 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593aab2-30d8-4e43-8500-bd10195da5c8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:10.216683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 19/38] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:10 2022] GET /identity/v3/users/bbb6b460327949a18b1de23a04493ec0 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:10.217468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593aab2-30d8-4e43-8500-bd10195da5c8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:10.324278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593aab2-30d8-4e43-8500-bd10195da5c8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:10.356715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a7bb2-c47f-4e52-9a19-5885f85891ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:10.357370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a7bb2-c47f-4e52-9a19-5885f85891ed None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:10.357665 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a7bb2-c47f-4e52-9a19-5885f85891ed None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:10.357933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a7bb2-c47f-4e52-9a19-5885f85891ed None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:10.358696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a7bb2-c47f-4e52-9a19-5885f85891ed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:10.360064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a7bb2-c47f-4e52-9a19-5885f85891ed None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:10.408536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Mar 8 15:19:10 2022] POST /identity/v3/roles => generated 223 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:19:10.409974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd1f15-97c6-4ab6-a6c7-100fce6da1e4 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:10.410274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd1f15-97c6-4ab6-a6c7-100fce6da1e4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:10.410563 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd1f15-97c6-4ab6-a6c7-100fce6da1e4 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:10.412746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 21/40] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:10.412951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd1f15-97c6-4ab6-a6c7-100fce6da1e4 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:10.420933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Mar 8 15:19:10 2022] POST /identity/v3/roles => generated 225 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:19:10.426205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b77a-43e6-475c-b8a4-a9fd540e2b12 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:10.426647 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b77a-43e6-475c-b8a4-a9fd540e2b12 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:10.432391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b77a-43e6-475c-b8a4-a9fd540e2b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:10.460119 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7440b77a-43e6-475c-b8a4-a9fd540e2b12 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:10.463029 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7440b77a-43e6-475c-b8a4-a9fd540e2b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:10.548598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 21/42] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:10.565602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd1f15-97c6-4ab6-a6c7-100fce6da1e4 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:10.587152 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b77a-43e6-475c-b8a4-a9fd540e2b12 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:10.616089 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891f2f3-c284-4a9b-8ae2-2f101fdec7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:10.617471 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891f2f3-c284-4a9b-8ae2-2f101fdec7ac None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:10.618172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891f2f3-c284-4a9b-8ae2-2f101fdec7ac None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:10.619154 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891f2f3-c284-4a9b-8ae2-2f101fdec7ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:10.621888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891f2f3-c284-4a9b-8ae2-2f101fdec7ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:10.624487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891f2f3-c284-4a9b-8ae2-2f101fdec7ac None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:10.627529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 22/43] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:10.635717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891f2f3-c284-4a9b-8ae2-2f101fdec7ac None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:10.719901 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b77a-43e6-475c-b8a4-a9fd540e2b12 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:10.754341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891f2f3-c284-4a9b-8ae2-2f101fdec7ac None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:10.755776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2bdd5-7964-44eb-acb7-1154e0a81471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:10.756613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2bdd5-7964-44eb-acb7-1154e0a81471 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:10.756901 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2bdd5-7964-44eb-acb7-1154e0a81471 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:10.757181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2bdd5-7964-44eb-acb7-1154e0a81471 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:10.758347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2bdd5-7964-44eb-acb7-1154e0a81471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:10.760487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2bdd5-7964-44eb-acb7-1154e0a81471 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:10.762096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 22/44] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:10.767441 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2bdd5-7964-44eb-acb7-1154e0a81471 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:10.787577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6169294-22b5-42ee-9eed-9ad4368ea576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:10.788467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6169294-22b5-42ee-9eed-9ad4368ea576 None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:10.788750 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6169294-22b5-42ee-9eed-9ad4368ea576 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:10.789032 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6169294-22b5-42ee-9eed-9ad4368ea576 None admin] PATH_INFO: `/v3/domains/default/users/bbb6b460327949a18b1de23a04493ec0/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:10.791947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6169294-22b5-42ee-9eed-9ad4368ea576 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bbb6b460327949a18b1de23a04493ec0, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:10.793430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6169294-22b5-42ee-9eed-9ad4368ea576 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:10.859357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 23/45] 10.222.0.25 () {58 vars in 1361 bytes} [Tue Mar 8 15:19:10 2022] PUT /identity/v3/domains/default/users/bbb6b460327949a18b1de23a04493ec0/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:19:10.861613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2bdd5-7964-44eb-acb7-1154e0a81471 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:10.896599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75448e20-591a-42ea-9962-b16acd5784bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:10.897278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448e20-591a-42ea-9962-b16acd5784bd None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:10.897578 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448e20-591a-42ea-9962-b16acd5784bd None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:10.897845 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448e20-591a-42ea-9962-b16acd5784bd None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:10.898578 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75448e20-591a-42ea-9962-b16acd5784bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:10.900636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75448e20-591a-42ea-9962-b16acd5784bd None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:10.975786 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:19:10 2022] POST /identity/v3/projects => generated 312 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:19:13.112488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd7675-113a-4fe1-8db3-c983d81a1dc8 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:13.113025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd7675-113a-4fe1-8db3-c983d81a1dc8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:13.113025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd7675-113a-4fe1-8db3-c983d81a1dc8 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:13.114796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 24/47] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:13.120321 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0374e07-dd26-4952-8f09-33bf620c7de6 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:13.120715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0374e07-dd26-4952-8f09-33bf620c7de6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:13.120894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0374e07-dd26-4952-8f09-33bf620c7de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:13.137316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b0374e07-dd26-4952-8f09-33bf620c7de6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:13.138510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b0374e07-dd26-4952-8f09-33bf620c7de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:13.201992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 24/48] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:13.225370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd7675-113a-4fe1-8db3-c983d81a1dc8 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:13.320598 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd7675-113a-4fe1-8db3-c983d81a1dc8 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:13.352608 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa27d2f-e9d5-4e24-a499-85d45a0c56eb None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:13.352904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa27d2f-e9d5-4e24-a499-85d45a0c56eb None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:13.353088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bee9e-f400-4567-923b-22a05ca02198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:13.353219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa27d2f-e9d5-4e24-a499-85d45a0c56eb None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:13.353878 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bee9e-f400-4567-923b-22a05ca02198 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:13.354169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bee9e-f400-4567-923b-22a05ca02198 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:13.354450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bee9e-f400-4567-923b-22a05ca02198 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:13.354975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 25/49] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:13.359807 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf84f0-f61b-4e42-9eb5-6e14bca1fd65 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:13.360103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf84f0-f61b-4e42-9eb5-6e14bca1fd65 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:13.360417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf84f0-f61b-4e42-9eb5-6e14bca1fd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:13.364564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bee9e-f400-4567-923b-22a05ca02198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:13.371584 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-8b4bee9e-f400-4567-923b-22a05ca02198 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:19:13.372795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 25/50] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:19:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:13.377199 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-f9cf84f0-f61b-4e42-9eb5-6e14bca1fd65 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:13.378374 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f9cf84f0-f61b-4e42-9eb5-6e14bca1fd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:13.378483 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bee9e-f400-4567-923b-22a05ca02198 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:13.440624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 26/51] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:19:13.464129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf84f0-f61b-4e42-9eb5-6e14bca1fd65 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:13.472630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bee9e-f400-4567-923b-22a05ca02198 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:13.504009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d05221-2967-4f95-a89a-35ad37bf7aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:13.504703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d05221-2967-4f95-a89a-35ad37bf7aa1 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:13.504994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d05221-2967-4f95-a89a-35ad37bf7aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:13.505279 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d05221-2967-4f95-a89a-35ad37bf7aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:13.506028 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d05221-2967-4f95-a89a-35ad37bf7aa1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:13.506342 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d05221-2967-4f95-a89a-35ad37bf7aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:13.507738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d05221-2967-4f95-a89a-35ad37bf7aa1 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:13.515997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 26/52] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:13.521402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d05221-2967-4f95-a89a-35ad37bf7aa1 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:13.556968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf84f0-f61b-4e42-9eb5-6e14bca1fd65 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:13.589847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b4145-7e9c-4b8d-b947-0399865aed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:13.590704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b4145-7e9c-4b8d-b947-0399865aed5f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:13.590993 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b4145-7e9c-4b8d-b947-0399865aed5f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:13.591277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b4145-7e9c-4b8d-b947-0399865aed5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:13.592512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b4145-7e9c-4b8d-b947-0399865aed5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:13.593976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b4145-7e9c-4b8d-b947-0399865aed5f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:13.595581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:13.600933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b4145-7e9c-4b8d-b947-0399865aed5f None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:13.614448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d05221-2967-4f95-a89a-35ad37bf7aa1 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:13.646878 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3f35c-7f08-410e-86a8-560eadbafd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:13.647789 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3f35c-7f08-410e-86a8-560eadbafd98 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:13.648087 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3f35c-7f08-410e-86a8-560eadbafd98 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:13.648399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3f35c-7f08-410e-86a8-560eadbafd98 None admin] PATH_INFO: `/v3/users/bbb6b460327949a18b1de23a04493ec0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:13.649614 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3f35c-7f08-410e-86a8-560eadbafd98 None admin] RBAC: Authorizing `identity:get_user(user_id=bbb6b460327949a18b1de23a04493ec0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:13.651065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3f35c-7f08-410e-86a8-560eadbafd98 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:13.652698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 27/54] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:13 2022] GET /identity/v3/users/bbb6b460327949a18b1de23a04493ec0 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:13.657991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3f35c-7f08-410e-86a8-560eadbafd98 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:13.695231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b4145-7e9c-4b8d-b947-0399865aed5f None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:13.727878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719777d-c31f-4291-abe4-e28e29cb78fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:13.728557 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719777d-c31f-4291-abe4-e28e29cb78fb None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:13.728848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719777d-c31f-4291-abe4-e28e29cb78fb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:13.729139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719777d-c31f-4291-abe4-e28e29cb78fb None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:13.729841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719777d-c31f-4291-abe4-e28e29cb78fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:13.731295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719777d-c31f-4291-abe4-e28e29cb78fb None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:13.751125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3f35c-7f08-410e-86a8-560eadbafd98 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:13.787041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39173a56-0559-4714-8abd-dcd3866fab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:13.787817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39173a56-0559-4714-8abd-dcd3866fab4f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:13.788105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39173a56-0559-4714-8abd-dcd3866fab4f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:13.788423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39173a56-0559-4714-8abd-dcd3866fab4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:13.789610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39173a56-0559-4714-8abd-dcd3866fab4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:13.791150 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39173a56-0559-4714-8abd-dcd3866fab4f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:13.792807 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:13.798340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39173a56-0559-4714-8abd-dcd3866fab4f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:13.837935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 28/56] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Mar 8 15:19:13 2022] POST /identity/v3/projects => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:19:13.899201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39173a56-0559-4714-8abd-dcd3866fab4f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:13.933832 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cc5a4-f029-4dfa-a098-5ed5d10dc0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:13.934507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cc5a4-f029-4dfa-a098-5ed5d10dc0ce None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:13.934799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cc5a4-f029-4dfa-a098-5ed5d10dc0ce None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:13.935084 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cc5a4-f029-4dfa-a098-5ed5d10dc0ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:13.935937 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cc5a4-f029-4dfa-a098-5ed5d10dc0ce None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.domain.id=default, user.id=bbb6b460327949a18b1de23a04493ec0) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:13.936296 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cc5a4-f029-4dfa-a098-5ed5d10dc0ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:13.937795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cc5a4-f029-4dfa-a098-5ed5d10dc0ce None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:13.949792 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Mar 8 15:19:13 2022] GET /identity/v3/role_assignments?user.id=bbb6b460327949a18b1de23a04493ec0&scope.domain.id=default&role.id=24a7898c863141f1911792647b5274e3 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:16.115861 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91a75c-b1fb-4fec-9471-74d9e67a8535 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:16.116392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91a75c-b1fb-4fec-9471-74d9e67a8535 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:16.116473 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91a75c-b1fb-4fec-9471-74d9e67a8535 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:16.118509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 29/58] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:16.123735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956dbb1-a74f-455d-9d9d-21a89690febb None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:16.124170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956dbb1-a74f-455d-9d9d-21a89690febb None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:16.124326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956dbb1-a74f-455d-9d9d-21a89690febb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:16.141227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-3956dbb1-a74f-455d-9d9d-21a89690febb None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:16.142432 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3956dbb1-a74f-455d-9d9d-21a89690febb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:16.205503 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 30/59] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:16.230134 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91a75c-b1fb-4fec-9471-74d9e67a8535 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:16.326518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91a75c-b1fb-4fec-9471-74d9e67a8535 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:16.357259 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423170b-1908-454d-b295-b0982dd98fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:16.358035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423170b-1908-454d-b295-b0982dd98fea None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:16.358320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423170b-1908-454d-b295-b0982dd98fea None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:16.358596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423170b-1908-454d-b295-b0982dd98fea None admin] PATH_INFO: `/v3/domains/default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:16.359761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423170b-1908-454d-b295-b0982dd98fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:16.361235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423170b-1908-454d-b295-b0982dd98fea None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:16.362821 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 30/60] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:16.368760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956dbb1-a74f-455d-9d9d-21a89690febb None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:16.459908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956dbb1-a74f-455d-9d9d-21a89690febb None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:16.491164 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e54148-6085-4793-be43-303b282255dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:16.491838 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e54148-6085-4793-be43-303b282255dd None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:16.492111 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e54148-6085-4793-be43-303b282255dd None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:16.492675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e54148-6085-4793-be43-303b282255dd None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:16.493408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e54148-6085-4793-be43-303b282255dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:16.494853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e54148-6085-4793-be43-303b282255dd None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:16.617880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 31/61] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:19:16 2022] POST /identity/v3/users => generated 275 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:19:20.260645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28fb42-e074-4876-93fb-5922c3a79e7a None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.261208 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28fb42-e074-4876-93fb-5922c3a79e7a None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.261208 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28fb42-e074-4876-93fb-5922c3a79e7a None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.263171 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 31/62] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:20.268386 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38f11-1a8b-4360-82b4-3360d14643d4 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.269380 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38f11-1a8b-4360-82b4-3360d14643d4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.269886 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38f11-1a8b-4360-82b4-3360d14643d4 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.272120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:20.277874 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8c57d-de81-4ae3-b4b6-0ada8345ce50 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.278436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8c57d-de81-4ae3-b4b6-0ada8345ce50 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.279183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8c57d-de81-4ae3-b4b6-0ada8345ce50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.282112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39095825-31c2-4ed2-b290-d9c70daabaca None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.283016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39095825-31c2-4ed2-b290-d9c70daabaca None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.284033 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39095825-31c2-4ed2-b290-d9c70daabaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.311782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-8fc8c57d-de81-4ae3-b4b6-0ada8345ce50 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:20.315011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8fc8c57d-de81-4ae3-b4b6-0ada8345ce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:20.327286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-39095825-31c2-4ed2-b290-d9c70daabaca None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:20.328793 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-39095825-31c2-4ed2-b290-d9c70daabaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:20.430148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 33/64] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:20.431771 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866a81f-d4bc-4deb-be66-5a0cd232cc8e None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.432068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866a81f-d4bc-4deb-be66-5a0cd232cc8e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.432381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866a81f-d4bc-4deb-be66-5a0cd232cc8e None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.434028 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 34/65] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:20.435422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e5bb3-e98e-491a-a0c2-33265a9941ea None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.435875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e5bb3-e98e-491a-a0c2-33265a9941ea None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.436393 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e5bb3-e98e-491a-a0c2-33265a9941ea None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.440390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 32/66] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:20.441919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94a8d9-a8ae-4cb2-92fb-5de61bfddfc3 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.442426 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94a8d9-a8ae-4cb2-92fb-5de61bfddfc3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.442913 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94a8d9-a8ae-4cb2-92fb-5de61bfddfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.448578 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 35/67] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:20 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:20.455210 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e5bb3-e98e-491a-a0c2-33265a9941ea None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:20.460544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-1d94a8d9-a8ae-4cb2-92fb-5de61bfddfc3 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:20.462524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1d94a8d9-a8ae-4cb2-92fb-5de61bfddfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:20.540183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 33/68] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:20.540183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec70f2-4e81-410e-914c-2a3f58082cd4 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.540183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec70f2-4e81-410e-914c-2a3f58082cd4 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.540183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec70f2-4e81-410e-914c-2a3f58082cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.558970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e5bb3-e98e-491a-a0c2-33265a9941ea None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:20.559536 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-f7ec70f2-4e81-410e-914c-2a3f58082cd4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:20.560740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f7ec70f2-4e81-410e-914c-2a3f58082cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:20.594727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bec0db-bc0b-4dcf-80b4-d91e9e149d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:20.595797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bec0db-bc0b-4dcf-80b4-d91e9e149d7c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.595913 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bec0db-bc0b-4dcf-80b4-d91e9e149d7c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.596211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bec0db-bc0b-4dcf-80b4-d91e9e149d7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.606641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bec0db-bc0b-4dcf-80b4-d91e9e149d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:20.613487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-42bec0db-bc0b-4dcf-80b4-d91e9e149d7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:19:20.618247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 36/69] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:20.618247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bec0db-bc0b-4dcf-80b4-d91e9e149d7c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:20.629149 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 34/70] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:20.629993 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec70f2-4e81-410e-914c-2a3f58082cd4 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:20.711375 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bec0db-bc0b-4dcf-80b4-d91e9e149d7c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:20.722916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec70f2-4e81-410e-914c-2a3f58082cd4 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:20.743612 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b04d5d-3c56-4566-b236-bc21c9a3cbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:20.744439 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b04d5d-3c56-4566-b236-bc21c9a3cbee None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.744732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b04d5d-3c56-4566-b236-bc21c9a3cbee None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.745015 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b04d5d-3c56-4566-b236-bc21c9a3cbee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.754863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b04d5d-3c56-4566-b236-bc21c9a3cbee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:20.755630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288f5de-f486-407a-af89-49acb7bd77e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:20.756442 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288f5de-f486-407a-af89-49acb7bd77e1 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.756730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288f5de-f486-407a-af89-49acb7bd77e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.757009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288f5de-f486-407a-af89-49acb7bd77e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.762652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-c7b04d5d-3c56-4566-b236-bc21c9a3cbee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:19:20.763782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 37/71] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:19:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:20.764999 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491eef1-6fd2-4095-a6d4-f381c8322c22 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.765289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491eef1-6fd2-4095-a6d4-f381c8322c22 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.765572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491eef1-6fd2-4095-a6d4-f381c8322c22 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.767085 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288f5de-f486-407a-af89-49acb7bd77e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:20.767243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 38/72] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:20.767944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491eef1-6fd2-4095-a6d4-f381c8322c22 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:20.774564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-f288f5de-f486-407a-af89-49acb7bd77e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:20.775762 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 35/73] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:20.776564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288f5de-f486-407a-af89-49acb7bd77e1 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:20.862896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491eef1-6fd2-4095-a6d4-f381c8322c22 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:20.871320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288f5de-f486-407a-af89-49acb7bd77e1 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:20.894182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc16cc8-5402-4338-ae06-91439f9c2491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:20.894833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc16cc8-5402-4338-ae06-91439f9c2491 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.895116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc16cc8-5402-4338-ae06-91439f9c2491 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.895403 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc16cc8-5402-4338-ae06-91439f9c2491 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.896140 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc16cc8-5402-4338-ae06-91439f9c2491 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:20.896479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc16cc8-5402-4338-ae06-91439f9c2491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:20.897865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc16cc8-5402-4338-ae06-91439f9c2491 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:20.903011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301f4bb-aa4f-4da8-9e2c-f4ef89f4a9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:20.903782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301f4bb-aa4f-4da8-9e2c-f4ef89f4a9de None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.904071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301f4bb-aa4f-4da8-9e2c-f4ef89f4a9de None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.904446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301f4bb-aa4f-4da8-9e2c-f4ef89f4a9de None admin] PATH_INFO: `/v3/roles/member` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.907277 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 39/74] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:20.908067 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc16cc8-5402-4338-ae06-91439f9c2491 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:20.914245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301f4bb-aa4f-4da8-9e2c-f4ef89f4a9de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:20.921241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-d301f4bb-aa4f-4da8-9e2c-f4ef89f4a9de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:20.922409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 36/75] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:20.923561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e0b56-6738-4e55-86f6-5dc40a55f36f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:20.923849 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e0b56-6738-4e55-86f6-5dc40a55f36f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:20.924131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e0b56-6738-4e55-86f6-5dc40a55f36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:20.940703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-3e1e0b56-6738-4e55-86f6-5dc40a55f36f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:20.941889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3e1e0b56-6738-4e55-86f6-5dc40a55f36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:21.001170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc16cc8-5402-4338-ae06-91439f9c2491 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:21.003884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 37/76] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:21.004729 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e0b56-6738-4e55-86f6-5dc40a55f36f None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:21.035798 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dc0e1-ebf7-4379-987a-da826d2bb6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:21.036492 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dc0e1-ebf7-4379-987a-da826d2bb6fa None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:21.036779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dc0e1-ebf7-4379-987a-da826d2bb6fa None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:21.037058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dc0e1-ebf7-4379-987a-da826d2bb6fa None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:21.037799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dc0e1-ebf7-4379-987a-da826d2bb6fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:21.038104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dc0e1-ebf7-4379-987a-da826d2bb6fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:21.039462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dc0e1-ebf7-4379-987a-da826d2bb6fa None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:21.047005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 40/77] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:19:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:21.047957 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dc0e1-ebf7-4379-987a-da826d2bb6fa None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:21.097942 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e0b56-6738-4e55-86f6-5dc40a55f36f None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:21.130139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87999400-f0a7-4618-8dfa-4624ecde9b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:21.130804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999400-f0a7-4618-8dfa-4624ecde9b60 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:21.131094 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999400-f0a7-4618-8dfa-4624ecde9b60 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:21.131374 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999400-f0a7-4618-8dfa-4624ecde9b60 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:21.132123 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87999400-f0a7-4618-8dfa-4624ecde9b60 None admin] RBAC: Adding query filter params (name=member) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:21.132464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87999400-f0a7-4618-8dfa-4624ecde9b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:21.134458 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87999400-f0a7-4618-8dfa-4624ecde9b60 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:21.142559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 38/78] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:21.143376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87999400-f0a7-4618-8dfa-4624ecde9b60 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:21.143924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dc0e1-ebf7-4379-987a-da826d2bb6fa None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:21.175303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b57ab7-a27c-432c-aed2-3ac1315e8e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:21.176197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b57ab7-a27c-432c-aed2-3ac1315e8e20 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:21.176490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b57ab7-a27c-432c-aed2-3ac1315e8e20 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:21.176773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b57ab7-a27c-432c-aed2-3ac1315e8e20 None admin] PATH_INFO: `/v3/users/bbb6b460327949a18b1de23a04493ec0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:21.177971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b57ab7-a27c-432c-aed2-3ac1315e8e20 None admin] RBAC: Authorizing `identity:get_user(user_id=bbb6b460327949a18b1de23a04493ec0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:21.179413 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b57ab7-a27c-432c-aed2-3ac1315e8e20 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:21.181565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 41/79] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:21 2022] GET /identity/v3/users/bbb6b460327949a18b1de23a04493ec0 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:21.183026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b57ab7-a27c-432c-aed2-3ac1315e8e20 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:21.235814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87999400-f0a7-4618-8dfa-4624ecde9b60 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:21.268295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977ce1a-4f90-43c5-a475-4e176e92965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:21.268905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977ce1a-4f90-43c5-a475-4e176e92965a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:21.269193 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977ce1a-4f90-43c5-a475-4e176e92965a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:21.269479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977ce1a-4f90-43c5-a475-4e176e92965a None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:21.270221 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977ce1a-4f90-43c5-a475-4e176e92965a None admin] RBAC: Adding query filter params (name=member) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:21.270530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977ce1a-4f90-43c5-a475-4e176e92965a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:21.271916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977ce1a-4f90-43c5-a475-4e176e92965a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:21.274477 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b57ab7-a27c-432c-aed2-3ac1315e8e20 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:21.279714 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 39/80] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:21.280537 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977ce1a-4f90-43c5-a475-4e176e92965a None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:21.308887 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67148ab8-27b2-465b-aa02-87dcc505f6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:21.309687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67148ab8-27b2-465b-aa02-87dcc505f6e6 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:21.310177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67148ab8-27b2-465b-aa02-87dcc505f6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:21.310632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67148ab8-27b2-465b-aa02-87dcc505f6e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:21.312459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67148ab8-27b2-465b-aa02-87dcc505f6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:21.314584 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67148ab8-27b2-465b-aa02-87dcc505f6e6 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:21.316244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 42/81] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:21.317377 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67148ab8-27b2-465b-aa02-87dcc505f6e6 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:21.374680 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977ce1a-4f90-43c5-a475-4e176e92965a None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:21.406339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e66613-d398-47c1-bfd4-6b076a5927cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:21.407204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e66613-d398-47c1-bfd4-6b076a5927cc None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:21.407489 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e66613-d398-47c1-bfd4-6b076a5927cc None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:21.407771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e66613-d398-47c1-bfd4-6b076a5927cc None admin] PATH_INFO: `/v3/users/3fa609439efa41e7832b839df854b004` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:21.409317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67148ab8-27b2-465b-aa02-87dcc505f6e6 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:21.421207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e66613-d398-47c1-bfd4-6b076a5927cc None admin] RBAC: Authorizing `identity:get_user(user_id=3fa609439efa41e7832b839df854b004)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:21.422674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e66613-d398-47c1-bfd4-6b076a5927cc None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:21.424349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 40/82] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:21 2022] GET /identity/v3/users/3fa609439efa41e7832b839df854b004 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:21.425115 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e66613-d398-47c1-bfd4-6b076a5927cc None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:21.445599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d576f-f726-40f2-b443-61972228f363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:21.447024 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d576f-f726-40f2-b443-61972228f363 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:21.447320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d576f-f726-40f2-b443-61972228f363 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:21.447596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d576f-f726-40f2-b443-61972228f363 None admin] PATH_INFO: `/v3/users/3fa609439efa41e7832b839df854b004` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:21.448848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d576f-f726-40f2-b443-61972228f363 None admin] RBAC: Authorizing `identity:get_user(user_id=3fa609439efa41e7832b839df854b004)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:21.450302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d576f-f726-40f2-b443-61972228f363 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:21.451917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 43/83] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:21 2022] GET /identity/v3/users/3fa609439efa41e7832b839df854b004 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:21.452714 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d576f-f726-40f2-b443-61972228f363 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:21.518466 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e66613-d398-47c1-bfd4-6b076a5927cc None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:21.544984 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d576f-f726-40f2-b443-61972228f363 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:21.549988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0b32f-cac6-4acc-ae74-01cd518818c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:21.550632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0b32f-cac6-4acc-ae74-01cd518818c2 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:21.550920 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0b32f-cac6-4acc-ae74-01cd518818c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:21.551213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0b32f-cac6-4acc-ae74-01cd518818c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:21.576558 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dbc89-0034-4db2-a796-225c7f8f96f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:21.577409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dbc89-0034-4db2-a796-225c7f8f96f3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:21.577696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dbc89-0034-4db2-a796-225c7f8f96f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:21.577980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dbc89-0034-4db2-a796-225c7f8f96f3 None admin] PATH_INFO: `/v3/users/3fa609439efa41e7832b839df854b004` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:21.579169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613dbc89-0034-4db2-a796-225c7f8f96f3 None admin] RBAC: Authorizing `identity:get_user(user_id=3fa609439efa41e7832b839df854b004)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:21.580649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613dbc89-0034-4db2-a796-225c7f8f96f3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:21.582247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 44/84] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:21 2022] GET /identity/v3/users/3fa609439efa41e7832b839df854b004 => generated 275 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:21.587437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dbc89-0034-4db2-a796-225c7f8f96f3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:21.614482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0b32f-cac6-4acc-ae74-01cd518818c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:21.615945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0b32f-cac6-4acc-ae74-01cd518818c2 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:21.687444 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dbc89-0034-4db2-a796-225c7f8f96f3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:21.708812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 41/85] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:21.709808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0b32f-cac6-4acc-ae74-01cd518818c2 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:21.718143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6151e4b-7c07-4394-8993-8a7ea71f5806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:21.718804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6151e4b-7c07-4394-8993-8a7ea71f5806 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:21.719131 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6151e4b-7c07-4394-8993-8a7ea71f5806 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:21.719392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6151e4b-7c07-4394-8993-8a7ea71f5806 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:21.720101 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6151e4b-7c07-4394-8993-8a7ea71f5806 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:21.721565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6151e4b-7c07-4394-8993-8a7ea71f5806 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:21.804823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0b32f-cac6-4acc-ae74-01cd518818c2 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:21.825529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 45/86] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:19:21 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:19:21.831789 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6151e4b-7c07-4394-8993-8a7ea71f5806 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:21.839479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c81c1d-a7a2-49d6-8290-696dd41f1f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:21.840180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c81c1d-a7a2-49d6-8290-696dd41f1f55 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:21.840466 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c81c1d-a7a2-49d6-8290-696dd41f1f55 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:21.840753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c81c1d-a7a2-49d6-8290-696dd41f1f55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:21.913306 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c81c1d-a7a2-49d6-8290-696dd41f1f55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:21.915387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c81c1d-a7a2-49d6-8290-696dd41f1f55 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:21.932394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6151e4b-7c07-4394-8993-8a7ea71f5806 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:21.966640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326c83f-7cdb-42e5-b2bd-3701ae9f40a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:21.967311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326c83f-7cdb-42e5-b2bd-3701ae9f40a3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:21.967601 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326c83f-7cdb-42e5-b2bd-3701ae9f40a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:21.967894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326c83f-7cdb-42e5-b2bd-3701ae9f40a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:22.018085 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 42/87] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:22.018947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c81c1d-a7a2-49d6-8290-696dd41f1f55 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:22.037034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326c83f-7cdb-42e5-b2bd-3701ae9f40a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:22.038517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326c83f-7cdb-42e5-b2bd-3701ae9f40a3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:22.120033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c81c1d-a7a2-49d6-8290-696dd41f1f55 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:22.139112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 46/88] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:22.140329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326c83f-7cdb-42e5-b2bd-3701ae9f40a3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:22.164049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638a77f-4b0c-4cdf-b210-18757fe820aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:22.165344 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638a77f-4b0c-4cdf-b210-18757fe820aa None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:22.165625 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638a77f-4b0c-4cdf-b210-18757fe820aa None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:22.165903 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638a77f-4b0c-4cdf-b210-18757fe820aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:22.236995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638a77f-4b0c-4cdf-b210-18757fe820aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:22.238804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638a77f-4b0c-4cdf-b210-18757fe820aa None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:22.255262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326c83f-7cdb-42e5-b2bd-3701ae9f40a3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:22.290421 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f47955-ee4d-489e-ab69-dbd53e63a32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:22.291313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f47955-ee4d-489e-ab69-dbd53e63a32a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:22.291599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f47955-ee4d-489e-ab69-dbd53e63a32a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:22.291878 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f47955-ee4d-489e-ab69-dbd53e63a32a None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:22.293137 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f47955-ee4d-489e-ab69-dbd53e63a32a None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:22.294688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f47955-ee4d-489e-ab69-dbd53e63a32a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:22.296419 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 47/89] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:22 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:22.297272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f47955-ee4d-489e-ab69-dbd53e63a32a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:22.346103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 43/90] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:22.351869 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638a77f-4b0c-4cdf-b210-18757fe820aa None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:22.396192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f47955-ee4d-489e-ab69-dbd53e63a32a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:22.429848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3b3f7-dfac-44af-9195-cf6f7be8d8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:22.430696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3b3f7-dfac-44af-9195-cf6f7be8d8f7 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:22.431104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3b3f7-dfac-44af-9195-cf6f7be8d8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:22.431299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3b3f7-dfac-44af-9195-cf6f7be8d8f7 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:22.432513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3b3f7-dfac-44af-9195-cf6f7be8d8f7 None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:22.434039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3b3f7-dfac-44af-9195-cf6f7be8d8f7 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:22.436036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 48/91] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:22 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:22.437012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3b3f7-dfac-44af-9195-cf6f7be8d8f7 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:22.453220 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638a77f-4b0c-4cdf-b210-18757fe820aa None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:22.486757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62580807-9804-415a-8c13-a1b67effd28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:22.487911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62580807-9804-415a-8c13-a1b67effd28c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:22.488465 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62580807-9804-415a-8c13-a1b67effd28c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:22.488941 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62580807-9804-415a-8c13-a1b67effd28c None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:22.490320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62580807-9804-415a-8c13-a1b67effd28c None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:22.491959 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62580807-9804-415a-8c13-a1b67effd28c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:22.494140 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 44/92] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:22 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:22.495125 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62580807-9804-415a-8c13-a1b67effd28c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:22.535472 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3b3f7-dfac-44af-9195-cf6f7be8d8f7 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:22.568794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c17855-2db1-424a-9d03-c62a8fa55519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:22.569124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c17855-2db1-424a-9d03-c62a8fa55519 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:22.569414 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c17855-2db1-424a-9d03-c62a8fa55519 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:22.569716 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c17855-2db1-424a-9d03-c62a8fa55519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:22.570546 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c17855-2db1-424a-9d03-c62a8fa55519 None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=1b979e84a2154694996d7c8a5aa5afd1, user.id=bbb6b460327949a18b1de23a04493ec0) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:22.571399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c17855-2db1-424a-9d03-c62a8fa55519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:22.572872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c17855-2db1-424a-9d03-c62a8fa55519 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:22.578695 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 49/93] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:22 2022] GET /identity/v3/role_assignments?user.id=bbb6b460327949a18b1de23a04493ec0&scope.project.id=1b979e84a2154694996d7c8a5aa5afd1&role.id=24a7898c863141f1911792647b5274e3 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:22.579655 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c17855-2db1-424a-9d03-c62a8fa55519 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:22.597387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62580807-9804-415a-8c13-a1b67effd28c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:22.639689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8383466-912e-4111-bb6d-70d98ae8e21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:22.640956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8383466-912e-4111-bb6d-70d98ae8e21f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:22.641475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8383466-912e-4111-bb6d-70d98ae8e21f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:22.641955 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8383466-912e-4111-bb6d-70d98ae8e21f None admin] PATH_INFO: `/v3/projects/792f593907214d6ead7b005cae2ca81e` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:22.643422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8383466-912e-4111-bb6d-70d98ae8e21f None admin] RBAC: Authorizing `identity:get_project(project_id=792f593907214d6ead7b005cae2ca81e)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:22.645112 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8383466-912e-4111-bb6d-70d98ae8e21f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:22.647063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 45/94] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:22 2022] GET /identity/v3/projects/792f593907214d6ead7b005cae2ca81e => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:22.648031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8383466-912e-4111-bb6d-70d98ae8e21f None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:22.687557 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c17855-2db1-424a-9d03-c62a8fa55519 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:22.723076 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefe269-11be-4dcb-9b81-89b62de34e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:22.723749 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefe269-11be-4dcb-9b81-89b62de34e9b None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:22.724035 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefe269-11be-4dcb-9b81-89b62de34e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:22.724349 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefe269-11be-4dcb-9b81-89b62de34e9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:22.725191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefe269-11be-4dcb-9b81-89b62de34e9b None admin] RBAC: Adding query filter params (role.id=21dc73c091ba46889022763efb51de4e, scope.project.id=1b979e84a2154694996d7c8a5aa5afd1, user.id=3fa609439efa41e7832b839df854b004) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:22.725505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefe269-11be-4dcb-9b81-89b62de34e9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:22.727150 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefe269-11be-4dcb-9b81-89b62de34e9b None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:22.733457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 50/95] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:22 2022] GET /identity/v3/role_assignments?user.id=3fa609439efa41e7832b839df854b004&scope.project.id=1b979e84a2154694996d7c8a5aa5afd1&role.id=21dc73c091ba46889022763efb51de4e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:22.734278 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefe269-11be-4dcb-9b81-89b62de34e9b None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:22.757199 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8383466-912e-4111-bb6d-70d98ae8e21f None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:22.794256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa646b-3dd4-4018-984b-99150c695e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:22.795329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa646b-3dd4-4018-984b-99150c695e3c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:22.795848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa646b-3dd4-4018-984b-99150c695e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:22.796401 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa646b-3dd4-4018-984b-99150c695e3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:22.797483 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa646b-3dd4-4018-984b-99150c695e3c None admin] RBAC: Adding query filter params (role.id=ab135a02f63c4a138c6b116ad4f9c8d0, scope.project.id=1b979e84a2154694996d7c8a5aa5afd1, user.id=3fa609439efa41e7832b839df854b004) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:22.798008 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa646b-3dd4-4018-984b-99150c695e3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:22.799729 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa646b-3dd4-4018-984b-99150c695e3c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:22.806960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 46/96] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:22 2022] GET /identity/v3/role_assignments?user.id=3fa609439efa41e7832b839df854b004&scope.project.id=1b979e84a2154694996d7c8a5aa5afd1&role.id=ab135a02f63c4a138c6b116ad4f9c8d0 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:22.849142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefe269-11be-4dcb-9b81-89b62de34e9b None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:22.894083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8809261-9bd0-4b4c-b025-3634b1bf31fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:22.895177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8809261-9bd0-4b4c-b025-3634b1bf31fd None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:22.895665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8809261-9bd0-4b4c-b025-3634b1bf31fd None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:22.896200 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8809261-9bd0-4b4c-b025-3634b1bf31fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:22.897347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8809261-9bd0-4b4c-b025-3634b1bf31fd None admin] RBAC: Adding query filter params (role.id=ab135a02f63c4a138c6b116ad4f9c8d0, scope.project.id=792f593907214d6ead7b005cae2ca81e, user.id=3fa609439efa41e7832b839df854b004) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:22.897903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8809261-9bd0-4b4c-b025-3634b1bf31fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:22.899687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8809261-9bd0-4b4c-b025-3634b1bf31fd None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:22.913067 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 51/97] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:22 2022] GET /identity/v3/role_assignments?user.id=3fa609439efa41e7832b839df854b004&scope.project.id=792f593907214d6ead7b005cae2ca81e&role.id=ab135a02f63c4a138c6b116ad4f9c8d0 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:24.761749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dce40-9323-4265-8abb-6f4afb0b75f4 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:24.762254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dce40-9323-4265-8abb-6f4afb0b75f4 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:24.762353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dce40-9323-4265-8abb-6f4afb0b75f4 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:24.764236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 47/98] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:24.769729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a603570-2e6f-44f4-9b7c-7d26c2147cf6 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:24.770136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a603570-2e6f-44f4-9b7c-7d26c2147cf6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:24.770304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a603570-2e6f-44f4-9b7c-7d26c2147cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:24.792676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-2a603570-2e6f-44f4-9b7c-7d26c2147cf6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:24.793868 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2a603570-2e6f-44f4-9b7c-7d26c2147cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:24.878296 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 52/99] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:19:24.922400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dce40-9323-4265-8abb-6f4afb0b75f4 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:24.939605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6fd7b-dff4-4bc2-a949-048b66828c54 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:24.939895 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6fd7b-dff4-4bc2-a949-048b66828c54 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:24.940383 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6fd7b-dff4-4bc2-a949-048b66828c54 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:24.942823 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 53/100] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:24.948349 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa7bc3-50b3-4270-9470-32416cda34d5 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:24.948805 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa7bc3-50b3-4270-9470-32416cda34d5 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:24.949245 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa7bc3-50b3-4270-9470-32416cda34d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:24.979818 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c0aa7bc3-50b3-4270-9470-32416cda34d5 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:24.981411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c0aa7bc3-50b3-4270-9470-32416cda34d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:25.116212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 54/101] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:19:25.133659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dce40-9323-4265-8abb-6f4afb0b75f4 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:25.154271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa7bc3-50b3-4270-9470-32416cda34d5 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:25.204175 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69349f-a173-449d-a7c3-224c09fea879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:25.205293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69349f-a173-449d-a7c3-224c09fea879 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:25.205721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69349f-a173-449d-a7c3-224c09fea879 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:25.206150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69349f-a173-449d-a7c3-224c09fea879 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:25.207471 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69349f-a173-449d-a7c3-224c09fea879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:25.209118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d69349f-a173-449d-a7c3-224c09fea879 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:25.210876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 48/102] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:25.220120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69349f-a173-449d-a7c3-224c09fea879 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:25.323504 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa7bc3-50b3-4270-9470-32416cda34d5 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:25.377614 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053259f-d53d-438e-bcd3-1d6080578a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:25.378425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053259f-d53d-438e-bcd3-1d6080578a82 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:25.378707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053259f-d53d-438e-bcd3-1d6080578a82 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:25.378987 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053259f-d53d-438e-bcd3-1d6080578a82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:25.402397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053259f-d53d-438e-bcd3-1d6080578a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:25.417827 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-3053259f-d53d-438e-bcd3-1d6080578a82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 15:19:25.419069 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 55/103] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:25.425348 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053259f-d53d-438e-bcd3-1d6080578a82 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:25.445158 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69349f-a173-449d-a7c3-224c09fea879 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:25.521628 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaafcf5-ff38-46ff-b429-74fdbd65e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:25.522590 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaafcf5-ff38-46ff-b429-74fdbd65e278 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:25.523082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaafcf5-ff38-46ff-b429-74fdbd65e278 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:25.523547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaafcf5-ff38-46ff-b429-74fdbd65e278 None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:25.525066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaafcf5-ff38-46ff-b429-74fdbd65e278 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:25.526764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaafcf5-ff38-46ff-b429-74fdbd65e278 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:25.545775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053259f-d53d-438e-bcd3-1d6080578a82 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:25.579047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371eddf-08e0-4845-97b9-4892ff77d9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:25.579714 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371eddf-08e0-4845-97b9-4892ff77d9f8 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:25.579997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371eddf-08e0-4845-97b9-4892ff77d9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:25.580308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371eddf-08e0-4845-97b9-4892ff77d9f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:25.581058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371eddf-08e0-4845-97b9-4892ff77d9f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:25.581370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371eddf-08e0-4845-97b9-4892ff77d9f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:25.582761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371eddf-08e0-4845-97b9-4892ff77d9f8 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:25.592022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 56/104] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:25.597029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371eddf-08e0-4845-97b9-4892ff77d9f8 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:25.693825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 49/105] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:19:25 2022] POST /identity/v3/projects => generated 302 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:19:25.763726 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371eddf-08e0-4845-97b9-4892ff77d9f8 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:25.813866 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c98a03-3df7-495c-abb2-1b0248fdb129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:25.814773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c98a03-3df7-495c-abb2-1b0248fdb129 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:25.815064 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c98a03-3df7-495c-abb2-1b0248fdb129 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:25.815343 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c98a03-3df7-495c-abb2-1b0248fdb129 None admin] PATH_INFO: `/v3/users/682d23b6974d46e389f7ea018ccac033` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:25.837249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c98a03-3df7-495c-abb2-1b0248fdb129 None admin] RBAC: Authorizing `identity:get_user(user_id=682d23b6974d46e389f7ea018ccac033)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:25.838732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c98a03-3df7-495c-abb2-1b0248fdb129 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:25.840494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 57/106] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:25 2022] GET /identity/v3/users/682d23b6974d46e389f7ea018ccac033 => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:25.847605 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaafcf5-ff38-46ff-b429-74fdbd65e278 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:25.929180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcee05-b9cf-492c-8de1-28cb7642ad01 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:25.929529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcee05-b9cf-492c-8de1-28cb7642ad01 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:25.929756 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcee05-b9cf-492c-8de1-28cb7642ad01 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:25.932168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 58/107] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:25.937884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be809a92-5ad2-4850-8857-c696920b06ee None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:25.938176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be809a92-5ad2-4850-8857-c696920b06ee None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:25.938457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be809a92-5ad2-4850-8857-c696920b06ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:25.966502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-be809a92-5ad2-4850-8857-c696920b06ee None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:25.967718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-be809a92-5ad2-4850-8857-c696920b06ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:25.976515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaafcf5-ff38-46ff-b429-74fdbd65e278 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:26.022412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06852ae6-70dd-4908-88d8-8126119b72c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:26.023097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06852ae6-70dd-4908-88d8-8126119b72c5 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:26.023388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06852ae6-70dd-4908-88d8-8126119b72c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:26.023709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06852ae6-70dd-4908-88d8-8126119b72c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:26.121498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 59/108] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:19:26.151967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06852ae6-70dd-4908-88d8-8126119b72c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:26.153765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06852ae6-70dd-4908-88d8-8126119b72c5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:26.158498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be809a92-5ad2-4850-8857-c696920b06ee None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:26.269238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 50/109] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:26.274393 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06852ae6-70dd-4908-88d8-8126119b72c5 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:26.326280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be809a92-5ad2-4850-8857-c696920b06ee None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:26.381418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804287da-17c2-4c1c-8f10-f5944ea67315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:26.382219 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804287da-17c2-4c1c-8f10-f5944ea67315 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:26.382497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804287da-17c2-4c1c-8f10-f5944ea67315 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:26.382966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804287da-17c2-4c1c-8f10-f5944ea67315 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:26.393462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06852ae6-70dd-4908-88d8-8126119b72c5 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:26.401718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804287da-17c2-4c1c-8f10-f5944ea67315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:26.413037 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-804287da-17c2-4c1c-8f10-f5944ea67315 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:26.415097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 60/110] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:26.420922 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804287da-17c2-4c1c-8f10-f5944ea67315 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:26.435707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fc37f-6a67-42a3-af60-c8e1c8c86ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:26.436607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fc37f-6a67-42a3-af60-c8e1c8c86ffc None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:26.436898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fc37f-6a67-42a3-af60-c8e1c8c86ffc None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:26.437184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fc37f-6a67-42a3-af60-c8e1c8c86ffc None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:26.441408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fc37f-6a67-42a3-af60-c8e1c8c86ffc None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:26.443926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fc37f-6a67-42a3-af60-c8e1c8c86ffc None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:26.448297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 51/111] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:26 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:26.455109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fc37f-6a67-42a3-af60-c8e1c8c86ffc None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:26.607350 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804287da-17c2-4c1c-8f10-f5944ea67315 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:26.637672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fc37f-6a67-42a3-af60-c8e1c8c86ffc None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:26.666712 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4d460-ecc0-4f8f-974b-6436c6e4b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:26.667900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4d460-ecc0-4f8f-974b-6436c6e4b939 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:26.668427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4d460-ecc0-4f8f-974b-6436c6e4b939 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:26.669228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4d460-ecc0-4f8f-974b-6436c6e4b939 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:26.670178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4d460-ecc0-4f8f-974b-6436c6e4b939 None admin] RBAC: Adding query filter params (name=member) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:26.670702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4d460-ecc0-4f8f-974b-6436c6e4b939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:26.673262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4d460-ecc0-4f8f-974b-6436c6e4b939 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:26.684059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 61/112] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:26.688718 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9e206-31c8-4261-bc2e-53af2e04255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:26.688718 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9e206-31c8-4261-bc2e-53af2e04255c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:26.688718 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9e206-31c8-4261-bc2e-53af2e04255c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:26.688718 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9e206-31c8-4261-bc2e-53af2e04255c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:26.689044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9e206-31c8-4261-bc2e-53af2e04255c None admin] RBAC: Adding query filter params (role.id=2e236c62c0f041ab91e9fab86a52cd2d, scope.project.id=1b979e84a2154694996d7c8a5aa5afd1, user.id=682d23b6974d46e389f7ea018ccac033) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:26.689044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9e206-31c8-4261-bc2e-53af2e04255c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:26.690512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9e206-31c8-4261-bc2e-53af2e04255c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:26.691006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8c425-60a8-4156-aed9-6c744a4bb2f6 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:26.691520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8c425-60a8-4156-aed9-6c744a4bb2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:26.692045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8c425-60a8-4156-aed9-6c744a4bb2f6 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:26.695060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 62/113] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:26.696499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8d28-d5aa-4099-ba88-bbbcf8d04522 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:26.697068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8d28-d5aa-4099-ba88-bbbcf8d04522 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:26.697597 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8d28-d5aa-4099-ba88-bbbcf8d04522 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:26.703764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 52/115] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:26 2022] GET /identity/v3/role_assignments?user.id=682d23b6974d46e389f7ea018ccac033&scope.project.id=1b979e84a2154694996d7c8a5aa5afd1&role.id=2e236c62c0f041ab91e9fab86a52cd2d => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:26.703764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9e206-31c8-4261-bc2e-53af2e04255c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:26.704360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 63/115] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:26.707032 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514b6a0-4b26-49c3-8477-98581771dd38 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:26.707502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514b6a0-4b26-49c3-8477-98581771dd38 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:26.707936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514b6a0-4b26-49c3-8477-98581771dd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:26.731490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-0514b6a0-4b26-49c3-8477-98581771dd38 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:26.733280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0514b6a0-4b26-49c3-8477-98581771dd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:26.821906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 64/116] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:26.824315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b46fc9-7a64-4faf-9969-887630a4ebdc None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:26.824767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b46fc9-7a64-4faf-9969-887630a4ebdc None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:26.825199 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b46fc9-7a64-4faf-9969-887630a4ebdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:26.842081 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9e206-31c8-4261-bc2e-53af2e04255c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:26.847252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-70b46fc9-7a64-4faf-9969-887630a4ebdc None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:26.848760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-70b46fc9-7a64-4faf-9969-887630a4ebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:26.890590 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090245b-8432-4b74-b6b6-50d5063afa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:26.891474 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090245b-8432-4b74-b6b6-50d5063afa0b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:26.891758 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090245b-8432-4b74-b6b6-50d5063afa0b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:26.892342 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090245b-8432-4b74-b6b6-50d5063afa0b None admin] PATH_INFO: `/v3/users/3fa609439efa41e7832b839df854b004` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:26.893649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090245b-8432-4b74-b6b6-50d5063afa0b None admin] RBAC: Authorizing `identity:get_user(user_id=3fa609439efa41e7832b839df854b004)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:26.894805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090245b-8432-4b74-b6b6-50d5063afa0b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:26.897230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 53/117] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:26 2022] GET /identity/v3/users/3fa609439efa41e7832b839df854b004 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:26.898249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00447615-7d12-430e-87a8-716f40937865 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:26.898597 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00447615-7d12-430e-87a8-716f40937865 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:26.899392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00447615-7d12-430e-87a8-716f40937865 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:26.901253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 54/118] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:26.903244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00447615-7d12-430e-87a8-716f40937865 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:26.949198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 65/119] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:26.957123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b46fc9-7a64-4faf-9969-887630a4ebdc None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:27.019750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00447615-7d12-430e-87a8-716f40937865 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:27.064079 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a3cf7-8ce0-4bf0-9bca-ccd5c29cea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:27.065039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3cf7-8ce0-4bf0-9bca-ccd5c29cea42 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:27.065420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3cf7-8ce0-4bf0-9bca-ccd5c29cea42 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:27.065794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a3cf7-8ce0-4bf0-9bca-ccd5c29cea42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:27.069539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b46fc9-7a64-4faf-9969-887630a4ebdc None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:27.076975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a3cf7-8ce0-4bf0-9bca-ccd5c29cea42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:27.084169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-d22a3cf7-8ce0-4bf0-9bca-ccd5c29cea42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:19:27.085644 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 55/120] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:27.091953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7404500-bc2e-4ef2-ad5e-0dc7a4aca1f5 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:27.092368 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7404500-bc2e-4ef2-ad5e-0dc7a4aca1f5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:27.092754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7404500-bc2e-4ef2-ad5e-0dc7a4aca1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:27.109998 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-f7404500-bc2e-4ef2-ad5e-0dc7a4aca1f5 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:27.111317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f7404500-bc2e-4ef2-ad5e-0dc7a4aca1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:27.113264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea8738-8c5e-4f5c-a271-c5f293fd4637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:27.115106 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea8738-8c5e-4f5c-a271-c5f293fd4637 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:27.115412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea8738-8c5e-4f5c-a271-c5f293fd4637 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:27.115700 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea8738-8c5e-4f5c-a271-c5f293fd4637 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:27.117782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea8738-8c5e-4f5c-a271-c5f293fd4637 None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:27.119378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea8738-8c5e-4f5c-a271-c5f293fd4637 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:27.121854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 66/121] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:26 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:27.122648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea8738-8c5e-4f5c-a271-c5f293fd4637 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:27.185260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 56/122] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:27.186290 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7404500-bc2e-4ef2-ad5e-0dc7a4aca1f5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:27.249806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea8738-8c5e-4f5c-a271-c5f293fd4637 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:27.284973 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7404500-bc2e-4ef2-ad5e-0dc7a4aca1f5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:27.290510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963ff82-dc7e-466c-b33c-982016c060ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:27.291470 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963ff82-dc7e-466c-b33c-982016c060ae None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:27.291852 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963ff82-dc7e-466c-b33c-982016c060ae None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:27.292262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963ff82-dc7e-466c-b33c-982016c060ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:27.302831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963ff82-dc7e-466c-b33c-982016c060ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:27.310079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-3963ff82-dc7e-466c-b33c-982016c060ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:27.311556 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 67/123] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:27.316834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963ff82-dc7e-466c-b33c-982016c060ae None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:27.322648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a311d-6786-451d-9244-0a8989165753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:27.323327 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a311d-6786-451d-9244-0a8989165753 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:27.323616 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a311d-6786-451d-9244-0a8989165753 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:27.323896 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a311d-6786-451d-9244-0a8989165753 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:27.324686 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a311d-6786-451d-9244-0a8989165753 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:27.325001 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a311d-6786-451d-9244-0a8989165753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:27.326778 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a311d-6786-451d-9244-0a8989165753 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:27.337843 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 57/124] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:27.338670 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a311d-6786-451d-9244-0a8989165753 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:27.429928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963ff82-dc7e-466c-b33c-982016c060ae None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:27.450113 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a311d-6786-451d-9244-0a8989165753 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:27.470755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e4e17-6a2c-441d-91f9-347761843221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:27.471904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e4e17-6a2c-441d-91f9-347761843221 None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:27.472217 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e4e17-6a2c-441d-91f9-347761843221 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:27.472638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e4e17-6a2c-441d-91f9-347761843221 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1/users/3fa609439efa41e7832b839df854b004/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:27.475205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e4e17-6a2c-441d-91f9-347761843221 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b979e84a2154694996d7c8a5aa5afd1, user_id=3fa609439efa41e7832b839df854b004, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:27.478002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e4e17-6a2c-441d-91f9-347761843221 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:27.484514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed0232-2ba1-4a59-b499-16427232e7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:27.485387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed0232-2ba1-4a59-b499-16427232e7b4 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:27.485749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed0232-2ba1-4a59-b499-16427232e7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:27.486092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed0232-2ba1-4a59-b499-16427232e7b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:27.496137 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed0232-2ba1-4a59-b499-16427232e7b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:27.503492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-e2ed0232-2ba1-4a59-b499-16427232e7b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:19:27.504701 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 58/125] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:19:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:27.505691 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed0232-2ba1-4a59-b499-16427232e7b4 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:27.563751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 68/126] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:19:27 2022] PUT /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1/users/3fa609439efa41e7832b839df854b004/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:19:27.565531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e4e17-6a2c-441d-91f9-347761843221 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:27.626075 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed0232-2ba1-4a59-b499-16427232e7b4 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:27.690836 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d247407-862c-41b7-8f55-df27630187c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:27.691506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d247407-862c-41b7-8f55-df27630187c6 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:27.691796 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d247407-862c-41b7-8f55-df27630187c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:27.692120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d247407-862c-41b7-8f55-df27630187c6 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:27.692965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d247407-862c-41b7-8f55-df27630187c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:27.693287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d247407-862c-41b7-8f55-df27630187c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:27.694725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d247407-862c-41b7-8f55-df27630187c6 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:27.710747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 59/127] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:27.712374 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d247407-862c-41b7-8f55-df27630187c6 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:27.720004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e4e17-6a2c-441d-91f9-347761843221 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:27.760265 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af745d8-818a-4c33-9204-c18972fc60d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:27.761718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af745d8-818a-4c33-9204-c18972fc60d9 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:27.762018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af745d8-818a-4c33-9204-c18972fc60d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:27.762306 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af745d8-818a-4c33-9204-c18972fc60d9 None admin] PATH_INFO: `/v3/users/bbb6b460327949a18b1de23a04493ec0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:27.763674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af745d8-818a-4c33-9204-c18972fc60d9 None admin] RBAC: Authorizing `identity:get_user(user_id=bbb6b460327949a18b1de23a04493ec0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:27.765275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af745d8-818a-4c33-9204-c18972fc60d9 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:27.768294 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 69/128] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:27 2022] GET /identity/v3/users/bbb6b460327949a18b1de23a04493ec0 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:27.769208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af745d8-818a-4c33-9204-c18972fc60d9 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:27.887638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d247407-862c-41b7-8f55-df27630187c6 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:27.891666 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af745d8-818a-4c33-9204-c18972fc60d9 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:27.926067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72a415-e3d2-4bdc-9cb1-b3cd1f84432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:27.927841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72a415-e3d2-4bdc-9cb1-b3cd1f84432c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:27.928675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72a415-e3d2-4bdc-9cb1-b3cd1f84432c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:27.929155 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72a415-e3d2-4bdc-9cb1-b3cd1f84432c None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:27.929609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b2bfa-94c7-4d41-9da3-1cb841615f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:27.930908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72a415-e3d2-4bdc-9cb1-b3cd1f84432c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:27.931019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b2bfa-94c7-4d41-9da3-1cb841615f51 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:27.931304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b2bfa-94c7-4d41-9da3-1cb841615f51 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:27.931588 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b2bfa-94c7-4d41-9da3-1cb841615f51 None admin] PATH_INFO: `/v3/users/3fa609439efa41e7832b839df854b004` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:27.931925 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72a415-e3d2-4bdc-9cb1-b3cd1f84432c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:27.932847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b2bfa-94c7-4d41-9da3-1cb841615f51 None admin] RBAC: Authorizing `identity:get_user(user_id=3fa609439efa41e7832b839df854b004)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:27.933748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72a415-e3d2-4bdc-9cb1-b3cd1f84432c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:27.934319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b2bfa-94c7-4d41-9da3-1cb841615f51 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:27.936292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 70/129] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:27 2022] GET /identity/v3/users/3fa609439efa41e7832b839df854b004 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:27.937134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b2bfa-94c7-4d41-9da3-1cb841615f51 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:27.943633 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 60/130] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:19:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:27.944757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72a415-e3d2-4bdc-9cb1-b3cd1f84432c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:28.111870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72a415-e3d2-4bdc-9cb1-b3cd1f84432c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:28.155526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a35a7-a23e-4049-aaa7-50ffa43ea733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:28.157275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a35a7-a23e-4049-aaa7-50ffa43ea733 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:28.157797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a35a7-a23e-4049-aaa7-50ffa43ea733 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:28.158276 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a35a7-a23e-4049-aaa7-50ffa43ea733 None admin] PATH_INFO: `/v3/projects/792f593907214d6ead7b005cae2ca81e` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:28.160107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a35a7-a23e-4049-aaa7-50ffa43ea733 None admin] RBAC: Authorizing `identity:get_project(project_id=792f593907214d6ead7b005cae2ca81e)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:28.162605 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a35a7-a23e-4049-aaa7-50ffa43ea733 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:28.164742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 61/131] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:27 2022] GET /identity/v3/projects/792f593907214d6ead7b005cae2ca81e => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:28.167878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a35a7-a23e-4049-aaa7-50ffa43ea733 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:28.198426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b2bfa-94c7-4d41-9da3-1cb841615f51 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:28.298965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a35a7-a23e-4049-aaa7-50ffa43ea733 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:28.302318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ceb1dc-941e-40a3-82b9-13a9a96896ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:28.303015 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceb1dc-941e-40a3-82b9-13a9a96896ed None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:28.303301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceb1dc-941e-40a3-82b9-13a9a96896ed None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:28.303579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceb1dc-941e-40a3-82b9-13a9a96896ed None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:28.308865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ceb1dc-941e-40a3-82b9-13a9a96896ed None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:28.310454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ceb1dc-941e-40a3-82b9-13a9a96896ed None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:28.312012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 71/132] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:27 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:28.312861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ceb1dc-941e-40a3-82b9-13a9a96896ed None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:28.337143 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893229d-ef26-4886-aaca-9cf7e38dfcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:28.338728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893229d-ef26-4886-aaca-9cf7e38dfcc8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:28.339492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893229d-ef26-4886-aaca-9cf7e38dfcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:28.340040 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893229d-ef26-4886-aaca-9cf7e38dfcc8 None admin] PATH_INFO: `/v3/users/3fa609439efa41e7832b839df854b004` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:28.341454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893229d-ef26-4886-aaca-9cf7e38dfcc8 None admin] RBAC: Authorizing `identity:get_user(user_id=3fa609439efa41e7832b839df854b004)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:28.343107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893229d-ef26-4886-aaca-9cf7e38dfcc8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:28.345223 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 62/133] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:28 2022] GET /identity/v3/users/3fa609439efa41e7832b839df854b004 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:28.346180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893229d-ef26-4886-aaca-9cf7e38dfcc8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:28.456880 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893229d-ef26-4886-aaca-9cf7e38dfcc8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:28.504353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6244d-cd20-462e-af05-6569599260d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:28.506146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6244d-cd20-462e-af05-6569599260d8 None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:28.506885 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6244d-cd20-462e-af05-6569599260d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:28.507579 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6244d-cd20-462e-af05-6569599260d8 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1/users/bbb6b460327949a18b1de23a04493ec0/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:28.510390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6244d-cd20-462e-af05-6569599260d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b979e84a2154694996d7c8a5aa5afd1, user_id=bbb6b460327949a18b1de23a04493ec0, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:28.512280 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6244d-cd20-462e-af05-6569599260d8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:28.538171 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ceb1dc-941e-40a3-82b9-13a9a96896ed None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:28.573490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b30b-cb10-4b50-8748-232f1cef9bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:28.574693 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b30b-cb10-4b50-8748-232f1cef9bad None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:28.575207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b30b-cb10-4b50-8748-232f1cef9bad None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:28.575645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b30b-cb10-4b50-8748-232f1cef9bad None admin] PATH_INFO: `/v3/projects/792f593907214d6ead7b005cae2ca81e/users/3fa609439efa41e7832b839df854b004/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:28.577915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50b30b-cb10-4b50-8748-232f1cef9bad None admin] RBAC: Authorizing `identity:create_grant(project_id=792f593907214d6ead7b005cae2ca81e, user_id=3fa609439efa41e7832b839df854b004, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:28.579705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50b30b-cb10-4b50-8748-232f1cef9bad None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:28.630838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 63/134] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:19:28 2022] PUT /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1/users/bbb6b460327949a18b1de23a04493ec0/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:19:28.631953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6244d-cd20-462e-af05-6569599260d8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:28.659299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 72/135] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:19:28 2022] PUT /identity/v3/projects/792f593907214d6ead7b005cae2ca81e/users/3fa609439efa41e7832b839df854b004/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:19:28.660875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294846ea-7f45-416f-ab07-b72e5b8575f6 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:28.661227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294846ea-7f45-416f-ab07-b72e5b8575f6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:28.661559 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294846ea-7f45-416f-ab07-b72e5b8575f6 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:28.672177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 73/136] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:28.672177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c770c-a496-4811-bd02-c1b1269af9a7 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:28.672177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c770c-a496-4811-bd02-c1b1269af9a7 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:28.672177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c770c-a496-4811-bd02-c1b1269af9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:28.689683 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-109c770c-a496-4811-bd02-c1b1269af9a7 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:28.691130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-109c770c-a496-4811-bd02-c1b1269af9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:28.797179 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 74/137] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:19:28.818287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6244d-cd20-462e-af05-6569599260d8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:28.868026 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a477a-6d89-4bea-9a69-26e95afd5c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:28.868921 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a477a-6d89-4bea-9a69-26e95afd5c41 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:28.869204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a477a-6d89-4bea-9a69-26e95afd5c41 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:28.869482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a477a-6d89-4bea-9a69-26e95afd5c41 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:28.871851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a477a-6d89-4bea-9a69-26e95afd5c41 None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:28.873405 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a477a-6d89-4bea-9a69-26e95afd5c41 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:28.875593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 64/138] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:28 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:28.879574 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c770c-a496-4811-bd02-c1b1269af9a7 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:28.891653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a477a-6d89-4bea-9a69-26e95afd5c41 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:29.051264 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a477a-6d89-4bea-9a69-26e95afd5c41 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:29.094461 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b58506-c39c-4b10-a377-eee548c94679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:29.095717 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b58506-c39c-4b10-a377-eee548c94679 None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:29.096230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b58506-c39c-4b10-a377-eee548c94679 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:29.096703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b58506-c39c-4b10-a377-eee548c94679 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1/users/3fa609439efa41e7832b839df854b004/roles/21dc73c091ba46889022763efb51de4e` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:29.106048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b58506-c39c-4b10-a377-eee548c94679 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b979e84a2154694996d7c8a5aa5afd1, user_id=3fa609439efa41e7832b839df854b004, role_id=21dc73c091ba46889022763efb51de4e)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:29.107491 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c770c-a496-4811-bd02-c1b1269af9a7 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:29.108369 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b58506-c39c-4b10-a377-eee548c94679 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:29.146314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748a7eb-5d9a-42c4-a4ef-d7604b020413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:29.147112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748a7eb-5d9a-42c4-a4ef-d7604b020413 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:29.147399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748a7eb-5d9a-42c4-a4ef-d7604b020413 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:29.147679 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748a7eb-5d9a-42c4-a4ef-d7604b020413 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:29.149416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748a7eb-5d9a-42c4-a4ef-d7604b020413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:29.150857 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748a7eb-5d9a-42c4-a4ef-d7604b020413 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:29.156657 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 75/139] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:29.162363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748a7eb-5d9a-42c4-a4ef-d7604b020413 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:29.197804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 65/140] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:19:28 2022] PUT /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1/users/3fa609439efa41e7832b839df854b004/roles/21dc73c091ba46889022763efb51de4e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:19:29.303758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748a7eb-5d9a-42c4-a4ef-d7604b020413 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:29.351675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35357-0936-4354-8ae9-587de5e793bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:29.352387 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35357-0936-4354-8ae9-587de5e793bc None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:29.352739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35357-0936-4354-8ae9-587de5e793bc None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:29.352948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35357-0936-4354-8ae9-587de5e793bc None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:29.353676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e35357-0936-4354-8ae9-587de5e793bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:29.355114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e35357-0936-4354-8ae9-587de5e793bc None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:29.422173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cce63-bb7e-413d-9ffa-d128e67ef816 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:29.422824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cce63-bb7e-413d-9ffa-d128e67ef816 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:29.423303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cce63-bb7e-413d-9ffa-d128e67ef816 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:29.425341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 66/141] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:29.431633 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017d83-3779-4355-bcf4-6e6df991277b None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:29.432242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017d83-3779-4355-bcf4-6e6df991277b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:29.432746 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1017d83-3779-4355-bcf4-6e6df991277b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:29.457304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-d1017d83-3779-4355-bcf4-6e6df991277b None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:29.459007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d1017d83-3779-4355-bcf4-6e6df991277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:29.480737 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 76/142] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:19:29 2022] POST /identity/v3/users => generated 283 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:19:29.562262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 67/143] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:19:29.599152 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35357-0936-4354-8ae9-587de5e793bc None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:29.735916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35357-0936-4354-8ae9-587de5e793bc None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:29.771512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05a6a9-71c1-4319-9f97-b91a1adec381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:29.772342 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05a6a9-71c1-4319-9f97-b91a1adec381 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:29.772676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05a6a9-71c1-4319-9f97-b91a1adec381 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:29.772958 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05a6a9-71c1-4319-9f97-b91a1adec381 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:29.787854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05a6a9-71c1-4319-9f97-b91a1adec381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:29.795211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-cf05a6a9-71c1-4319-9f97-b91a1adec381 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 15:19:29.796469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 77/144] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:29.802162 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1017d83-3779-4355-bcf4-6e6df991277b None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:29.943061 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1017d83-3779-4355-bcf4-6e6df991277b None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:29.982381 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33041308-ad3e-4dfc-945c-1f4405d31ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:29.983415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33041308-ad3e-4dfc-945c-1f4405d31ae2 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:29.983900 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33041308-ad3e-4dfc-945c-1f4405d31ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:29.984414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33041308-ad3e-4dfc-945c-1f4405d31ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:29.985403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33041308-ad3e-4dfc-945c-1f4405d31ae2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:29.985908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33041308-ad3e-4dfc-945c-1f4405d31ae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:29.987481 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33041308-ad3e-4dfc-945c-1f4405d31ae2 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:30.001753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 68/145] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:30.007463 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05a6a9-71c1-4319-9f97-b91a1adec381 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:30.159947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05a6a9-71c1-4319-9f97-b91a1adec381 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:30.202546 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d41664-9d44-455e-86fe-ad071ec14072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:30.203730 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d41664-9d44-455e-86fe-ad071ec14072 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:30.204258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d41664-9d44-455e-86fe-ad071ec14072 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:30.204759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d41664-9d44-455e-86fe-ad071ec14072 None admin] PATH_INFO: `/v3/users/682d23b6974d46e389f7ea018ccac033` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:30.208852 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d41664-9d44-455e-86fe-ad071ec14072 None admin] RBAC: Authorizing `identity:get_user(user_id=682d23b6974d46e389f7ea018ccac033)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:30.210524 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d41664-9d44-455e-86fe-ad071ec14072 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:30.212926 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 78/146] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:30 2022] GET /identity/v3/users/682d23b6974d46e389f7ea018ccac033 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:30.218355 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33041308-ad3e-4dfc-945c-1f4405d31ae2 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:30.326925 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33041308-ad3e-4dfc-945c-1f4405d31ae2 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:30.363377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb64c7-0981-42d9-8dc8-807ea6acb2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:30.364620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb64c7-0981-42d9-8dc8-807ea6acb2c3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:30.365126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb64c7-0981-42d9-8dc8-807ea6acb2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:30.365600 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb64c7-0981-42d9-8dc8-807ea6acb2c3 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:30.372876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb64c7-0981-42d9-8dc8-807ea6acb2c3 None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:30.374563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb64c7-0981-42d9-8dc8-807ea6acb2c3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:30.376524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 69/147] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:30 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:30.382103 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d41664-9d44-455e-86fe-ad071ec14072 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:30.489434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d41664-9d44-455e-86fe-ad071ec14072 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:30.526326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a82b78-8631-4041-9dbb-246d15e3cd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:30.527588 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a82b78-8631-4041-9dbb-246d15e3cd12 None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:30.528088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a82b78-8631-4041-9dbb-246d15e3cd12 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:30.528614 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a82b78-8631-4041-9dbb-246d15e3cd12 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1/users/682d23b6974d46e389f7ea018ccac033/roles/2e236c62c0f041ab91e9fab86a52cd2d` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:30.533478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a82b78-8631-4041-9dbb-246d15e3cd12 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b979e84a2154694996d7c8a5aa5afd1, user_id=682d23b6974d46e389f7ea018ccac033, role_id=2e236c62c0f041ab91e9fab86a52cd2d)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:30.535251 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a82b78-8631-4041-9dbb-246d15e3cd12 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:30.745308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 79/148] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:19:30 2022] PUT /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1/users/682d23b6974d46e389f7ea018ccac033/roles/2e236c62c0f041ab91e9fab86a52cd2d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:19:30.868703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137e29d-c90d-4466-b71e-a1b03ef1d8bc None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:30.869266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137e29d-c90d-4466-b71e-a1b03ef1d8bc None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:30.869556 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137e29d-c90d-4466-b71e-a1b03ef1d8bc None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:30.871519 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 70/149] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:30.877372 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d2fe0-b2e0-40a6-be83-6ef880c9b8e8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:30.877674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d2fe0-b2e0-40a6-be83-6ef880c9b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:30.877965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d2fe0-b2e0-40a6-be83-6ef880c9b8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:30.896772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-ae3d2fe0-b2e0-40a6-be83-6ef880c9b8e8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:30.898326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ae3d2fe0-b2e0-40a6-be83-6ef880c9b8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:30.972922 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 80/150] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:30.996119 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137e29d-c90d-4466-b71e-a1b03ef1d8bc None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:31.108559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137e29d-c90d-4466-b71e-a1b03ef1d8bc None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:31.158919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cb7f4-d0de-4093-87d7-3c86f6706f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:31.160102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cb7f4-d0de-4093-87d7-3c86f6706f77 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:31.160610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cb7f4-d0de-4093-87d7-3c86f6706f77 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:31.161107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65cb7f4-d0de-4093-87d7-3c86f6706f77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:31.175207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65cb7f4-d0de-4093-87d7-3c86f6706f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:31.183244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-c65cb7f4-d0de-4093-87d7-3c86f6706f77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:31.188004 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 71/151] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:31.191271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d2fe0-b2e0-40a6-be83-6ef880c9b8e8 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:31.295670 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d2fe0-b2e0-40a6-be83-6ef880c9b8e8 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:31.330683 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb575e80-2552-487d-ab6b-f0d9c88c8c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:31.331680 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb575e80-2552-487d-ab6b-f0d9c88c8c72 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:31.332170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb575e80-2552-487d-ab6b-f0d9c88c8c72 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:31.332634 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb575e80-2552-487d-ab6b-f0d9c88c8c72 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:31.333599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb575e80-2552-487d-ab6b-f0d9c88c8c72 None admin] RBAC: Adding query filter params (name=member) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:31.334094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb575e80-2552-487d-ab6b-f0d9c88c8c72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:31.335801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb575e80-2552-487d-ab6b-f0d9c88c8c72 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:31.344958 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 81/152] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:31.350805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cb7f4-d0de-4093-87d7-3c86f6706f77 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:31.464271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65cb7f4-d0de-4093-87d7-3c86f6706f77 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:31.504850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4f35d-9316-4c5c-8810-70fe7c6e59f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:31.506093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4f35d-9316-4c5c-8810-70fe7c6e59f8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:31.506575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4f35d-9316-4c5c-8810-70fe7c6e59f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:31.507043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4f35d-9316-4c5c-8810-70fe7c6e59f8 None admin] PATH_INFO: `/v3/users/3fa609439efa41e7832b839df854b004` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:31.508571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4f35d-9316-4c5c-8810-70fe7c6e59f8 None admin] RBAC: Authorizing `identity:get_user(user_id=3fa609439efa41e7832b839df854b004)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:31.510265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4f35d-9316-4c5c-8810-70fe7c6e59f8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:31.512614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 72/153] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:31 2022] GET /identity/v3/users/3fa609439efa41e7832b839df854b004 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:31.518347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb575e80-2552-487d-ab6b-f0d9c88c8c72 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:31.622453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb575e80-2552-487d-ab6b-f0d9c88c8c72 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:31.657789 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8801709-6173-4a25-b2f3-f296b6e370c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:31.658796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8801709-6173-4a25-b2f3-f296b6e370c6 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:31.659274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8801709-6173-4a25-b2f3-f296b6e370c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:31.659739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8801709-6173-4a25-b2f3-f296b6e370c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:31.729770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8801709-6173-4a25-b2f3-f296b6e370c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:31.731602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8801709-6173-4a25-b2f3-f296b6e370c6 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:31.828427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 82/154] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:31.834292 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4f35d-9316-4c5c-8810-70fe7c6e59f8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:31.943271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4f35d-9316-4c5c-8810-70fe7c6e59f8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:31.985826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327ba94-b908-4d2e-9b77-395b6d41931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:31.987058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327ba94-b908-4d2e-9b77-395b6d41931b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:31.987536 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327ba94-b908-4d2e-9b77-395b6d41931b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:31.988002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327ba94-b908-4d2e-9b77-395b6d41931b None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:31.992841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327ba94-b908-4d2e-9b77-395b6d41931b None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:31.994529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327ba94-b908-4d2e-9b77-395b6d41931b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:31.996515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 73/155] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:31 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:32.002573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8801709-6173-4a25-b2f3-f296b6e370c6 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:32.106741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8801709-6173-4a25-b2f3-f296b6e370c6 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:32.141500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501da05a-29c3-40de-bd00-e6cfd40a136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:32.142494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501da05a-29c3-40de-bd00-e6cfd40a136a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:32.142990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501da05a-29c3-40de-bd00-e6cfd40a136a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:32.143455 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501da05a-29c3-40de-bd00-e6cfd40a136a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:32.144509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501da05a-29c3-40de-bd00-e6cfd40a136a None admin] RBAC: Adding query filter params (role.id=ab135a02f63c4a138c6b116ad4f9c8d0, scope.project.id=1b979e84a2154694996d7c8a5aa5afd1, user.id=3fa609439efa41e7832b839df854b004) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:32.145282 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501da05a-29c3-40de-bd00-e6cfd40a136a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:32.146564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501da05a-29c3-40de-bd00-e6cfd40a136a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:32.153458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 83/156] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:32 2022] GET /identity/v3/role_assignments?user.id=3fa609439efa41e7832b839df854b004&scope.project.id=1b979e84a2154694996d7c8a5aa5afd1&role.id=ab135a02f63c4a138c6b116ad4f9c8d0 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:32.785226 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba5f9-a80c-4328-9029-7a3619b6d3d5 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:32.785731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba5f9-a80c-4328-9029-7a3619b6d3d5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:32.785803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba5f9-a80c-4328-9029-7a3619b6d3d5 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:32.787683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 74/157] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:32.793656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc34b8-932e-49a2-8d8e-4d5b07b39f98 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:32.794051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc34b8-932e-49a2-8d8e-4d5b07b39f98 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:32.794215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc34b8-932e-49a2-8d8e-4d5b07b39f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:32.825121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-77cc34b8-932e-49a2-8d8e-4d5b07b39f98 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:32.826301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-77cc34b8-932e-49a2-8d8e-4d5b07b39f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:32.910977 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 84/158] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:19:32.955450 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ba5f9-a80c-4328-9029-7a3619b6d3d5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:33.073366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ba5f9-a80c-4328-9029-7a3619b6d3d5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:33.123068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26abeda-093a-4e10-83ae-d81f64831dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:33.123928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26abeda-093a-4e10-83ae-d81f64831dbb None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:33.124240 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26abeda-093a-4e10-83ae-d81f64831dbb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:33.124525 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26abeda-093a-4e10-83ae-d81f64831dbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:33.145003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26abeda-093a-4e10-83ae-d81f64831dbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:33.152612 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-e26abeda-093a-4e10-83ae-d81f64831dbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:19:33.153846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 75/159] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:19:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:33.160086 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc34b8-932e-49a2-8d8e-4d5b07b39f98 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:33.172740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ec5f2-ce05-466a-b299-26c90b09ff67 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:33.173022 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ec5f2-ce05-466a-b299-26c90b09ff67 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:33.173306 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ec5f2-ce05-466a-b299-26c90b09ff67 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:33.180715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 76/160] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:33.185898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0da256-4505-42c4-a576-647c853c971c None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:33.186201 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0da256-4505-42c4-a576-647c853c971c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:33.186481 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0da256-4505-42c4-a576-647c853c971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:33.215287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-1b0da256-4505-42c4-a576-647c853c971c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:33.216490 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1b0da256-4505-42c4-a576-647c853c971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:33.276883 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc34b8-932e-49a2-8d8e-4d5b07b39f98 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:33.315982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2964e5-5678-402e-afb2-80fe7339e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:33.316954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2964e5-5678-402e-afb2-80fe7339e868 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:33.317447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2964e5-5678-402e-afb2-80fe7339e868 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:33.317855 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2964e5-5678-402e-afb2-80fe7339e868 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:33.318740 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2964e5-5678-402e-afb2-80fe7339e868 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:33.319180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2964e5-5678-402e-afb2-80fe7339e868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:33.320774 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2964e5-5678-402e-afb2-80fe7339e868 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:33.334458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 85/161] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:33.340457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2964e5-5678-402e-afb2-80fe7339e868 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:33.390472 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 77/162] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:19:33.443552 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0da256-4505-42c4-a576-647c853c971c None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:33.468925 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2964e5-5678-402e-afb2-80fe7339e868 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:33.508962 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70921aa3-2240-45e9-b9fd-160671bb4b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:33.510100 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70921aa3-2240-45e9-b9fd-160671bb4b86 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:33.512418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70921aa3-2240-45e9-b9fd-160671bb4b86 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:33.512841 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70921aa3-2240-45e9-b9fd-160671bb4b86 None admin] PATH_INFO: `/v3/users/bbb6b460327949a18b1de23a04493ec0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:33.514839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70921aa3-2240-45e9-b9fd-160671bb4b86 None admin] RBAC: Authorizing `identity:get_user(user_id=bbb6b460327949a18b1de23a04493ec0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:33.516453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70921aa3-2240-45e9-b9fd-160671bb4b86 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:33.522737 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 86/163] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:33 2022] GET /identity/v3/users/bbb6b460327949a18b1de23a04493ec0 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:33.528784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70921aa3-2240-45e9-b9fd-160671bb4b86 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:33.723976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0da256-4505-42c4-a576-647c853c971c None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:33.764685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70921aa3-2240-45e9-b9fd-160671bb4b86 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:33.796773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa820684-9dcb-48f3-a185-268073a9798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:33.798248 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa820684-9dcb-48f3-a185-268073a9798f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:33.798770 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa820684-9dcb-48f3-a185-268073a9798f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:33.799239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa820684-9dcb-48f3-a185-268073a9798f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:33.813757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aedb9-913a-4b6c-9bbc-f15c4a2b948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:33.814942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aedb9-913a-4b6c-9bbc-f15c4a2b948d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:33.815361 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aedb9-913a-4b6c-9bbc-f15c4a2b948d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:33.815770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aedb9-913a-4b6c-9bbc-f15c4a2b948d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:33.824289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa820684-9dcb-48f3-a185-268073a9798f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:33.831834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-fa820684-9dcb-48f3-a185-268073a9798f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:33.833219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 78/164] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:33.842154 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f82cde-359f-41c3-ab17-367d5ae48bb7 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:33.842545 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f82cde-359f-41c3-ab17-367d5ae48bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:33.842928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f82cde-359f-41c3-ab17-367d5ae48bb7 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:33.845210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 79/165] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:33.846010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f82cde-359f-41c3-ab17-367d5ae48bb7 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:33.979655 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11aedb9-913a-4b6c-9bbc-f15c4a2b948d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:33.981394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11aedb9-913a-4b6c-9bbc-f15c4a2b948d None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:33.987241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f82cde-359f-41c3-ab17-367d5ae48bb7 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:34.028581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e7146-db26-4fc1-9833-ca01122d8e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:34.029802 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e7146-db26-4fc1-9833-ca01122d8e08 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:34.030224 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e7146-db26-4fc1-9833-ca01122d8e08 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:34.030604 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e7146-db26-4fc1-9833-ca01122d8e08 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:34.031756 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e7146-db26-4fc1-9833-ca01122d8e08 None admin] RBAC: Adding query filter params (name=member) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:34.032178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e7146-db26-4fc1-9833-ca01122d8e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:34.034152 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e7146-db26-4fc1-9833-ca01122d8e08 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:34.045343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 80/166] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:34.047011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0ff4f-6bfd-44d5-8d17-fa93c3c7acc6 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:34.047398 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0ff4f-6bfd-44d5-8d17-fa93c3c7acc6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:34.047779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0ff4f-6bfd-44d5-8d17-fa93c3c7acc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:34.080893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-83c0ff4f-6bfd-44d5-8d17-fa93c3c7acc6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:34.083018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-83c0ff4f-6bfd-44d5-8d17-fa93c3c7acc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:34.109228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 87/167] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 15:19:34.110412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aedb9-913a-4b6c-9bbc-f15c4a2b948d None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:34.204740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 81/168] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:34.205674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0ff4f-6bfd-44d5-8d17-fa93c3c7acc6 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:34.286873 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aedb9-913a-4b6c-9bbc-f15c4a2b948d None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:34.345085 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898135a7-6a9b-44c5-9989-34efe763e98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:34.345960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898135a7-6a9b-44c5-9989-34efe763e98c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:34.346237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898135a7-6a9b-44c5-9989-34efe763e98c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:34.346507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898135a7-6a9b-44c5-9989-34efe763e98c None admin] PATH_INFO: `/v3/users/3fa609439efa41e7832b839df854b004` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:34.348828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898135a7-6a9b-44c5-9989-34efe763e98c None admin] RBAC: Authorizing `identity:get_user(user_id=3fa609439efa41e7832b839df854b004)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:34.350283 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898135a7-6a9b-44c5-9989-34efe763e98c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:34.352480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 88/169] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:34 2022] GET /identity/v3/users/3fa609439efa41e7832b839df854b004 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:34.358373 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c0d95-42a8-43af-98ce-b85758805066 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:34.358643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c0d95-42a8-43af-98ce-b85758805066 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:34.358920 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c0d95-42a8-43af-98ce-b85758805066 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:34.362356 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 89/170] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:34.364606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c0d95-42a8-43af-98ce-b85758805066 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:34.379489 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0ff4f-6bfd-44d5-8d17-fa93c3c7acc6 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:34.436783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90570036-2d23-429a-b17d-553879ba4db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:34.437668 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90570036-2d23-429a-b17d-553879ba4db8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:34.437948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90570036-2d23-429a-b17d-553879ba4db8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:34.438220 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90570036-2d23-429a-b17d-553879ba4db8 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:34.441715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90570036-2d23-429a-b17d-553879ba4db8 None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:34.443232 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90570036-2d23-429a-b17d-553879ba4db8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:34.446420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 82/171] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:34 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:34.448668 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90570036-2d23-429a-b17d-553879ba4db8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:34.559728 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c0d95-42a8-43af-98ce-b85758805066 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:34.618453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f2e13-8b5a-4421-a21b-e37faf041418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:34.619265 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f2e13-8b5a-4421-a21b-e37faf041418 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:34.619546 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f2e13-8b5a-4421-a21b-e37faf041418 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:34.619814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f2e13-8b5a-4421-a21b-e37faf041418 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:34.629179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90570036-2d23-429a-b17d-553879ba4db8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:34.647527 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f2e13-8b5a-4421-a21b-e37faf041418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:34.657983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-8c5f2e13-8b5a-4421-a21b-e37faf041418 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:19:34.659211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 90/172] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:19:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:34.660531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b096cb7-f434-4bfa-b9e6-417591140979 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:34.660702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b096cb7-f434-4bfa-b9e6-417591140979 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:34.660970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b096cb7-f434-4bfa-b9e6-417591140979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:34.693791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-4b096cb7-f434-4bfa-b9e6-417591140979 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:34.695121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4b096cb7-f434-4bfa-b9e6-417591140979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:34.700843 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47720d2a-91c0-4d3f-ada5-9c5bab238350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:34.701498 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47720d2a-91c0-4d3f-ada5-9c5bab238350 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:34.701778 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47720d2a-91c0-4d3f-ada5-9c5bab238350 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:34.702046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47720d2a-91c0-4d3f-ada5-9c5bab238350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:34.794290 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47720d2a-91c0-4d3f-ada5-9c5bab238350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:34.795010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 91/173] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:34.795918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47720d2a-91c0-4d3f-ada5-9c5bab238350 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:34.796463 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b096cb7-f434-4bfa-b9e6-417591140979 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:34.911405 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 83/174] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:34.912264 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47720d2a-91c0-4d3f-ada5-9c5bab238350 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:34.913311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b096cb7-f434-4bfa-b9e6-417591140979 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:34.951628 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abcfaf-42fd-4652-8468-ee39075e81b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:34.952453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abcfaf-42fd-4652-8468-ee39075e81b3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:34.952742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abcfaf-42fd-4652-8468-ee39075e81b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:34.953016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abcfaf-42fd-4652-8468-ee39075e81b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:34.953842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abcfaf-42fd-4652-8468-ee39075e81b3 None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=1b979e84a2154694996d7c8a5aa5afd1, user.id=bbb6b460327949a18b1de23a04493ec0) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:34.954154 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abcfaf-42fd-4652-8468-ee39075e81b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:34.955589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abcfaf-42fd-4652-8468-ee39075e81b3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:34.968409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 92/175] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:34 2022] GET /identity/v3/role_assignments?user.id=bbb6b460327949a18b1de23a04493ec0&scope.project.id=1b979e84a2154694996d7c8a5aa5afd1&role.id=24a7898c863141f1911792647b5274e3 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:34.968409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e9104-6794-4226-8daf-b66e966203ad None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:34.968409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e9104-6794-4226-8daf-b66e966203ad None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:34.968409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e9104-6794-4226-8daf-b66e966203ad None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:34.968409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 93/176] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:34.968409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e9104-6794-4226-8daf-b66e966203ad None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:35.020917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47720d2a-91c0-4d3f-ada5-9c5bab238350 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:35.056275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de5f9-d866-4991-a689-d094bc414ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:35.056953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de5f9-d866-4991-a689-d094bc414ffb None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.057236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de5f9-d866-4991-a689-d094bc414ffb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.057512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de5f9-d866-4991-a689-d094bc414ffb None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.058331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24de5f9-d866-4991-a689-d094bc414ffb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:35.058642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24de5f9-d866-4991-a689-d094bc414ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:35.060052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24de5f9-d866-4991-a689-d094bc414ffb None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:35.074517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 84/177] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:19:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:35.074517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b48d35-865b-49e9-b0f8-456aa9646e83 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.074517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b48d35-865b-49e9-b0f8-456aa9646e83 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.074517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b48d35-865b-49e9-b0f8-456aa9646e83 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.074517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 85/178] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:35.074517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b48d35-865b-49e9-b0f8-456aa9646e83 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:35.088127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e9104-6794-4226-8daf-b66e966203ad None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:35.123846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ff997-1bd0-4696-9b56-c8388765b393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:35.124995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ff997-1bd0-4696-9b56-c8388765b393 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.125468 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ff997-1bd0-4696-9b56-c8388765b393 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.125747 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ff997-1bd0-4696-9b56-c8388765b393 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.137485 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ff997-1bd0-4696-9b56-c8388765b393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:35.144444 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-215ff997-1bd0-4696-9b56-c8388765b393 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:19:35.145835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 94/179] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:19:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:35.146919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58fb37-ad6c-496e-ae9c-4e69c16cfa60 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.147276 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58fb37-ad6c-496e-ae9c-4e69c16cfa60 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.147551 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58fb37-ad6c-496e-ae9c-4e69c16cfa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.164881 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-1e58fb37-ad6c-496e-ae9c-4e69c16cfa60 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:35.166278 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-1e58fb37-ad6c-496e-ae9c-4e69c16cfa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:35.186587 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b48d35-865b-49e9-b0f8-456aa9646e83 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:35.221568 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b567-7743-42ab-943a-82706277398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:35.222426 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b567-7743-42ab-943a-82706277398a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.222698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b567-7743-42ab-943a-82706277398a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.223242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b567-7743-42ab-943a-82706277398a None admin] PATH_INFO: `/v3/projects/792f593907214d6ead7b005cae2ca81e` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.224166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57b567-7743-42ab-943a-82706277398a None admin] RBAC: Authorizing `identity:get_project(project_id=792f593907214d6ead7b005cae2ca81e)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:35.225625 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57b567-7743-42ab-943a-82706277398a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:35.227362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 86/180] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:35 2022] GET /identity/v3/projects/792f593907214d6ead7b005cae2ca81e => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:35.228681 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883aa535-cd94-468f-9a0a-1a081d0585cb None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.228964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883aa535-cd94-468f-9a0a-1a081d0585cb None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.229238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883aa535-cd94-468f-9a0a-1a081d0585cb None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.230837 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 87/181] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:35.231964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883aa535-cd94-468f-9a0a-1a081d0585cb None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:35.238417 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 95/182] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:35.239691 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707de0e-2300-4462-a381-d790ee14757b None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.239979 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707de0e-2300-4462-a381-d790ee14757b None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.240720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707de0e-2300-4462-a381-d790ee14757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.256832 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5707de0e-2300-4462-a381-d790ee14757b None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:35.258530 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5707de0e-2300-4462-a381-d790ee14757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:35.319034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 96/183] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:35.320388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707de0e-2300-4462-a381-d790ee14757b None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:35.326815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883aa535-cd94-468f-9a0a-1a081d0585cb None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:35.358840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113fcdb-359b-4467-b0d6-e9bb4b9a5c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:35.359694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113fcdb-359b-4467-b0d6-e9bb4b9a5c97 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.359970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113fcdb-359b-4467-b0d6-e9bb4b9a5c97 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.360270 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113fcdb-359b-4467-b0d6-e9bb4b9a5c97 None admin] PATH_INFO: `/v3/users/3fa609439efa41e7832b839df854b004` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.361449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113fcdb-359b-4467-b0d6-e9bb4b9a5c97 None admin] RBAC: Authorizing `identity:get_user(user_id=3fa609439efa41e7832b839df854b004)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:35.362883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113fcdb-359b-4467-b0d6-e9bb4b9a5c97 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:35.364506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 88/184] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:35 2022] GET /identity/v3/users/3fa609439efa41e7832b839df854b004 => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:35.365251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113fcdb-359b-4467-b0d6-e9bb4b9a5c97 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:35.415104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707de0e-2300-4462-a381-d790ee14757b None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:35.446895 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707571a4-a026-4974-9dda-392bdd793683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:35.447544 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707571a4-a026-4974-9dda-392bdd793683 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.447824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707571a4-a026-4974-9dda-392bdd793683 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.448097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707571a4-a026-4974-9dda-392bdd793683 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.448862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707571a4-a026-4974-9dda-392bdd793683 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:35.449165 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707571a4-a026-4974-9dda-392bdd793683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:35.450543 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707571a4-a026-4974-9dda-392bdd793683 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:35.457190 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113fcdb-359b-4467-b0d6-e9bb4b9a5c97 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:35.458051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 97/185] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:35.459182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f7727-c96a-457f-a007-793daf500f22 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.459464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f7727-c96a-457f-a007-793daf500f22 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.459734 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f7727-c96a-457f-a007-793daf500f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.474896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-1d6f7727-c96a-457f-a007-793daf500f22 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:35.476079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-1d6f7727-c96a-457f-a007-793daf500f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:35.488432 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61af3e4-08a9-4e14-bfa9-d43d10651160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:35.489072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af3e4-08a9-4e14-bfa9-d43d10651160 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.489351 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af3e4-08a9-4e14-bfa9-d43d10651160 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.489626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af3e4-08a9-4e14-bfa9-d43d10651160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.490432 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61af3e4-08a9-4e14-bfa9-d43d10651160 None admin] RBAC: Adding query filter params (role.id=ab135a02f63c4a138c6b116ad4f9c8d0, scope.project.id=792f593907214d6ead7b005cae2ca81e, user.id=3fa609439efa41e7832b839df854b004) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:35.490739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61af3e4-08a9-4e14-bfa9-d43d10651160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:35.492994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61af3e4-08a9-4e14-bfa9-d43d10651160 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:35.504217 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 89/186] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:35 2022] GET /identity/v3/role_assignments?user.id=3fa609439efa41e7832b839df854b004&scope.project.id=792f593907214d6ead7b005cae2ca81e&role.id=ab135a02f63c4a138c6b116ad4f9c8d0 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:35.504217 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61af3e4-08a9-4e14-bfa9-d43d10651160 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:35.552183 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 98/187] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:35.552183 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f7727-c96a-457f-a007-793daf500f22 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:35.611779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61af3e4-08a9-4e14-bfa9-d43d10651160 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:35.647223 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36834edd-cb0e-4067-bca9-632de7b4f2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:35.647430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f7727-c96a-457f-a007-793daf500f22 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:35.648069 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36834edd-cb0e-4067-bca9-632de7b4f2d0 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.648382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36834edd-cb0e-4067-bca9-632de7b4f2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.648658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36834edd-cb0e-4067-bca9-632de7b4f2d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.659754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36834edd-cb0e-4067-bca9-632de7b4f2d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:35.667274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-36834edd-cb0e-4067-bca9-632de7b4f2d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:19:35.673812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 90/188] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:19:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:35.673812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36834edd-cb0e-4067-bca9-632de7b4f2d0 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:35.683288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960c553-4ca0-4822-88ab-0fc54ca9000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:35.684082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960c553-4ca0-4822-88ab-0fc54ca9000a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.684387 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960c553-4ca0-4822-88ab-0fc54ca9000a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.685217 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960c553-4ca0-4822-88ab-0fc54ca9000a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.685901 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960c553-4ca0-4822-88ab-0fc54ca9000a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:35.687959 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960c553-4ca0-4822-88ab-0fc54ca9000a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:35.688951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 99/189] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:35.694402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960c553-4ca0-4822-88ab-0fc54ca9000a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:35.769761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36834edd-cb0e-4067-bca9-632de7b4f2d0 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:35.787785 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960c553-4ca0-4822-88ab-0fc54ca9000a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:35.801485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e7f39-fbce-4294-8e1a-68991138d546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:35.802126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e7f39-fbce-4294-8e1a-68991138d546 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.802407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e7f39-fbce-4294-8e1a-68991138d546 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.802679 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e7f39-fbce-4294-8e1a-68991138d546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.820300 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b5d0e-b562-47a6-8f43-5a71a10b79f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:35.821154 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5d0e-b562-47a6-8f43-5a71a10b79f8 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.821434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5d0e-b562-47a6-8f43-5a71a10b79f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.821703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b5d0e-b562-47a6-8f43-5a71a10b79f8 None admin] PATH_INFO: `/v3/users/c63d03578b244677b4c31eac170fd370` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.834245 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b5d0e-b562-47a6-8f43-5a71a10b79f8 None admin] RBAC: Authorizing `identity:get_user(user_id=c63d03578b244677b4c31eac170fd370)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:35.835754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b5d0e-b562-47a6-8f43-5a71a10b79f8 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:35.837432 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 100/190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:35 2022] GET /identity/v3/users/c63d03578b244677b4c31eac170fd370 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:35.838182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b5d0e-b562-47a6-8f43-5a71a10b79f8 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:35.867616 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e7f39-fbce-4294-8e1a-68991138d546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:35.869113 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e7f39-fbce-4294-8e1a-68991138d546 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:35.939814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b5d0e-b562-47a6-8f43-5a71a10b79f8 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:35.960634 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 91/191] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:35.961370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e7f39-fbce-4294-8e1a-68991138d546 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:35.975467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95958da-2d80-4a2e-958b-e38265674a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:35.976880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95958da-2d80-4a2e-958b-e38265674a4b None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:35.977160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95958da-2d80-4a2e-958b-e38265674a4b None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:35.977429 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95958da-2d80-4a2e-958b-e38265674a4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:35.986992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95958da-2d80-4a2e-958b-e38265674a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:35.994889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-a95958da-2d80-4a2e-958b-e38265674a4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 15:19:35.996052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 101/192] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:35.996811 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95958da-2d80-4a2e-958b-e38265674a4b None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:36.053651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e7f39-fbce-4294-8e1a-68991138d546 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:36.085766 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f64fc9-3dfb-4b26-be7e-ee1767892807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:36.086897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f64fc9-3dfb-4b26-be7e-ee1767892807 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:36.087363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f64fc9-3dfb-4b26-be7e-ee1767892807 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:36.087870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f64fc9-3dfb-4b26-be7e-ee1767892807 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:36.089004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95958da-2d80-4a2e-958b-e38265674a4b None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:36.089277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f64fc9-3dfb-4b26-be7e-ee1767892807 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:36.089789 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f64fc9-3dfb-4b26-be7e-ee1767892807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:36.091706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f64fc9-3dfb-4b26-be7e-ee1767892807 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:36.099817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 92/193] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:19:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:36.100654 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f64fc9-3dfb-4b26-be7e-ee1767892807 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:36.122251 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70f24d-181a-4fb9-81a8-08ff836b1819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:36.122911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f24d-181a-4fb9-81a8-08ff836b1819 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:36.123193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f24d-181a-4fb9-81a8-08ff836b1819 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:36.123471 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f24d-181a-4fb9-81a8-08ff836b1819 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:36.124196 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70f24d-181a-4fb9-81a8-08ff836b1819 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:36.125638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70f24d-181a-4fb9-81a8-08ff836b1819 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:36.195281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f64fc9-3dfb-4b26-be7e-ee1767892807 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:36.227414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1e0d3-0e77-414e-91ad-1f85f399394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:36.228046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1e0d3-0e77-414e-91ad-1f85f399394b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:36.228360 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1e0d3-0e77-414e-91ad-1f85f399394b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:36.228640 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1e0d3-0e77-414e-91ad-1f85f399394b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:36.246743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 102/194] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:19:35 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:19:36.247660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70f24d-181a-4fb9-81a8-08ff836b1819 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:36.298438 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1e0d3-0e77-414e-91ad-1f85f399394b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:36.299932 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1e0d3-0e77-414e-91ad-1f85f399394b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:36.355446 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70f24d-181a-4fb9-81a8-08ff836b1819 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:36.389474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb10f27-5f93-49fc-ac06-19b8043fef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:36.390345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb10f27-5f93-49fc-ac06-19b8043fef78 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:36.390625 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb10f27-5f93-49fc-ac06-19b8043fef78 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:36.390901 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb10f27-5f93-49fc-ac06-19b8043fef78 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:36.392121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb10f27-5f93-49fc-ac06-19b8043fef78 None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:36.393727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb10f27-5f93-49fc-ac06-19b8043fef78 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:36.401245 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 103/195] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:36 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:36.401245 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb10f27-5f93-49fc-ac06-19b8043fef78 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:36.408515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 93/196] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:36.413373 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1e0d3-0e77-414e-91ad-1f85f399394b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:36.503916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb10f27-5f93-49fc-ac06-19b8043fef78 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:36.512291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1e0d3-0e77-414e-91ad-1f85f399394b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:36.540638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743cbae-d5b7-47d5-bdd8-0299b8da0d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:36.541277 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743cbae-d5b7-47d5-bdd8-0299b8da0d4c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:36.550619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743cbae-d5b7-47d5-bdd8-0299b8da0d4c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:36.550619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743cbae-d5b7-47d5-bdd8-0299b8da0d4c None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:36.550619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743cbae-d5b7-47d5-bdd8-0299b8da0d4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:36.550619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743cbae-d5b7-47d5-bdd8-0299b8da0d4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:36.550619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743cbae-d5b7-47d5-bdd8-0299b8da0d4c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:36.550956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c025cbd-cadb-4226-928a-f1ee107cc9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:36.550956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c025cbd-cadb-4226-928a-f1ee107cc9a5 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:36.550956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c025cbd-cadb-4226-928a-f1ee107cc9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:36.550956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c025cbd-cadb-4226-928a-f1ee107cc9a5 None admin] PATH_INFO: `/v3/users/c63d03578b244677b4c31eac170fd370` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:36.551198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c025cbd-cadb-4226-928a-f1ee107cc9a5 None admin] RBAC: Authorizing `identity:get_user(user_id=c63d03578b244677b4c31eac170fd370)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:36.552482 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 104/197] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:36.554266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c025cbd-cadb-4226-928a-f1ee107cc9a5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:36.554400 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743cbae-d5b7-47d5-bdd8-0299b8da0d4c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:36.555034 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 94/198] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:36 2022] GET /identity/v3/users/c63d03578b244677b4c31eac170fd370 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:36.555832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c025cbd-cadb-4226-928a-f1ee107cc9a5 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:36.657020 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743cbae-d5b7-47d5-bdd8-0299b8da0d4c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:36.658606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c025cbd-cadb-4226-928a-f1ee107cc9a5 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:36.690215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45e5c6-d225-4e0c-901f-cdd3c73b016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:36.691064 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e5c6-d225-4e0c-901f-cdd3c73b016a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:36.691437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e5c6-d225-4e0c-901f-cdd3c73b016a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:36.691815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e5c6-d225-4e0c-901f-cdd3c73b016a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:36.692277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30641885-b876-4b8a-9f27-bd1399fd8d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:36.692665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e5c6-d225-4e0c-901f-cdd3c73b016a None admin] RBAC: Adding query filter params (role.id=21dc73c091ba46889022763efb51de4e, scope.project.id=1b979e84a2154694996d7c8a5aa5afd1, user.id=3fa609439efa41e7832b839df854b004) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:36.692977 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e5c6-d225-4e0c-901f-cdd3c73b016a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:36.693146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30641885-b876-4b8a-9f27-bd1399fd8d88 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:36.693408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30641885-b876-4b8a-9f27-bd1399fd8d88 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:36.693690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30641885-b876-4b8a-9f27-bd1399fd8d88 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:36.694521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e5c6-d225-4e0c-901f-cdd3c73b016a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:36.695455 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30641885-b876-4b8a-9f27-bd1399fd8d88 None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:36.696989 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30641885-b876-4b8a-9f27-bd1399fd8d88 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:36.698682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 95/199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:36 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:36.699459 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30641885-b876-4b8a-9f27-bd1399fd8d88 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:36.701590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 105/200] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:36 2022] GET /identity/v3/role_assignments?user.id=3fa609439efa41e7832b839df854b004&scope.project.id=1b979e84a2154694996d7c8a5aa5afd1&role.id=21dc73c091ba46889022763efb51de4e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:36.702408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45e5c6-d225-4e0c-901f-cdd3c73b016a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:36.804186 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45e5c6-d225-4e0c-901f-cdd3c73b016a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:36.804357 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30641885-b876-4b8a-9f27-bd1399fd8d88 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:36.840582 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf944d-5fd9-442a-b45f-4be49c9b4116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:36.840777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a390e8-b42d-4b7d-a874-5dc421a74317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:36.841300 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a390e8-b42d-4b7d-a874-5dc421a74317 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:36.841533 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf944d-5fd9-442a-b45f-4be49c9b4116 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:36.841649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a390e8-b42d-4b7d-a874-5dc421a74317 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:36.841819 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf944d-5fd9-442a-b45f-4be49c9b4116 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:36.841911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a390e8-b42d-4b7d-a874-5dc421a74317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:36.842097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf944d-5fd9-442a-b45f-4be49c9b4116 None admin] PATH_INFO: `/v3/users/682d23b6974d46e389f7ea018ccac033` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:36.843364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf944d-5fd9-442a-b45f-4be49c9b4116 None admin] RBAC: Authorizing `identity:get_user(user_id=682d23b6974d46e389f7ea018ccac033)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:36.844967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf944d-5fd9-442a-b45f-4be49c9b4116 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:36.846606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 96/201] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:36 2022] GET /identity/v3/users/682d23b6974d46e389f7ea018ccac033 => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:36.847376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf944d-5fd9-442a-b45f-4be49c9b4116 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:36.912862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a390e8-b42d-4b7d-a874-5dc421a74317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:36.914372 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a390e8-b42d-4b7d-a874-5dc421a74317 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:36.950674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf944d-5fd9-442a-b45f-4be49c9b4116 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:36.990683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0a643-8bef-4900-ba2d-37a3f72c2e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:36.992264 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0a643-8bef-4900-ba2d-37a3f72c2e51 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:36.992421 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0a643-8bef-4900-ba2d-37a3f72c2e51 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:36.996169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0a643-8bef-4900-ba2d-37a3f72c2e51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:36.996169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0a643-8bef-4900-ba2d-37a3f72c2e51 None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=0875194231ad4cbd89e6165cb46375c3, user.id=c63d03578b244677b4c31eac170fd370) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:36.996169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0a643-8bef-4900-ba2d-37a3f72c2e51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:36.996169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0a643-8bef-4900-ba2d-37a3f72c2e51 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:37.001311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 97/202] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:36 2022] GET /identity/v3/role_assignments?user.id=c63d03578b244677b4c31eac170fd370&scope.project.id=0875194231ad4cbd89e6165cb46375c3&role.id=24a7898c863141f1911792647b5274e3 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:37.002145 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0a643-8bef-4900-ba2d-37a3f72c2e51 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:37.017319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 106/203] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:37.025742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a390e8-b42d-4b7d-a874-5dc421a74317 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:37.138395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0a643-8bef-4900-ba2d-37a3f72c2e51 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:37.166572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a390e8-b42d-4b7d-a874-5dc421a74317 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:37.180484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a1578-c364-4ba6-bb90-341f3bc3eaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:37.181111 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a1578-c364-4ba6-bb90-341f3bc3eaf5 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:37.181391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a1578-c364-4ba6-bb90-341f3bc3eaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:37.181665 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a1578-c364-4ba6-bb90-341f3bc3eaf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:37.209586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e4a4e-6975-4f92-8dcd-b09bb999f500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:37.211066 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e4a4e-6975-4f92-8dcd-b09bb999f500 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:37.211371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e4a4e-6975-4f92-8dcd-b09bb999f500 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:37.211782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e4a4e-6975-4f92-8dcd-b09bb999f500 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:37.213366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e4a4e-6975-4f92-8dcd-b09bb999f500 None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:37.215456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e4a4e-6975-4f92-8dcd-b09bb999f500 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:37.218040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 107/204] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:37 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:37.224371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e4a4e-6975-4f92-8dcd-b09bb999f500 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:37.261730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a1578-c364-4ba6-bb90-341f3bc3eaf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:37.263215 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a1578-c364-4ba6-bb90-341f3bc3eaf5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:37.356759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e4a4e-6975-4f92-8dcd-b09bb999f500 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:37.375872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 98/205] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:37.381969 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a1578-c364-4ba6-bb90-341f3bc3eaf5 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:37.404729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c4f53-caec-4957-bb15-be5d388d04f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:37.405311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c4f53-caec-4957-bb15-be5d388d04f6 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:37.405593 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c4f53-caec-4957-bb15-be5d388d04f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:37.405867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c4f53-caec-4957-bb15-be5d388d04f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:37.406708 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c4f53-caec-4957-bb15-be5d388d04f6 None admin] RBAC: Adding query filter params (role.id=21dc73c091ba46889022763efb51de4e, scope.project.id=0875194231ad4cbd89e6165cb46375c3, user.id=c63d03578b244677b4c31eac170fd370) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:37.407020 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c4f53-caec-4957-bb15-be5d388d04f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:37.408547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c4f53-caec-4957-bb15-be5d388d04f6 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:37.416682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 108/206] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:37 2022] GET /identity/v3/role_assignments?user.id=c63d03578b244677b4c31eac170fd370&scope.project.id=0875194231ad4cbd89e6165cb46375c3&role.id=21dc73c091ba46889022763efb51de4e => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:37.490709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a1578-c364-4ba6-bb90-341f3bc3eaf5 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:37.528403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab127928-be5e-441f-8e33-731462cfbb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:37.529269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127928-be5e-441f-8e33-731462cfbb85 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:37.529551 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127928-be5e-441f-8e33-731462cfbb85 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:37.529907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab127928-be5e-441f-8e33-731462cfbb85 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:37.531173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab127928-be5e-441f-8e33-731462cfbb85 None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:37.532707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab127928-be5e-441f-8e33-731462cfbb85 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:37.534808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 99/207] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:37 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:37.541166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c4f53-caec-4957-bb15-be5d388d04f6 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:37.665685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c4f53-caec-4957-bb15-be5d388d04f6 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:37.707397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aaa93-226c-4fdd-9b5a-7152785e3340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:37.708048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aaa93-226c-4fdd-9b5a-7152785e3340 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:37.708353 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aaa93-226c-4fdd-9b5a-7152785e3340 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:37.708627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aaa93-226c-4fdd-9b5a-7152785e3340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:37.709456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aaa93-226c-4fdd-9b5a-7152785e3340 None admin] RBAC: Adding query filter params (role.id=2e236c62c0f041ab91e9fab86a52cd2d, scope.project.id=1b979e84a2154694996d7c8a5aa5afd1, user.id=682d23b6974d46e389f7ea018ccac033) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:37.709763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aaa93-226c-4fdd-9b5a-7152785e3340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:37.711767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aaa93-226c-4fdd-9b5a-7152785e3340 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:37.720908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 109/208] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:37 2022] GET /identity/v3/role_assignments?user.id=682d23b6974d46e389f7ea018ccac033&scope.project.id=1b979e84a2154694996d7c8a5aa5afd1&role.id=2e236c62c0f041ab91e9fab86a52cd2d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:39.008590 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e458a-eced-4779-8212-daa0bfb6d494 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:39.009121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e458a-eced-4779-8212-daa0bfb6d494 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:39.009121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e458a-eced-4779-8212-daa0bfb6d494 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:39.010918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 100/209] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:39.016409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99d4ec-af76-4898-a40e-bb1e9f483bea None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:39.016804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99d4ec-af76-4898-a40e-bb1e9f483bea None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:39.016983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99d4ec-af76-4898-a40e-bb1e9f483bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:39.034961 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-4b99d4ec-af76-4898-a40e-bb1e9f483bea None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:39.036248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4b99d4ec-af76-4898-a40e-bb1e9f483bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:39.101834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99104-138c-4064-b8e4-5dcad9b215db None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:39.102130 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99104-138c-4064-b8e4-5dcad9b215db None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:39.102398 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d99104-138c-4064-b8e4-5dcad9b215db None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:39.104337 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 101/210] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:39.106295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 110/211] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:39.109209 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f37f9-a8f2-4889-876f-c5fe1602343d None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:39.109499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f37f9-a8f2-4889-876f-c5fe1602343d None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:39.109778 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f37f9-a8f2-4889-876f-c5fe1602343d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:39.129520 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-2e4f37f9-a8f2-4889-876f-c5fe1602343d None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:39.130704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2e4f37f9-a8f2-4889-876f-c5fe1602343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:39.135322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99d4ec-af76-4898-a40e-bb1e9f483bea None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:39.202245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 102/212] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:39.225607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f37f9-a8f2-4889-876f-c5fe1602343d None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:39.262218 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99d4ec-af76-4898-a40e-bb1e9f483bea None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:39.303663 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cee9f1-3165-43db-9d1c-fa3456328a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:39.306131 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cee9f1-3165-43db-9d1c-fa3456328a38 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:39.306645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cee9f1-3165-43db-9d1c-fa3456328a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:39.307119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cee9f1-3165-43db-9d1c-fa3456328a38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:39.308626 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cee9f1-3165-43db-9d1c-fa3456328a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:39.310814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cee9f1-3165-43db-9d1c-fa3456328a38 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:39.313502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 111/213] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:39.319273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cee9f1-3165-43db-9d1c-fa3456328a38 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:39.342269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f37f9-a8f2-4889-876f-c5fe1602343d None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:39.388583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334cbae-6d70-4ccc-8eaf-24cb093e97ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:39.389977 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334cbae-6d70-4ccc-8eaf-24cb093e97ae None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:39.390724 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334cbae-6d70-4ccc-8eaf-24cb093e97ae None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:39.391514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334cbae-6d70-4ccc-8eaf-24cb093e97ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:39.405466 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334cbae-6d70-4ccc-8eaf-24cb093e97ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:39.415154 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-b334cbae-6d70-4ccc-8eaf-24cb093e97ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:39.421661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 103/214] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:39.423346 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334cbae-6d70-4ccc-8eaf-24cb093e97ae None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:39.438821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cee9f1-3165-43db-9d1c-fa3456328a38 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:39.485304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb01844-f30c-41a5-8f76-5d5fc70aa83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:39.486484 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb01844-f30c-41a5-8f76-5d5fc70aa83f None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:39.487266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb01844-f30c-41a5-8f76-5d5fc70aa83f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:39.487981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb01844-f30c-41a5-8f76-5d5fc70aa83f None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:39.488944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb01844-f30c-41a5-8f76-5d5fc70aa83f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:39.490769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb01844-f30c-41a5-8f76-5d5fc70aa83f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:39.525091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334cbae-6d70-4ccc-8eaf-24cb093e97ae None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:39.560050 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902343c-94ae-42f8-917f-e11ebd8dabc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:39.560769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902343c-94ae-42f8-917f-e11ebd8dabc3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:39.561053 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902343c-94ae-42f8-917f-e11ebd8dabc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:39.561325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902343c-94ae-42f8-917f-e11ebd8dabc3 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:39.562147 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902343c-94ae-42f8-917f-e11ebd8dabc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:39.562459 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902343c-94ae-42f8-917f-e11ebd8dabc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:39.563884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902343c-94ae-42f8-917f-e11ebd8dabc3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:39.578007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 104/215] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:39.579912 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902343c-94ae-42f8-917f-e11ebd8dabc3 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:39.591420 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 112/216] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:19:39 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:19:39.714098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902343c-94ae-42f8-917f-e11ebd8dabc3 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:39.754446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd909c10-6717-43a5-938a-07d760581cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:39.755728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd909c10-6717-43a5-938a-07d760581cd0 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:39.756249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd909c10-6717-43a5-938a-07d760581cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:39.756725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd909c10-6717-43a5-938a-07d760581cd0 None admin] PATH_INFO: `/v3/users/d08bd84da3f345d79fdae2603b80acfa` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:39.774025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd909c10-6717-43a5-938a-07d760581cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=d08bd84da3f345d79fdae2603b80acfa)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:39.776078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd909c10-6717-43a5-938a-07d760581cd0 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:39.778762 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 105/217] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:39 2022] GET /identity/v3/users/d08bd84da3f345d79fdae2603b80acfa => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:39.784390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb01844-f30c-41a5-8f76-5d5fc70aa83f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:39.809675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77573a38-8d76-47f4-b84c-33fc815808f6 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:39.809974 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77573a38-8d76-47f4-b84c-33fc815808f6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:39.810238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77573a38-8d76-47f4-b84c-33fc815808f6 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:39.814280 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 106/218] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:39.817116 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac867-3afe-480c-adbf-74b730b9c193 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:39.817403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac867-3afe-480c-adbf-74b730b9c193 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:39.817682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac867-3afe-480c-adbf-74b730b9c193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:39.839711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-83aac867-3afe-480c-adbf-74b730b9c193 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:39.840948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-83aac867-3afe-480c-adbf-74b730b9c193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:39.909002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb01844-f30c-41a5-8f76-5d5fc70aa83f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:39.939793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 107/219] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:19:39.950143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed60b19-336f-4fc6-806c-41eb808acf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:39.950807 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed60b19-336f-4fc6-806c-41eb808acf82 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:39.951096 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed60b19-336f-4fc6-806c-41eb808acf82 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:39.951375 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed60b19-336f-4fc6-806c-41eb808acf82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:39.964630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aac867-3afe-480c-adbf-74b730b9c193 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:40.030862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed60b19-336f-4fc6-806c-41eb808acf82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:40.038915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed60b19-336f-4fc6-806c-41eb808acf82 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:40.078294 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aac867-3afe-480c-adbf-74b730b9c193 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:40.112792 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf60c70-3f29-4249-86c8-b7d17cdc97e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:40.113590 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf60c70-3f29-4249-86c8-b7d17cdc97e2 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:40.113872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf60c70-3f29-4249-86c8-b7d17cdc97e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:40.114146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf60c70-3f29-4249-86c8-b7d17cdc97e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:40.124804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf60c70-3f29-4249-86c8-b7d17cdc97e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:40.131732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-4bf60c70-3f29-4249-86c8-b7d17cdc97e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:19:40.133290 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 108/220] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:19:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:40.134525 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8f29b-4820-4553-bae4-7f7b9e9250bb None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:40.134810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8f29b-4820-4553-bae4-7f7b9e9250bb None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:40.135091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8f29b-4820-4553-bae4-7f7b9e9250bb None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:40.137026 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 109/221] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:40.141938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8f29b-4820-4553-bae4-7f7b9e9250bb None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:40.148291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 113/222] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:40.149612 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1391736-4bd6-4c4f-b4a6-12635fda5338 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:40.149899 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1391736-4bd6-4c4f-b4a6-12635fda5338 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:40.150177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1391736-4bd6-4c4f-b4a6-12635fda5338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:40.167319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c1391736-4bd6-4c4f-b4a6-12635fda5338 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:40.168535 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c1391736-4bd6-4c4f-b4a6-12635fda5338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:40.235224 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 114/223] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:40.236072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1391736-4bd6-4c4f-b4a6-12635fda5338 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:40.258275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8f29b-4820-4553-bae4-7f7b9e9250bb None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:40.300089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e833e8-7b16-47fc-9bda-843b0697a056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:40.300709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e833e8-7b16-47fc-9bda-843b0697a056 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:40.300996 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e833e8-7b16-47fc-9bda-843b0697a056 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:40.301272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e833e8-7b16-47fc-9bda-843b0697a056 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:40.302016 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e833e8-7b16-47fc-9bda-843b0697a056 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:40.302325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e833e8-7b16-47fc-9bda-843b0697a056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:40.303697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e833e8-7b16-47fc-9bda-843b0697a056 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:40.312198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 110/224] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:40.313041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e833e8-7b16-47fc-9bda-843b0697a056 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:40.340850 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1391736-4bd6-4c4f-b4a6-12635fda5338 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:40.378654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aefd67-ba4e-435a-8e97-4da17a84596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:40.379507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aefd67-ba4e-435a-8e97-4da17a84596a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:40.379831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aefd67-ba4e-435a-8e97-4da17a84596a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:40.380114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aefd67-ba4e-435a-8e97-4da17a84596a None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:40.381357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aefd67-ba4e-435a-8e97-4da17a84596a None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:40.383354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aefd67-ba4e-435a-8e97-4da17a84596a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:40.385128 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 115/225] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:40 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:40.385918 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aefd67-ba4e-435a-8e97-4da17a84596a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:40.411563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e833e8-7b16-47fc-9bda-843b0697a056 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:40.452341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebab63d-09fb-469e-904f-970d0c1b9042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:40.453435 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab63d-09fb-469e-904f-970d0c1b9042 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:40.453780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab63d-09fb-469e-904f-970d0c1b9042 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:40.454060 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebab63d-09fb-469e-904f-970d0c1b9042 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:40.468109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebab63d-09fb-469e-904f-970d0c1b9042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:40.477541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-6ebab63d-09fb-469e-904f-970d0c1b9042 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:19:40.479341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 111/226] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:19:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:40.480120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebab63d-09fb-469e-904f-970d0c1b9042 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:40.483870 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aefd67-ba4e-435a-8e97-4da17a84596a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:40.524357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc6166-68b4-4c2f-af46-ed2679268ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:40.525655 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc6166-68b4-4c2f-af46-ed2679268ffc None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:40.525938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc6166-68b4-4c2f-af46-ed2679268ffc None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:40.526217 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc6166-68b4-4c2f-af46-ed2679268ffc None admin] PATH_INFO: `/v3/users/c63d03578b244677b4c31eac170fd370` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:40.527793 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc6166-68b4-4c2f-af46-ed2679268ffc None admin] RBAC: Authorizing `identity:get_user(user_id=c63d03578b244677b4c31eac170fd370)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:40.530035 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc6166-68b4-4c2f-af46-ed2679268ffc None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:40.532628 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 116/227] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:40 2022] GET /identity/v3/users/c63d03578b244677b4c31eac170fd370 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:40.533511 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc6166-68b4-4c2f-af46-ed2679268ffc None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:40.589617 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebab63d-09fb-469e-904f-970d0c1b9042 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:40.659937 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77124cc2-98a4-49d0-aab4-c4c800e1d3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:40.660639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77124cc2-98a4-49d0-aab4-c4c800e1d3a3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:40.660921 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77124cc2-98a4-49d0-aab4-c4c800e1d3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:40.661256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77124cc2-98a4-49d0-aab4-c4c800e1d3a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:40.662404 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77124cc2-98a4-49d0-aab4-c4c800e1d3a3 None admin] RBAC: Adding query filter params (role.id=ab135a02f63c4a138c6b116ad4f9c8d0, scope.project.id=0875194231ad4cbd89e6165cb46375c3, user.id=d08bd84da3f345d79fdae2603b80acfa) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:40.662716 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77124cc2-98a4-49d0-aab4-c4c800e1d3a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:40.664422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77124cc2-98a4-49d0-aab4-c4c800e1d3a3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:40.671041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 112/228] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:40 2022] GET /identity/v3/role_assignments?user.id=d08bd84da3f345d79fdae2603b80acfa&scope.project.id=0875194231ad4cbd89e6165cb46375c3&role.id=ab135a02f63c4a138c6b116ad4f9c8d0 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:40.672080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77124cc2-98a4-49d0-aab4-c4c800e1d3a3 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:40.702053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc6166-68b4-4c2f-af46-ed2679268ffc None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:40.779236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ea181-5862-4bd2-8c2d-7b8a839e9037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:40.779916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ea181-5862-4bd2-8c2d-7b8a839e9037 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:40.780223 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ea181-5862-4bd2-8c2d-7b8a839e9037 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:40.782109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ea181-5862-4bd2-8c2d-7b8a839e9037 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:40.782907 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ea181-5862-4bd2-8c2d-7b8a839e9037 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:40.783220 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ea181-5862-4bd2-8c2d-7b8a839e9037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:40.784677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ea181-5862-4bd2-8c2d-7b8a839e9037 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:40.803734 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 117/229] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:19:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:40.813713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ea181-5862-4bd2-8c2d-7b8a839e9037 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:40.861580 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77124cc2-98a4-49d0-aab4-c4c800e1d3a3 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:40.906098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c5e48-2b38-4a18-9260-0f5c4e761f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:40.907293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c5e48-2b38-4a18-9260-0f5c4e761f80 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:40.907774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c5e48-2b38-4a18-9260-0f5c4e761f80 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:40.908296 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c5e48-2b38-4a18-9260-0f5c4e761f80 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:40.909713 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c5e48-2b38-4a18-9260-0f5c4e761f80 None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:40.911360 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c5e48-2b38-4a18-9260-0f5c4e761f80 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:40.913337 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 113/230] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:40 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:40.919010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c5e48-2b38-4a18-9260-0f5c4e761f80 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:40.959403 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ea181-5862-4bd2-8c2d-7b8a839e9037 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:41.015547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac3fe-fa09-4e04-bec1-1c8880833d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:41.016452 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac3fe-fa09-4e04-bec1-1c8880833d63 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:41.016740 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac3fe-fa09-4e04-bec1-1c8880833d63 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:41.017026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac3fe-fa09-4e04-bec1-1c8880833d63 None admin] PATH_INFO: `/v3/users/c63d03578b244677b4c31eac170fd370` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:41.020862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbac3fe-fa09-4e04-bec1-1c8880833d63 None admin] RBAC: Authorizing `identity:get_user(user_id=c63d03578b244677b4c31eac170fd370)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:41.022323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbac3fe-fa09-4e04-bec1-1c8880833d63 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:41.028250 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 118/231] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:40 2022] GET /identity/v3/users/c63d03578b244677b4c31eac170fd370 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:41.029709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c5e48-2b38-4a18-9260-0f5c4e761f80 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:41.041637 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac3fe-fa09-4e04-bec1-1c8880833d63 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:41.067911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896c231-9148-4dfa-8626-b072c953db8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:41.069238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896c231-9148-4dfa-8626-b072c953db8a None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:41.069780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896c231-9148-4dfa-8626-b072c953db8a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:41.070250 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896c231-9148-4dfa-8626-b072c953db8a None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3/users/c63d03578b244677b4c31eac170fd370/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:41.072531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896c231-9148-4dfa-8626-b072c953db8a None admin] RBAC: Authorizing `identity:create_grant(project_id=0875194231ad4cbd89e6165cb46375c3, user_id=c63d03578b244677b4c31eac170fd370, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:41.074183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896c231-9148-4dfa-8626-b072c953db8a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:41.164904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac3fe-fa09-4e04-bec1-1c8880833d63 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:41.183391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 114/232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:19:40 2022] PUT /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3/users/c63d03578b244677b4c31eac170fd370/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:19:41.212963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230f3cd-d2d4-4d1b-9932-42c191ccdb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:41.213843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230f3cd-d2d4-4d1b-9932-42c191ccdb6d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:41.214126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230f3cd-d2d4-4d1b-9932-42c191ccdb6d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:41.214401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230f3cd-d2d4-4d1b-9932-42c191ccdb6d None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:41.215668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230f3cd-d2d4-4d1b-9932-42c191ccdb6d None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:41.217164 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230f3cd-d2d4-4d1b-9932-42c191ccdb6d None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:41.218847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 119/233] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:41 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:41.224742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896c231-9148-4dfa-8626-b072c953db8a None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:41.350482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896c231-9148-4dfa-8626-b072c953db8a None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:41.406032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224ab70-6af2-4ed6-85ae-332e2b9c7e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:41.406937 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224ab70-6af2-4ed6-85ae-332e2b9c7e97 None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:41.407215 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224ab70-6af2-4ed6-85ae-332e2b9c7e97 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:41.407489 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224ab70-6af2-4ed6-85ae-332e2b9c7e97 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3/users/c63d03578b244677b4c31eac170fd370/roles/21dc73c091ba46889022763efb51de4e` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:41.409904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224ab70-6af2-4ed6-85ae-332e2b9c7e97 None admin] RBAC: Authorizing `identity:create_grant(project_id=0875194231ad4cbd89e6165cb46375c3, user_id=c63d03578b244677b4c31eac170fd370, role_id=21dc73c091ba46889022763efb51de4e)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:41.411394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224ab70-6af2-4ed6-85ae-332e2b9c7e97 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:41.523598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 115/234] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:19:41 2022] PUT /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3/users/c63d03578b244677b4c31eac170fd370/roles/21dc73c091ba46889022763efb51de4e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:19:42.247512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ff60e-0d6e-44ca-9cab-8fc292d02ad2 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:42.248006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ff60e-0d6e-44ca-9cab-8fc292d02ad2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:42.248074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ff60e-0d6e-44ca-9cab-8fc292d02ad2 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:42.249918 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 120/235] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:42.255296 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0774037-f125-4e7a-a7dc-8208037b59ff None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:42.255719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0774037-f125-4e7a-a7dc-8208037b59ff None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:42.255879 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0774037-f125-4e7a-a7dc-8208037b59ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:42.273273 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b0774037-f125-4e7a-a7dc-8208037b59ff None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:42.274495 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b0774037-f125-4e7a-a7dc-8208037b59ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:42.350659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 116/236] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:42.376085 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ff60e-0d6e-44ca-9cab-8fc292d02ad2 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:42.500935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ff60e-0d6e-44ca-9cab-8fc292d02ad2 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:42.531717 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea3c19-b488-4751-83f8-65e9a26933d8 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:42.532000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea3c19-b488-4751-83f8-65e9a26933d8 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:42.532304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea3c19-b488-4751-83f8-65e9a26933d8 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:42.534186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 117/237] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:42.539766 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644e250-30e7-48f7-bc2a-2566ed3f5aa8 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:42.540181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644e250-30e7-48f7-bc2a-2566ed3f5aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:42.540582 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644e250-30e7-48f7-bc2a-2566ed3f5aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:42.542844 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43d12b-297a-4b97-81d8-d789c1087ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:42.543673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43d12b-297a-4b97-81d8-d789c1087ba8 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:42.543956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43d12b-297a-4b97-81d8-d789c1087ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:42.544305 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43d12b-297a-4b97-81d8-d789c1087ba8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:42.545564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43d12b-297a-4b97-81d8-d789c1087ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:42.547093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43d12b-297a-4b97-81d8-d789c1087ba8 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:42.548958 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 121/238] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:42.554933 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43d12b-297a-4b97-81d8-d789c1087ba8 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:42.573114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-0644e250-30e7-48f7-bc2a-2566ed3f5aa8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:42.574309 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0644e250-30e7-48f7-bc2a-2566ed3f5aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:42.670949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 118/239] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:42.693755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644e250-30e7-48f7-bc2a-2566ed3f5aa8 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:42.727051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43d12b-297a-4b97-81d8-d789c1087ba8 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:42.785766 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0d6c7-d7c6-4685-a5ac-22430e73647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:42.786352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d6c7-d7c6-4685-a5ac-22430e73647f None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:42.786633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d6c7-d7c6-4685-a5ac-22430e73647f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:42.786904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d6c7-d7c6-4685-a5ac-22430e73647f None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:42.787610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0d6c7-d7c6-4685-a5ac-22430e73647f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:42.789587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0d6c7-d7c6-4685-a5ac-22430e73647f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:42.834803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644e250-30e7-48f7-bc2a-2566ed3f5aa8 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:42.872889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a178915-8191-470e-b03d-36dcde0b9a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:42.874018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a178915-8191-470e-b03d-36dcde0b9a25 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:42.874456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a178915-8191-470e-b03d-36dcde0b9a25 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:42.874885 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a178915-8191-470e-b03d-36dcde0b9a25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:42.886147 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a178915-8191-470e-b03d-36dcde0b9a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:42.893301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-5a178915-8191-470e-b03d-36dcde0b9a25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 15:19:42.894830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 119/240] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:42.901235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a178915-8191-470e-b03d-36dcde0b9a25 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:42.907216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 122/241] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:19:42 2022] POST /identity/v3/users => generated 293 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:19:43.009027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a178915-8191-470e-b03d-36dcde0b9a25 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:43.044700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716e19d-6071-4d85-b55f-ced345e8c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:43.045737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e19d-6071-4d85-b55f-ced345e8c6bf None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:43.046214 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e19d-6071-4d85-b55f-ced345e8c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:43.046684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716e19d-6071-4d85-b55f-ced345e8c6bf None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:43.047680 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716e19d-6071-4d85-b55f-ced345e8c6bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:43.048224 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716e19d-6071-4d85-b55f-ced345e8c6bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:43.049982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716e19d-6071-4d85-b55f-ced345e8c6bf None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:43.059786 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 120/242] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:43.065916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0d6c7-d7c6-4685-a5ac-22430e73647f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:43.215072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0d6c7-d7c6-4685-a5ac-22430e73647f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:43.253953 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f894a-4a50-4e64-933f-4a867688dcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:43.254847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f894a-4a50-4e64-933f-4a867688dcab None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:43.255123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f894a-4a50-4e64-933f-4a867688dcab None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:43.255399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f894a-4a50-4e64-933f-4a867688dcab None admin] PATH_INFO: `/v3/users/39094344e3d04d78b421786ec9d755c2` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:43.269940 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f894a-4a50-4e64-933f-4a867688dcab None admin] RBAC: Authorizing `identity:get_user(user_id=39094344e3d04d78b421786ec9d755c2)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:43.271425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f894a-4a50-4e64-933f-4a867688dcab None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:43.274039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 123/243] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:43 2022] GET /identity/v3/users/39094344e3d04d78b421786ec9d755c2 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:43.279160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716e19d-6071-4d85-b55f-ced345e8c6bf None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:43.399434 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716e19d-6071-4d85-b55f-ced345e8c6bf None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:43.448418 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285326-9afb-421b-8e3f-6a0b0e68a931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:43.449089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285326-9afb-421b-8e3f-6a0b0e68a931 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:43.449372 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285326-9afb-421b-8e3f-6a0b0e68a931 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:43.449645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285326-9afb-421b-8e3f-6a0b0e68a931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:43.528328 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b285326-9afb-421b-8e3f-6a0b0e68a931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:43.529823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b285326-9afb-421b-8e3f-6a0b0e68a931 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:43.622216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd700c0b-2fc4-4236-8fe1-9ad63fcdf9d2 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:43.622573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd700c0b-2fc4-4236-8fe1-9ad63fcdf9d2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:43.622869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd700c0b-2fc4-4236-8fe1-9ad63fcdf9d2 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:43.624679 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 124/244] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:43.629966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8d26-6b5f-4342-9d00-e3dfead64066 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:43.630260 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8d26-6b5f-4342-9d00-e3dfead64066 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:43.630532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a8d26-6b5f-4342-9d00-e3dfead64066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:43.631542 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 121/245] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:43.637250 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285326-9afb-421b-8e3f-6a0b0e68a931 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:43.656874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-515a8d26-6b5f-4342-9d00-e3dfead64066 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:43.658501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-515a8d26-6b5f-4342-9d00-e3dfead64066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:43.737801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 125/246] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:43.763324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285326-9afb-421b-8e3f-6a0b0e68a931 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:43.764372 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8d26-6b5f-4342-9d00-e3dfead64066 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:43.807138 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd5bd0-4770-4dd7-bbfb-91387ca2e128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:43.808195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd5bd0-4770-4dd7-bbfb-91387ca2e128 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:43.808490 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd5bd0-4770-4dd7-bbfb-91387ca2e128 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:43.808767 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd5bd0-4770-4dd7-bbfb-91387ca2e128 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:43.809975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd5bd0-4770-4dd7-bbfb-91387ca2e128 None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:43.811531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd5bd0-4770-4dd7-bbfb-91387ca2e128 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:43.814731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 122/247] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:43 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:43.820990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd5bd0-4770-4dd7-bbfb-91387ca2e128 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:43.934404 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a8d26-6b5f-4342-9d00-e3dfead64066 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:43.980090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd5bd0-4770-4dd7-bbfb-91387ca2e128 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:44.001806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115dc6-5b6d-4cb1-9290-efc3a79bb932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:44.002702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115dc6-5b6d-4cb1-9290-efc3a79bb932 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:44.002987 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115dc6-5b6d-4cb1-9290-efc3a79bb932 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:44.003259 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115dc6-5b6d-4cb1-9290-efc3a79bb932 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:44.015705 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272fefd-24df-4466-ab2e-4c4915a0c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:44.016396 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272fefd-24df-4466-ab2e-4c4915a0c9ce None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:44.016685 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272fefd-24df-4466-ab2e-4c4915a0c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:44.016967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272fefd-24df-4466-ab2e-4c4915a0c9ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:44.017854 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272fefd-24df-4466-ab2e-4c4915a0c9ce None admin] RBAC: Adding query filter params (role.id=2e236c62c0f041ab91e9fab86a52cd2d, scope.project.id=0875194231ad4cbd89e6165cb46375c3, user.id=39094344e3d04d78b421786ec9d755c2) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:44.018175 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272fefd-24df-4466-ab2e-4c4915a0c9ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:44.019938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272fefd-24df-4466-ab2e-4c4915a0c9ce None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:44.027030 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 123/248] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:43 2022] GET /identity/v3/role_assignments?user.id=39094344e3d04d78b421786ec9d755c2&scope.project.id=0875194231ad4cbd89e6165cb46375c3&role.id=2e236c62c0f041ab91e9fab86a52cd2d => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:44.028445 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf4181-fcd4-4e2a-b03e-9d55952aadea None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:44.028743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf4181-fcd4-4e2a-b03e-9d55952aadea None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:44.029020 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf4181-fcd4-4e2a-b03e-9d55952aadea None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:44.031047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 124/249] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:44.038229 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a115dc6-5b6d-4cb1-9290-efc3a79bb932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:44.038791 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a730-47f8-4f9e-993f-d23370706ce8 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:44.039084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a730-47f8-4f9e-993f-d23370706ce8 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:44.039367 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a730-47f8-4f9e-993f-d23370706ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:44.045172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-5a115dc6-5b6d-4cb1-9290-efc3a79bb932 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:44.046571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 126/250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:44.057531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115dc6-5b6d-4cb1-9290-efc3a79bb932 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:44.059297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-abb1a730-47f8-4f9e-993f-d23370706ce8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:44.060804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-abb1a730-47f8-4f9e-993f-d23370706ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:44.139573 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 125/251] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:44.167485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1a730-47f8-4f9e-993f-d23370706ce8 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:44.291997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1a730-47f8-4f9e-993f-d23370706ce8 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:44.307396 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115dc6-5b6d-4cb1-9290-efc3a79bb932 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:44.344898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc518daa-408a-496b-80c5-9f1f01820946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:44.346033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc518daa-408a-496b-80c5-9f1f01820946 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:44.346529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc518daa-408a-496b-80c5-9f1f01820946 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:44.346995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc518daa-408a-496b-80c5-9f1f01820946 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:44.354853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53e0e6-555f-4a11-9787-6613e2571fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:44.355844 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53e0e6-555f-4a11-9787-6613e2571fd0 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:44.356361 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53e0e6-555f-4a11-9787-6613e2571fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:44.356966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53e0e6-555f-4a11-9787-6613e2571fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:44.362445 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53e0e6-555f-4a11-9787-6613e2571fd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:44.363723 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53e0e6-555f-4a11-9787-6613e2571fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:44.367623 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53e0e6-555f-4a11-9787-6613e2571fd0 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:44.376134 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc518daa-408a-496b-80c5-9f1f01820946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:44.384345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-fc518daa-408a-496b-80c5-9f1f01820946 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:19:44.386737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 126/252] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:19:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:44.393814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 127/253] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:44.394894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc518daa-408a-496b-80c5-9f1f01820946 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:44.411838 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53e0e6-555f-4a11-9787-6613e2571fd0 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:44.538040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53e0e6-555f-4a11-9787-6613e2571fd0 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:44.582002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc518daa-408a-496b-80c5-9f1f01820946 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:44.589748 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dac728-9255-4b57-8b55-a16bb81dcb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:44.590635 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dac728-9255-4b57-8b55-a16bb81dcb17 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:44.590923 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dac728-9255-4b57-8b55-a16bb81dcb17 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:44.591202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dac728-9255-4b57-8b55-a16bb81dcb17 None admin] PATH_INFO: `/v3/users/d08bd84da3f345d79fdae2603b80acfa` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:44.596322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dac728-9255-4b57-8b55-a16bb81dcb17 None admin] RBAC: Authorizing `identity:get_user(user_id=d08bd84da3f345d79fdae2603b80acfa)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:44.598057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dac728-9255-4b57-8b55-a16bb81dcb17 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:44.600190 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 128/254] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:44 2022] GET /identity/v3/users/d08bd84da3f345d79fdae2603b80acfa => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:44.605720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dac728-9255-4b57-8b55-a16bb81dcb17 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:44.708229 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eb22a-4f68-4a23-aca0-07cba3c57a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:44.709929 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eb22a-4f68-4a23-aca0-07cba3c57a79 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:44.710561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eb22a-4f68-4a23-aca0-07cba3c57a79 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:44.712064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eb22a-4f68-4a23-aca0-07cba3c57a79 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:44.713053 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031eb22a-4f68-4a23-aca0-07cba3c57a79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:44.714207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031eb22a-4f68-4a23-aca0-07cba3c57a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:44.717688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031eb22a-4f68-4a23-aca0-07cba3c57a79 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:44.735169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 127/255] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:44.743352 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eb22a-4f68-4a23-aca0-07cba3c57a79 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:44.805386 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dac728-9255-4b57-8b55-a16bb81dcb17 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:44.843274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d458ca3-e641-405b-82ac-c59ff39acdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:44.844045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d458ca3-e641-405b-82ac-c59ff39acdae None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:44.844353 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d458ca3-e641-405b-82ac-c59ff39acdae None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:44.844629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d458ca3-e641-405b-82ac-c59ff39acdae None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:44.846522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d458ca3-e641-405b-82ac-c59ff39acdae None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:44.847992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d458ca3-e641-405b-82ac-c59ff39acdae None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:44.849996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 129/256] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:44 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:44.851954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46618436-d10d-415a-85af-6a020089cd1b None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:44.852467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46618436-d10d-415a-85af-6a020089cd1b None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:44.852946 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46618436-d10d-415a-85af-6a020089cd1b None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:44.854767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 130/257] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:44.865095 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46618436-d10d-415a-85af-6a020089cd1b None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:44.905868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eb22a-4f68-4a23-aca0-07cba3c57a79 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:44.940834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32707306-3984-4314-b89a-5f806e8dc779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:44.941701 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32707306-3984-4314-b89a-5f806e8dc779 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:44.941981 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32707306-3984-4314-b89a-5f806e8dc779 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:44.942252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32707306-3984-4314-b89a-5f806e8dc779 None admin] PATH_INFO: `/v3/users/c63d03578b244677b4c31eac170fd370` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:44.943428 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32707306-3984-4314-b89a-5f806e8dc779 None admin] RBAC: Authorizing `identity:get_user(user_id=c63d03578b244677b4c31eac170fd370)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:44.944953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32707306-3984-4314-b89a-5f806e8dc779 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:44.946991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 128/258] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:44 2022] GET /identity/v3/users/c63d03578b244677b4c31eac170fd370 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:44.948230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffa978-164c-4771-ab9b-095ea4988256 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:44.948518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffa978-164c-4771-ab9b-095ea4988256 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:44.948796 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffa978-164c-4771-ab9b-095ea4988256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:44.969837 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-20ffa978-164c-4771-ab9b-095ea4988256 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:44.970996 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-20ffa978-164c-4771-ab9b-095ea4988256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:45.070299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 129/259] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:45.070979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffa978-164c-4771-ab9b-095ea4988256 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:45.084474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46618436-d10d-415a-85af-6a020089cd1b None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:45.176858 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b00f5-4aee-44fb-b7bf-407dcf7582b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:45.177759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b00f5-4aee-44fb-b7bf-407dcf7582b5 None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:45.178044 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b00f5-4aee-44fb-b7bf-407dcf7582b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:45.178321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b00f5-4aee-44fb-b7bf-407dcf7582b5 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3/users/d08bd84da3f345d79fdae2603b80acfa/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:45.180425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b00f5-4aee-44fb-b7bf-407dcf7582b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0875194231ad4cbd89e6165cb46375c3, user_id=d08bd84da3f345d79fdae2603b80acfa, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:45.181991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b00f5-4aee-44fb-b7bf-407dcf7582b5 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:45.190037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffa978-164c-4771-ab9b-095ea4988256 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:45.227526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963723f3-4805-42a8-8fdd-1869dd233632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:45.228203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963723f3-4805-42a8-8fdd-1869dd233632 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:45.228540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963723f3-4805-42a8-8fdd-1869dd233632 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:45.228817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963723f3-4805-42a8-8fdd-1869dd233632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:45.297889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963723f3-4805-42a8-8fdd-1869dd233632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:45.299463 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963723f3-4805-42a8-8fdd-1869dd233632 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:45.302036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 131/260] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:19:44 2022] PUT /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3/users/d08bd84da3f345d79fdae2603b80acfa/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:19:45.302883 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b00f5-4aee-44fb-b7bf-407dcf7582b5 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:45.496810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b00f5-4aee-44fb-b7bf-407dcf7582b5 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:45.511487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 130/261] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:45.512522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963723f3-4805-42a8-8fdd-1869dd233632 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:45.564543 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94c42-bcea-4867-8976-d3ac2b184bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:45.565354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94c42-bcea-4867-8976-d3ac2b184bb3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:45.565632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94c42-bcea-4867-8976-d3ac2b184bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:45.565936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94c42-bcea-4867-8976-d3ac2b184bb3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:45.590641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c94c42-bcea-4867-8976-d3ac2b184bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:45.603172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-e9c94c42-bcea-4867-8976-d3ac2b184bb3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:19:45.608677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 132/262] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:19:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:45.614563 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94c42-bcea-4867-8976-d3ac2b184bb3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:45.644623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963723f3-4805-42a8-8fdd-1869dd233632 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:45.682677 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eb3d3-8cb8-4576-b708-f592191b439a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:45.683535 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eb3d3-8cb8-4576-b708-f592191b439a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:45.683816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eb3d3-8cb8-4576-b708-f592191b439a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:45.684090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eb3d3-8cb8-4576-b708-f592191b439a None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:45.685567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344eb3d3-8cb8-4576-b708-f592191b439a None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:45.687028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344eb3d3-8cb8-4576-b708-f592191b439a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:45.689436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 131/263] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:45 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:45.695947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eb3d3-8cb8-4576-b708-f592191b439a None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:45.783871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94c42-bcea-4867-8976-d3ac2b184bb3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:45.818815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d5635-06d7-45d0-8c04-b84f6bc3d58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:45.820228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d5635-06d7-45d0-8c04-b84f6bc3d58c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:45.820515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d5635-06d7-45d0-8c04-b84f6bc3d58c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:45.820788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d5635-06d7-45d0-8c04-b84f6bc3d58c None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:45.822061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d5635-06d7-45d0-8c04-b84f6bc3d58c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:45.822373 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d5635-06d7-45d0-8c04-b84f6bc3d58c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:45.824197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d5635-06d7-45d0-8c04-b84f6bc3d58c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:45.833226 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 133/264] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:19:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:45.840262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d5635-06d7-45d0-8c04-b84f6bc3d58c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:45.883002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eb3d3-8cb8-4576-b708-f592191b439a None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:45.946737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e290c-3c74-414a-9327-066ac34f23e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:45.948301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e290c-3c74-414a-9327-066ac34f23e9 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:45.948641 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e290c-3c74-414a-9327-066ac34f23e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:45.948922 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e290c-3c74-414a-9327-066ac34f23e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:45.949780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e290c-3c74-414a-9327-066ac34f23e9 None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=0875194231ad4cbd89e6165cb46375c3, user.id=c63d03578b244677b4c31eac170fd370) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:45.950092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e290c-3c74-414a-9327-066ac34f23e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:45.951584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e290c-3c74-414a-9327-066ac34f23e9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:45.972339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 132/265] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:45 2022] GET /identity/v3/role_assignments?user.id=c63d03578b244677b4c31eac170fd370&scope.project.id=0875194231ad4cbd89e6165cb46375c3&role.id=24a7898c863141f1911792647b5274e3 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:46.016331 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d5635-06d7-45d0-8c04-b84f6bc3d58c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:46.061980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9c810-6164-457d-98cc-367356ebabae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:46.062798 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9c810-6164-457d-98cc-367356ebabae None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:46.063081 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9c810-6164-457d-98cc-367356ebabae None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:46.063359 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9c810-6164-457d-98cc-367356ebabae None admin] PATH_INFO: `/v3/users/c63d03578b244677b4c31eac170fd370` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:46.068028 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9c810-6164-457d-98cc-367356ebabae None admin] RBAC: Authorizing `identity:get_user(user_id=c63d03578b244677b4c31eac170fd370)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:46.070418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9c810-6164-457d-98cc-367356ebabae None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:46.072434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 134/266] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:45 2022] GET /identity/v3/users/c63d03578b244677b4c31eac170fd370 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:46.078391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e290c-3c74-414a-9327-066ac34f23e9 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:46.205109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e290c-3c74-414a-9327-066ac34f23e9 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:46.244467 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20761301-159d-46d0-bfb3-c752daa68eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:46.245117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20761301-159d-46d0-bfb3-c752daa68eef None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:46.245446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20761301-159d-46d0-bfb3-c752daa68eef None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:46.245722 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20761301-159d-46d0-bfb3-c752daa68eef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:46.314598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20761301-159d-46d0-bfb3-c752daa68eef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:46.316069 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20761301-159d-46d0-bfb3-c752daa68eef None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:46.422192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 133/267] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:46.427733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9c810-6164-457d-98cc-367356ebabae None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:46.539176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9c810-6164-457d-98cc-367356ebabae None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:46.584273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5c06d-fd14-443a-afd6-93388c2c93a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:46.584273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5c06d-fd14-443a-afd6-93388c2c93a9 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:46.584273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5c06d-fd14-443a-afd6-93388c2c93a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:46.584694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1a0dd-7f9a-4ed5-8eac-453a8e29f626 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:46.584774 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5c06d-fd14-443a-afd6-93388c2c93a9 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:46.584841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1a0dd-7f9a-4ed5-8eac-453a8e29f626 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:46.584841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1a0dd-7f9a-4ed5-8eac-453a8e29f626 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:46.586017 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 134/268] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:46.588918 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5c06d-fd14-443a-afd6-93388c2c93a9 None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:46.590376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5c06d-fd14-443a-afd6-93388c2c93a9 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:46.592078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa6a2a-8fd9-4f75-a778-a8ade7d7e2a9 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:46.592436 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 135/269] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:46 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:46.593003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa6a2a-8fd9-4f75-a778-a8ade7d7e2a9 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:46.593478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa6a2a-8fd9-4f75-a778-a8ade7d7e2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:46.598314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5c06d-fd14-443a-afd6-93388c2c93a9 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:46.613506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-e1fa6a2a-8fd9-4f75-a778-a8ade7d7e2a9 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:46.615092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-e1fa6a2a-8fd9-4f75-a778-a8ade7d7e2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:46.753353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 135/270] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:19:46.764764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5c06d-fd14-443a-afd6-93388c2c93a9 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:46.797118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa6a2a-8fd9-4f75-a778-a8ade7d7e2a9 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:46.812528 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fc0f3-3a27-4279-a650-382adba1a320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:46.813200 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fc0f3-3a27-4279-a650-382adba1a320 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:46.813481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fc0f3-3a27-4279-a650-382adba1a320 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:46.813758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fc0f3-3a27-4279-a650-382adba1a320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:46.815157 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fc0f3-3a27-4279-a650-382adba1a320 None admin] RBAC: Adding query filter params (role.id=21dc73c091ba46889022763efb51de4e, scope.project.id=0875194231ad4cbd89e6165cb46375c3, user.id=c63d03578b244677b4c31eac170fd370) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:46.815479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fc0f3-3a27-4279-a650-382adba1a320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:46.817409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fc0f3-3a27-4279-a650-382adba1a320 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:46.825501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 136/271] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:46 2022] GET /identity/v3/role_assignments?user.id=c63d03578b244677b4c31eac170fd370&scope.project.id=0875194231ad4cbd89e6165cb46375c3&role.id=21dc73c091ba46889022763efb51de4e => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:46.826799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a96170-ce38-490c-94ee-8660efd007bc None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:46.827084 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a96170-ce38-490c-94ee-8660efd007bc None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:46.827360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a96170-ce38-490c-94ee-8660efd007bc None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:46.829264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 137/272] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:46.835576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088f9c3-a477-47b2-8e0f-25c22773bf7a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:46.835830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088f9c3-a477-47b2-8e0f-25c22773bf7a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:46.836064 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088f9c3-a477-47b2-8e0f-25c22773bf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:46.857362 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-9088f9c3-a477-47b2-8e0f-25c22773bf7a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:46.858571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9088f9c3-a477-47b2-8e0f-25c22773bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:46.930132 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa6a2a-8fd9-4f75-a778-a8ade7d7e2a9 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:46.971660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55079dd1-dd5a-4217-be72-92863d7e0dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:46.972499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55079dd1-dd5a-4217-be72-92863d7e0dd2 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:46.972782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55079dd1-dd5a-4217-be72-92863d7e0dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:46.973055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55079dd1-dd5a-4217-be72-92863d7e0dd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:46.987726 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55079dd1-dd5a-4217-be72-92863d7e0dd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:46.998164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-55079dd1-dd5a-4217-be72-92863d7e0dd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:46.999775 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 136/273] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:47.007347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55079dd1-dd5a-4217-be72-92863d7e0dd2 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:47.034527 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 138/274] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:47.076102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088f9c3-a477-47b2-8e0f-25c22773bf7a None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:47.129528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55079dd1-dd5a-4217-be72-92863d7e0dd2 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:47.172371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357f170-bf46-48bf-b8e5-0ba887a60093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:47.173035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357f170-bf46-48bf-b8e5-0ba887a60093 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:47.173308 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357f170-bf46-48bf-b8e5-0ba887a60093 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:47.173585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357f170-bf46-48bf-b8e5-0ba887a60093 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:47.174324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357f170-bf46-48bf-b8e5-0ba887a60093 None admin] RBAC: Adding query filter params (name=member) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:47.174630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357f170-bf46-48bf-b8e5-0ba887a60093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:47.176021 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357f170-bf46-48bf-b8e5-0ba887a60093 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:47.184014 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 137/275] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:47.185401 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aa22e-34ad-4c37-81d5-9b468d1fc096 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:47.185687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aa22e-34ad-4c37-81d5-9b468d1fc096 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:47.185963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8aa22e-34ad-4c37-81d5-9b468d1fc096 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:47.188178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 138/276] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:47.189439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aa22e-34ad-4c37-81d5-9b468d1fc096 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:47.215377 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088f9c3-a477-47b2-8e0f-25c22773bf7a None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:47.250078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4a045-9b77-4157-b970-eb80a36ae027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:47.250917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a045-9b77-4157-b970-eb80a36ae027 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:47.251126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a045-9b77-4157-b970-eb80a36ae027 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:47.251410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a045-9b77-4157-b970-eb80a36ae027 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:47.252593 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4a045-9b77-4157-b970-eb80a36ae027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:47.254040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4a045-9b77-4157-b970-eb80a36ae027 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:47.260663 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 139/277] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:47.261841 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff721b8-f17c-4945-b493-fa73b8a89334 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:47.262127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff721b8-f17c-4945-b493-fa73b8a89334 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:47.262404 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff721b8-f17c-4945-b493-fa73b8a89334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:47.279202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-0ff721b8-f17c-4945-b493-fa73b8a89334 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:47.280428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0ff721b8-f17c-4945-b493-fa73b8a89334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:47.289799 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8aa22e-34ad-4c37-81d5-9b468d1fc096 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:47.322762 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c728-4649-4103-bdf0-fc783d4c03c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:47.323627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c728-4649-4103-bdf0-fc783d4c03c3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:47.323909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c728-4649-4103-bdf0-fc783d4c03c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:47.324209 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c728-4649-4103-bdf0-fc783d4c03c3 None admin] PATH_INFO: `/v3/users/22db557f27db42de955d306f82ae8428` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:47.337553 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32c728-4649-4103-bdf0-fc783d4c03c3 None admin] RBAC: Authorizing `identity:get_user(user_id=22db557f27db42de955d306f82ae8428)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:47.339011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32c728-4649-4103-bdf0-fc783d4c03c3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:47.340895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 139/278] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:47 2022] GET /identity/v3/users/22db557f27db42de955d306f82ae8428 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:47.344721 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 140/279] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:47.346061 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c728-4649-4103-bdf0-fc783d4c03c3 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:47.353091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff721b8-f17c-4945-b493-fa73b8a89334 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:47.445566 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c728-4649-4103-bdf0-fc783d4c03c3 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:47.447541 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff721b8-f17c-4945-b493-fa73b8a89334 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:47.476859 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaca37-5639-457f-a2b0-1a405ee416c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:47.477516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaca37-5639-457f-a2b0-1a405ee416c5 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:47.477801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaca37-5639-457f-a2b0-1a405ee416c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:47.478080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaca37-5639-457f-a2b0-1a405ee416c5 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:47.478777 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceaca37-5639-457f-a2b0-1a405ee416c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:47.479632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdf776-3638-485f-9f61-0009d4fb668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:47.480240 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceaca37-5639-457f-a2b0-1a405ee416c5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:47.480335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdf776-3638-485f-9f61-0009d4fb668d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:47.480599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdf776-3638-485f-9f61-0009d4fb668d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:47.480873 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdf776-3638-485f-9f61-0009d4fb668d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:47.481685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdf776-3638-485f-9f61-0009d4fb668d None admin] RBAC: Adding query filter params (role.id=ab135a02f63c4a138c6b116ad4f9c8d0, user.id=22db557f27db42de955d306f82ae8428, scope.system=all) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:47.481997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdf776-3638-485f-9f61-0009d4fb668d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:47.483407 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdf776-3638-485f-9f61-0009d4fb668d None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:47.496298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 141/280] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Mar 8 15:19:47 2022] GET /identity/v3/role_assignments?user.id=22db557f27db42de955d306f82ae8428&scope.system=all&role.id=ab135a02f63c4a138c6b116ad4f9c8d0 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:47.496298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdf776-3638-485f-9f61-0009d4fb668d None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:47.571733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 140/281] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:19:47 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:19:47.609805 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdf776-3638-485f-9f61-0009d4fb668d None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:47.651320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a9605-5193-4b23-8e78-581cde6b1347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:47.652138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a9605-5193-4b23-8e78-581cde6b1347 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:47.652446 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a9605-5193-4b23-8e78-581cde6b1347 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:47.652794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a9605-5193-4b23-8e78-581cde6b1347 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:47.665697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a9605-5193-4b23-8e78-581cde6b1347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:47.672858 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-027a9605-5193-4b23-8e78-581cde6b1347 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 15:19:47.674143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 142/282] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:47.681088 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaca37-5639-457f-a2b0-1a405ee416c5 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:47.794739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaca37-5639-457f-a2b0-1a405ee416c5 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:47.837278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f557c3-601f-4fcc-a6ab-b5b6d731f0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:47.837761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f557c3-601f-4fcc-a6ab-b5b6d731f0f0 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:47.838048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f557c3-601f-4fcc-a6ab-b5b6d731f0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:47.838327 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f557c3-601f-4fcc-a6ab-b5b6d731f0f0 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:47.839083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f557c3-601f-4fcc-a6ab-b5b6d731f0f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:47.839392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f557c3-601f-4fcc-a6ab-b5b6d731f0f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:47.840858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f557c3-601f-4fcc-a6ab-b5b6d731f0f0 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:47.852801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 141/283] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:47.857542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a9605-5193-4b23-8e78-581cde6b1347 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:47.981356 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a9605-5193-4b23-8e78-581cde6b1347 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:48.021745 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c548a-c0b5-406c-b4a6-9fd01d7259ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:48.022682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c548a-c0b5-406c-b4a6-9fd01d7259ac None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:48.022962 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c548a-c0b5-406c-b4a6-9fd01d7259ac None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:48.023236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c548a-c0b5-406c-b4a6-9fd01d7259ac None admin] PATH_INFO: `/v3/users/39094344e3d04d78b421786ec9d755c2` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:48.024460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c548a-c0b5-406c-b4a6-9fd01d7259ac None admin] RBAC: Authorizing `identity:get_user(user_id=39094344e3d04d78b421786ec9d755c2)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:48.025917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c548a-c0b5-406c-b4a6-9fd01d7259ac None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:48.027874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 143/284] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:47 2022] GET /identity/v3/users/39094344e3d04d78b421786ec9d755c2 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:48.033882 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f557c3-601f-4fcc-a6ab-b5b6d731f0f0 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:48.152107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f557c3-601f-4fcc-a6ab-b5b6d731f0f0 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:48.187580 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64fbc0-0124-467e-96e6-f564adc76cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:48.188854 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64fbc0-0124-467e-96e6-f564adc76cc7 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:48.189362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64fbc0-0124-467e-96e6-f564adc76cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:48.189828 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64fbc0-0124-467e-96e6-f564adc76cc7 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:48.191249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64fbc0-0124-467e-96e6-f564adc76cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:48.193003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64fbc0-0124-467e-96e6-f564adc76cc7 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:48.195000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 142/285] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:48 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:48.200733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c548a-c0b5-406c-b4a6-9fd01d7259ac None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:48.326483 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c548a-c0b5-406c-b4a6-9fd01d7259ac None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:48.366477 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57384d62-adaf-45da-bebe-9d11e02411be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:48.367753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57384d62-adaf-45da-bebe-9d11e02411be None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:48.368257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57384d62-adaf-45da-bebe-9d11e02411be None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:48.368743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57384d62-adaf-45da-bebe-9d11e02411be None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3/users/39094344e3d04d78b421786ec9d755c2/roles/2e236c62c0f041ab91e9fab86a52cd2d` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:48.376755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57384d62-adaf-45da-bebe-9d11e02411be None admin] RBAC: Authorizing `identity:create_grant(project_id=0875194231ad4cbd89e6165cb46375c3, user_id=39094344e3d04d78b421786ec9d755c2, role_id=2e236c62c0f041ab91e9fab86a52cd2d)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:48.379026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57384d62-adaf-45da-bebe-9d11e02411be None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:48.466002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 144/286] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:19:48 2022] PUT /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3/users/39094344e3d04d78b421786ec9d755c2/roles/2e236c62c0f041ab91e9fab86a52cd2d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:19:48.540277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0524-2f07-470e-a890-9f0586095270 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:48.540775 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0524-2f07-470e-a890-9f0586095270 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:48.540846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0524-2f07-470e-a890-9f0586095270 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:48.542841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 143/287] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:48.548431 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5a081-624a-41be-839c-ce8999f4cd28 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:48.549008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5a081-624a-41be-839c-ce8999f4cd28 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:48.549545 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5a081-624a-41be-839c-ce8999f4cd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:48.577410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-9ef5a081-624a-41be-839c-ce8999f4cd28 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:48.578979 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9ef5a081-624a-41be-839c-ce8999f4cd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:48.666994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 145/288] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:48.702965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d0524-2f07-470e-a890-9f0586095270 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:48.820874 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d0524-2f07-470e-a890-9f0586095270 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:48.863516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c785-80fd-4949-942e-59e3d64c70c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:48.864706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c785-80fd-4949-942e-59e3d64c70c4 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:48.865185 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c785-80fd-4949-942e-59e3d64c70c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:48.866425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c785-80fd-4949-942e-59e3d64c70c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:48.882161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701c785-80fd-4949-942e-59e3d64c70c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:48.889327 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-1701c785-80fd-4949-942e-59e3d64c70c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:48.890910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 144/289] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:48.896779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5a081-624a-41be-839c-ce8999f4cd28 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:48.997136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5a081-624a-41be-839c-ce8999f4cd28 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:49.035222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168a80e-761e-43b9-8ed3-5edcf337f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:49.036262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168a80e-761e-43b9-8ed3-5edcf337f14c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:49.036762 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168a80e-761e-43b9-8ed3-5edcf337f14c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:49.037230 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168a80e-761e-43b9-8ed3-5edcf337f14c None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:49.038785 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168a80e-761e-43b9-8ed3-5edcf337f14c None admin] RBAC: Adding query filter params (name=member) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:49.039285 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168a80e-761e-43b9-8ed3-5edcf337f14c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:49.040882 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168a80e-761e-43b9-8ed3-5edcf337f14c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:49.049815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 146/290] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:49.054925 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c785-80fd-4949-942e-59e3d64c70c4 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:49.158840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c785-80fd-4949-942e-59e3d64c70c4 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:49.198357 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b226872-1420-4f74-8fdc-1053535fc752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:49.199485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226872-1420-4f74-8fdc-1053535fc752 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:49.199921 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226872-1420-4f74-8fdc-1053535fc752 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:49.200361 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226872-1420-4f74-8fdc-1053535fc752 None admin] PATH_INFO: `/v3/users/d08bd84da3f345d79fdae2603b80acfa` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:49.201709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b226872-1420-4f74-8fdc-1053535fc752 None admin] RBAC: Authorizing `identity:get_user(user_id=d08bd84da3f345d79fdae2603b80acfa)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:49.203299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b226872-1420-4f74-8fdc-1053535fc752 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:49.205392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 145/291] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:49 2022] GET /identity/v3/users/d08bd84da3f345d79fdae2603b80acfa => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:49.210985 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168a80e-761e-43b9-8ed3-5edcf337f14c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:49.345072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168a80e-761e-43b9-8ed3-5edcf337f14c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:49.390271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669b73b-3baf-4e0b-a055-f19eb2469ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:49.390978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669b73b-3baf-4e0b-a055-f19eb2469ff9 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:49.391211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669b73b-3baf-4e0b-a055-f19eb2469ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:49.391494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669b73b-3baf-4e0b-a055-f19eb2469ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:49.479423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669b73b-3baf-4e0b-a055-f19eb2469ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:49.480918 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669b73b-3baf-4e0b-a055-f19eb2469ff9 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:49.632583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 147/292] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:49.637043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b226872-1420-4f74-8fdc-1053535fc752 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:49.767181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b226872-1420-4f74-8fdc-1053535fc752 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:49.812258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f72fb-adfc-48a2-9516-9aee815c7c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:49.813566 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f72fb-adfc-48a2-9516-9aee815c7c1d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:49.814058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f72fb-adfc-48a2-9516-9aee815c7c1d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:49.814740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f72fb-adfc-48a2-9516-9aee815c7c1d None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:49.821177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f72fb-adfc-48a2-9516-9aee815c7c1d None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:49.823103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f72fb-adfc-48a2-9516-9aee815c7c1d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:49.825586 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 146/293] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:49 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:49.831257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669b73b-3baf-4e0b-a055-f19eb2469ff9 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:50.003679 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669b73b-3baf-4e0b-a055-f19eb2469ff9 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:50.059094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd2353-59c3-4226-9552-aad8774982fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:50.059673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd2353-59c3-4226-9552-aad8774982fc None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:50.059952 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd2353-59c3-4226-9552-aad8774982fc None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:50.060254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd2353-59c3-4226-9552-aad8774982fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:50.061081 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd2353-59c3-4226-9552-aad8774982fc None admin] RBAC: Adding query filter params (role.id=ab135a02f63c4a138c6b116ad4f9c8d0, scope.project.id=0875194231ad4cbd89e6165cb46375c3, user.id=d08bd84da3f345d79fdae2603b80acfa) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:50.061388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd2353-59c3-4226-9552-aad8774982fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:50.062822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd2353-59c3-4226-9552-aad8774982fc None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:50.073871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 148/294] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:49 2022] GET /identity/v3/role_assignments?user.id=d08bd84da3f345d79fdae2603b80acfa&scope.project.id=0875194231ad4cbd89e6165cb46375c3&role.id=ab135a02f63c4a138c6b116ad4f9c8d0 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:50.341373 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad146e8-c542-4d36-ab04-2c5d7cfe9a22 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:50.342152 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad146e8-c542-4d36-ab04-2c5d7cfe9a22 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:50.342671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad146e8-c542-4d36-ab04-2c5d7cfe9a22 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:50.344777 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 147/295] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:50.350749 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681e0e8-56e0-4eb9-b7e7-aa1ec05830c8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:50.351041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681e0e8-56e0-4eb9-b7e7-aa1ec05830c8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:50.351316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681e0e8-56e0-4eb9-b7e7-aa1ec05830c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:50.369723 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-d681e0e8-56e0-4eb9-b7e7-aa1ec05830c8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:50.371208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d681e0e8-56e0-4eb9-b7e7-aa1ec05830c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:50.449180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 149/296] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:50.473482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad146e8-c542-4d36-ab04-2c5d7cfe9a22 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:50.585572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad146e8-c542-4d36-ab04-2c5d7cfe9a22 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:50.621559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d9886-8fce-4c91-8abd-3dc0c815312e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:50.622742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d9886-8fce-4c91-8abd-3dc0c815312e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:50.623244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d9886-8fce-4c91-8abd-3dc0c815312e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:50.623744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d9886-8fce-4c91-8abd-3dc0c815312e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:50.637306 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d9886-8fce-4c91-8abd-3dc0c815312e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:50.645439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-623d9886-8fce-4c91-8abd-3dc0c815312e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:50.647606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 148/297] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:50.653880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681e0e8-56e0-4eb9-b7e7-aa1ec05830c8 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:50.769412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681e0e8-56e0-4eb9-b7e7-aa1ec05830c8 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:50.804957 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8754552-7dcb-4fc2-9317-5e88a7cdc235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:50.805712 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8754552-7dcb-4fc2-9317-5e88a7cdc235 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:50.806152 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8754552-7dcb-4fc2-9317-5e88a7cdc235 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:50.806260 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8754552-7dcb-4fc2-9317-5e88a7cdc235 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:50.806993 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8754552-7dcb-4fc2-9317-5e88a7cdc235 None admin] RBAC: Adding query filter params (name=member) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:50.807306 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8754552-7dcb-4fc2-9317-5e88a7cdc235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:50.808708 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8754552-7dcb-4fc2-9317-5e88a7cdc235 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:50.816983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 150/298] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:50.823162 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d9886-8fce-4c91-8abd-3dc0c815312e None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:50.924472 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d9886-8fce-4c91-8abd-3dc0c815312e None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:50.958746 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940405a-0ffc-4dde-87fd-fdb960fd13ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:50.960574 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940405a-0ffc-4dde-87fd-fdb960fd13ee None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:50.961061 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940405a-0ffc-4dde-87fd-fdb960fd13ee None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:50.961530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940405a-0ffc-4dde-87fd-fdb960fd13ee None admin] PATH_INFO: `/v3/users/22db557f27db42de955d306f82ae8428` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:50.962986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940405a-0ffc-4dde-87fd-fdb960fd13ee None admin] RBAC: Authorizing `identity:get_user(user_id=22db557f27db42de955d306f82ae8428)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:50.964659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940405a-0ffc-4dde-87fd-fdb960fd13ee None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:50.966748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 149/299] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:50 2022] GET /identity/v3/users/22db557f27db42de955d306f82ae8428 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:50.972446 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8754552-7dcb-4fc2-9317-5e88a7cdc235 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:51.045146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a114148-0572-4394-b5a2-1aebc641438e None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.045793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a114148-0572-4394-b5a2-1aebc641438e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.046270 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a114148-0572-4394-b5a2-1aebc641438e None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.048641 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 150/300] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:51.054075 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a673af9-8e2a-4e67-a904-77adb62f14d1 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.054628 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a673af9-8e2a-4e67-a904-77adb62f14d1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.055116 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a673af9-8e2a-4e67-a904-77adb62f14d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.072713 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-0a673af9-8e2a-4e67-a904-77adb62f14d1 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:51.074191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0a673af9-8e2a-4e67-a904-77adb62f14d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:51.075909 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8754552-7dcb-4fc2-9317-5e88a7cdc235 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:51.110670 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bd918-fb4d-46e6-8825-096b9488a3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:51.111530 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bd918-fb4d-46e6-8825-096b9488a3cf None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.111812 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bd918-fb4d-46e6-8825-096b9488a3cf None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.112092 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bd918-fb4d-46e6-8825-096b9488a3cf None admin] PATH_INFO: `/v3/system/users/22db557f27db42de955d306f82ae8428/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.113597 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bd918-fb4d-46e6-8825-096b9488a3cf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=22db557f27db42de955d306f82ae8428, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:51.114974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bd918-fb4d-46e6-8825-096b9488a3cf None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:51.140415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 151/301] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:19:51.141773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a892e-7c7f-4185-8980-d1f173083403 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.142058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a892e-7c7f-4185-8980-d1f173083403 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.142331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a892e-7c7f-4185-8980-d1f173083403 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.143995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 152/302] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:51.145121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cbbc5-3eb7-471b-8d04-7e0bd64c7c60 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.145402 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cbbc5-3eb7-471b-8d04-7e0bd64c7c60 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.145718 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499cbbc5-3eb7-471b-8d04-7e0bd64c7c60 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.147318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 153/303] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:51.149541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fb329-2041-49bd-8db6-d7f7b664af0f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.149839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fb329-2041-49bd-8db6-d7f7b664af0f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.150107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fb329-2041-49bd-8db6-d7f7b664af0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.166368 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-158fb329-2041-49bd-8db6-d7f7b664af0f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:51.167516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-158fb329-2041-49bd-8db6-d7f7b664af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:51.206031 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 151/304] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Mar 8 15:19:50 2022] PUT /identity/v3/system/users/22db557f27db42de955d306f82ae8428/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:19:51.207283 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ec476-ebec-4399-bc74-7b38c7c17c3d None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.207576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ec476-ebec-4399-bc74-7b38c7c17c3d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.207855 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ec476-ebec-4399-bc74-7b38c7c17c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.226083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a39ec476-ebec-4399-bc74-7b38c7c17c3d None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:51.227537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a39ec476-ebec-4399-bc74-7b38c7c17c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:51.244173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 154/305] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:51.244173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fb329-2041-49bd-8db6-d7f7b664af0f None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:51.309420 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 152/306] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:51.310293 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ec476-ebec-4399-bc74-7b38c7c17c3d None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:51.355109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fb329-2041-49bd-8db6-d7f7b664af0f None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:51.392060 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc187223-d5c3-4e81-bfa2-83b63fcffec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:51.393912 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc187223-d5c3-4e81-bfa2-83b63fcffec7 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.394371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc187223-d5c3-4e81-bfa2-83b63fcffec7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.394650 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc187223-d5c3-4e81-bfa2-83b63fcffec7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.395836 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc187223-d5c3-4e81-bfa2-83b63fcffec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:51.397748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc187223-d5c3-4e81-bfa2-83b63fcffec7 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:51.399746 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 155/307] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:51.400862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc187223-d5c3-4e81-bfa2-83b63fcffec7 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:51.421498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ec476-ebec-4399-bc74-7b38c7c17c3d None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:51.454744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd73c24-ee79-4819-89c8-c6616146b7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:51.455636 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd73c24-ee79-4819-89c8-c6616146b7dd None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.455988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd73c24-ee79-4819-89c8-c6616146b7dd None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.456466 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd73c24-ee79-4819-89c8-c6616146b7dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.466098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd73c24-ee79-4819-89c8-c6616146b7dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:51.472945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-8cd73c24-ee79-4819-89c8-c6616146b7dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 15:19:51.474285 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 153/308] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:51.476201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd73c24-ee79-4819-89c8-c6616146b7dd None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:51.497958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc187223-d5c3-4e81-bfa2-83b63fcffec7 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:51.532132 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7075b18-593b-4819-8f65-b64bdfd675e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:51.532945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7075b18-593b-4819-8f65-b64bdfd675e1 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.533460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7075b18-593b-4819-8f65-b64bdfd675e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.533574 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7075b18-593b-4819-8f65-b64bdfd675e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.546296 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7075b18-593b-4819-8f65-b64bdfd675e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:51.555549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-f7075b18-593b-4819-8f65-b64bdfd675e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 15:19:51.560313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 156/309] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:51.561207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7075b18-593b-4819-8f65-b64bdfd675e1 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:51.577651 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd73c24-ee79-4819-89c8-c6616146b7dd None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:51.613495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d79fab-36fb-4ee4-bc15-f65af94de7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:51.614922 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d79fab-36fb-4ee4-bc15-f65af94de7b4 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.616476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d79fab-36fb-4ee4-bc15-f65af94de7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.616953 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d79fab-36fb-4ee4-bc15-f65af94de7b4 None admin] PATH_INFO: `/v3/groups` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.618410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d79fab-36fb-4ee4-bc15-f65af94de7b4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:51.620478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d79fab-36fb-4ee4-bc15-f65af94de7b4 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:51.655864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7075b18-593b-4819-8f65-b64bdfd675e1 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:51.687860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1def94-e83b-4d3a-b0cb-7a2e825541b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:51.688558 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1def94-e83b-4d3a-b0cb-7a2e825541b4 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.688838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1def94-e83b-4d3a-b0cb-7a2e825541b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.689114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1def94-e83b-4d3a-b0cb-7a2e825541b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.689906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1def94-e83b-4d3a-b0cb-7a2e825541b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:51.690207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1def94-e83b-4d3a-b0cb-7a2e825541b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:51.691603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1def94-e83b-4d3a-b0cb-7a2e825541b4 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:51.704388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 154/310] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Mar 8 15:19:51 2022] POST /identity/v3/groups => generated 229 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:19:51.704388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d79fab-36fb-4ee4-bc15-f65af94de7b4 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:51.704653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 157/311] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:51.705520 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1def94-e83b-4d3a-b0cb-7a2e825541b4 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:51.814960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1def94-e83b-4d3a-b0cb-7a2e825541b4 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:51.822747 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d79fab-36fb-4ee4-bc15-f65af94de7b4 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:51.851114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d9c94-c425-4fd6-8ae0-0646727b1ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:51.852020 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d9c94-c425-4fd6-8ae0-0646727b1ceb None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.852333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d9c94-c425-4fd6-8ae0-0646727b1ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.852608 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d9c94-c425-4fd6-8ae0-0646727b1ceb None admin] PATH_INFO: `/v3/users/b948a48ac80347bf8a8c2bb2a26fe738` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.859545 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd29e1-e522-46d2-a7ad-f1912f62bf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:51.860308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd29e1-e522-46d2-a7ad-f1912f62bf90 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:51.860590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd29e1-e522-46d2-a7ad-f1912f62bf90 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:51.860865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd29e1-e522-46d2-a7ad-f1912f62bf90 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:51.861740 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd29e1-e522-46d2-a7ad-f1912f62bf90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:51.862047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd29e1-e522-46d2-a7ad-f1912f62bf90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:51.863539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd29e1-e522-46d2-a7ad-f1912f62bf90 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:51.868078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d9c94-c425-4fd6-8ae0-0646727b1ceb None admin] RBAC: Authorizing `identity:get_user(user_id=b948a48ac80347bf8a8c2bb2a26fe738)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:51.869584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d9c94-c425-4fd6-8ae0-0646727b1ceb None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:51.871657 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 158/312] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:51 2022] GET /identity/v3/users/b948a48ac80347bf8a8c2bb2a26fe738 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:51.878006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d9c94-c425-4fd6-8ae0-0646727b1ceb None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:51.878498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 155/313] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:51.883986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd29e1-e522-46d2-a7ad-f1912f62bf90 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:51.986190 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d9c94-c425-4fd6-8ae0-0646727b1ceb None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:52.020853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd29e1-e522-46d2-a7ad-f1912f62bf90 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:52.026663 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f090ec-8042-4584-a292-ca06c4c1d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:52.027312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f090ec-8042-4584-a292-ca06c4c1d865 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:52.027589 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f090ec-8042-4584-a292-ca06c4c1d865 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:52.027864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f090ec-8042-4584-a292-ca06c4c1d865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:52.028718 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f090ec-8042-4584-a292-ca06c4c1d865 None admin] RBAC: Adding query filter params (role.id=2e236c62c0f041ab91e9fab86a52cd2d, user.id=b948a48ac80347bf8a8c2bb2a26fe738, scope.system=all) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:52.029027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f090ec-8042-4584-a292-ca06c4c1d865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:52.030460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f090ec-8042-4584-a292-ca06c4c1d865 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:52.035815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 159/314] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Mar 8 15:19:51 2022] GET /identity/v3/role_assignments?user.id=b948a48ac80347bf8a8c2bb2a26fe738&scope.system=all&role.id=2e236c62c0f041ab91e9fab86a52cd2d => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:52.063454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294a243-3094-47c9-83da-e103e11fc685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:52.064382 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294a243-3094-47c9-83da-e103e11fc685 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:52.064668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294a243-3094-47c9-83da-e103e11fc685 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:52.064942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294a243-3094-47c9-83da-e103e11fc685 None admin] PATH_INFO: `/v3/users/39094344e3d04d78b421786ec9d755c2` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:52.066296 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294a243-3094-47c9-83da-e103e11fc685 None admin] RBAC: Authorizing `identity:get_user(user_id=39094344e3d04d78b421786ec9d755c2)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:52.067726 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294a243-3094-47c9-83da-e103e11fc685 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:52.070049 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 156/315] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:51 2022] GET /identity/v3/users/39094344e3d04d78b421786ec9d755c2 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:52.077333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f090ec-8042-4584-a292-ca06c4c1d865 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:52.190755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f090ec-8042-4584-a292-ca06c4c1d865 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:52.229784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2aaa7-9496-4979-82dc-fd2ec206f0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:52.230445 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2aaa7-9496-4979-82dc-fd2ec206f0e7 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:52.230726 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2aaa7-9496-4979-82dc-fd2ec206f0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:52.231002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2aaa7-9496-4979-82dc-fd2ec206f0e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:52.299563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2aaa7-9496-4979-82dc-fd2ec206f0e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:52.301048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2aaa7-9496-4979-82dc-fd2ec206f0e7 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:52.404481 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 160/316] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:52.409794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294a243-3094-47c9-83da-e103e11fc685 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:52.507717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294a243-3094-47c9-83da-e103e11fc685 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:52.540682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d466126-010c-4fbc-9cea-91c660ab0471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:52.541851 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d466126-010c-4fbc-9cea-91c660ab0471 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:52.542323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d466126-010c-4fbc-9cea-91c660ab0471 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:52.542782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d466126-010c-4fbc-9cea-91c660ab0471 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:52.544231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d466126-010c-4fbc-9cea-91c660ab0471 None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:52.545856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d466126-010c-4fbc-9cea-91c660ab0471 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:52.547965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 157/317] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:52 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:52.553994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2aaa7-9496-4979-82dc-fd2ec206f0e7 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:52.667126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2aaa7-9496-4979-82dc-fd2ec206f0e7 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:52.702056 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c4851-d91d-4654-9bc9-dc01cdd509d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:52.702977 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c4851-d91d-4654-9bc9-dc01cdd509d9 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:52.703497 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c4851-d91d-4654-9bc9-dc01cdd509d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:52.703943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c4851-d91d-4654-9bc9-dc01cdd509d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:52.704994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c4851-d91d-4654-9bc9-dc01cdd509d9 None admin] RBAC: Adding query filter params (role.id=2e236c62c0f041ab91e9fab86a52cd2d, scope.project.id=0875194231ad4cbd89e6165cb46375c3, user.id=39094344e3d04d78b421786ec9d755c2) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:52.705479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c4851-d91d-4654-9bc9-dc01cdd509d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:52.707109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c4851-d91d-4654-9bc9-dc01cdd509d9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:52.713445 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 161/318] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:19:52 2022] GET /identity/v3/role_assignments?user.id=39094344e3d04d78b421786ec9d755c2&scope.project.id=0875194231ad4cbd89e6165cb46375c3&role.id=2e236c62c0f041ab91e9fab86a52cd2d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:53.545232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c528d7a-16f8-4ed7-8d60-eff7c3ebe69d None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:53.545733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c528d7a-16f8-4ed7-8d60-eff7c3ebe69d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:53.545733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c528d7a-16f8-4ed7-8d60-eff7c3ebe69d None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:53.547597 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 158/319] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:53.552785 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047498dd-5295-4586-89d5-cef2676893b1 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:53.557739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047498dd-5295-4586-89d5-cef2676893b1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:53.557739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047498dd-5295-4586-89d5-cef2676893b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:53.570533 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-047498dd-5295-4586-89d5-cef2676893b1 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:53.571715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-047498dd-5295-4586-89d5-cef2676893b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:53.765854 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 162/320] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:53.789249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c528d7a-16f8-4ed7-8d60-eff7c3ebe69d None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:53.885701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c528d7a-16f8-4ed7-8d60-eff7c3ebe69d None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:53.917247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb1d56-4efd-42e4-9376-24dd1b0bf279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:53.918036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1d56-4efd-42e4-9376-24dd1b0bf279 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:53.918323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1d56-4efd-42e4-9376-24dd1b0bf279 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:53.918598 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1d56-4efd-42e4-9376-24dd1b0bf279 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:53.929089 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb1d56-4efd-42e4-9376-24dd1b0bf279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:53.935958 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-f2bb1d56-4efd-42e4-9376-24dd1b0bf279 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:53.937338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 159/321] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:53.943149 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047498dd-5295-4586-89d5-cef2676893b1 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:54.042323 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047498dd-5295-4586-89d5-cef2676893b1 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:54.079015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73deb85f-ea33-435d-b346-cceebfbf14ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:54.079683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deb85f-ea33-435d-b346-cceebfbf14ea None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:54.079963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deb85f-ea33-435d-b346-cceebfbf14ea None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:54.080258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deb85f-ea33-435d-b346-cceebfbf14ea None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:54.081077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73deb85f-ea33-435d-b346-cceebfbf14ea None admin] RBAC: Adding query filter params (name=member) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:54.081386 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73deb85f-ea33-435d-b346-cceebfbf14ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:54.082769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73deb85f-ea33-435d-b346-cceebfbf14ea None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:54.087994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0eaa-7877-441a-adbf-ebe2344a7267 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:54.088320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0eaa-7877-441a-adbf-ebe2344a7267 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:54.088600 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0eaa-7877-441a-adbf-ebe2344a7267 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:54.090376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 160/322] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:54.093890 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 163/323] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:54.095542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f7c8f-ba80-4796-9202-03c987d269da None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:54.095832 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f7c8f-ba80-4796-9202-03c987d269da None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:54.096113 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f7c8f-ba80-4796-9202-03c987d269da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:54.099260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73deb85f-ea33-435d-b346-cceebfbf14ea None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:54.112867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a07f7c8f-ba80-4796-9202-03c987d269da None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:54.114052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a07f7c8f-ba80-4796-9202-03c987d269da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:54.188193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 161/324] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:54.200863 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73deb85f-ea33-435d-b346-cceebfbf14ea None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:54.211204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f7c8f-ba80-4796-9202-03c987d269da None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:54.233199 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb837856-03d0-4c0f-a857-ea62132e2384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:54.234066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb837856-03d0-4c0f-a857-ea62132e2384 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:54.234353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb837856-03d0-4c0f-a857-ea62132e2384 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:54.234902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb837856-03d0-4c0f-a857-ea62132e2384 None admin] PATH_INFO: `/v3/users/22db557f27db42de955d306f82ae8428` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:54.235821 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb837856-03d0-4c0f-a857-ea62132e2384 None admin] RBAC: Authorizing `identity:get_user(user_id=22db557f27db42de955d306f82ae8428)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:54.237517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb837856-03d0-4c0f-a857-ea62132e2384 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:54.239066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 164/325] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:54 2022] GET /identity/v3/users/22db557f27db42de955d306f82ae8428 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:54.245335 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb837856-03d0-4c0f-a857-ea62132e2384 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:54.346913 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb837856-03d0-4c0f-a857-ea62132e2384 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:54.380396 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddac89-840e-465f-9789-b5b853894110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:54.381598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddac89-840e-465f-9789-b5b853894110 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:54.381894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddac89-840e-465f-9789-b5b853894110 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:54.382173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddac89-840e-465f-9789-b5b853894110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:54.383003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddac89-840e-465f-9789-b5b853894110 None admin] RBAC: Adding query filter params (role.id=ab135a02f63c4a138c6b116ad4f9c8d0, user.id=22db557f27db42de955d306f82ae8428, scope.system=all) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:54.383320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddac89-840e-465f-9789-b5b853894110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:54.384793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddac89-840e-465f-9789-b5b853894110 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:54.396456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 165/326] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Mar 8 15:19:54 2022] GET /identity/v3/role_assignments?user.id=22db557f27db42de955d306f82ae8428&scope.system=all&role.id=ab135a02f63c4a138c6b116ad4f9c8d0 => generated 510 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:54.417879 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b45e5-449a-4bb5-9bbb-2181fe30c785 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:54.418177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b45e5-449a-4bb5-9bbb-2181fe30c785 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:54.418462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b45e5-449a-4bb5-9bbb-2181fe30c785 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:54.424187 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 166/327] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:54.426695 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c86ec-9510-4858-8795-5a333ea565e0 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:54.426987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c86ec-9510-4858-8795-5a333ea565e0 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:54.427441 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c86ec-9510-4858-8795-5a333ea565e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:54.431419 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f7c8f-ba80-4796-9202-03c987d269da None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:54.447654 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-5e4c86ec-9510-4858-8795-5a333ea565e0 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:54.449195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-5e4c86ec-9510-4858-8795-5a333ea565e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:54.467536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97775aa-c853-49e5-9555-ca39ad52e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:54.468366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97775aa-c853-49e5-9555-ca39ad52e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:54.468653 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97775aa-c853-49e5-9555-ca39ad52e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:54.468932 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97775aa-c853-49e5-9555-ca39ad52e2c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:54.470128 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97775aa-c853-49e5-9555-ca39ad52e2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:54.471582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97775aa-c853-49e5-9555-ca39ad52e2c7 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:54.473267 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 162/328] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:19:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:54.478975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97775aa-c853-49e5-9555-ca39ad52e2c7 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:54.522400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 167/329] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:54.544830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c86ec-9510-4858-8795-5a333ea565e0 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:54.583105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97775aa-c853-49e5-9555-ca39ad52e2c7 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:54.652045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba5056-9ea0-4329-8839-780b2c1cf7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:54.652674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba5056-9ea0-4329-8839-780b2c1cf7e9 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:54.652962 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba5056-9ea0-4329-8839-780b2c1cf7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:54.653244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba5056-9ea0-4329-8839-780b2c1cf7e9 None admin] PATH_INFO: `/v3/groups` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:54.653930 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba5056-9ea0-4329-8839-780b2c1cf7e9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:54.655363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba5056-9ea0-4329-8839-780b2c1cf7e9 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:54.682779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c86ec-9510-4858-8795-5a333ea565e0 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:54.716269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520f00f-1d61-4deb-873b-52fb88834ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:54.717058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520f00f-1d61-4deb-873b-52fb88834ad7 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:54.717338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520f00f-1d61-4deb-873b-52fb88834ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:54.717637 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520f00f-1d61-4deb-873b-52fb88834ad7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:54.728360 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520f00f-1d61-4deb-873b-52fb88834ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:54.735222 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-8520f00f-1d61-4deb-873b-52fb88834ad7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 15:19:54.736420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 168/330] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:54.742862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520f00f-1d61-4deb-873b-52fb88834ad7 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:54.753046 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 163/331] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Mar 8 15:19:54 2022] POST /identity/v3/groups => generated 226 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:19:54.844605 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520f00f-1d61-4deb-873b-52fb88834ad7 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:54.878726 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e29ef8-6d78-4074-9892-e46a1e9dd39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:54.879396 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e29ef8-6d78-4074-9892-e46a1e9dd39b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:54.879675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e29ef8-6d78-4074-9892-e46a1e9dd39b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:54.879946 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e29ef8-6d78-4074-9892-e46a1e9dd39b None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:54.880735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e29ef8-6d78-4074-9892-e46a1e9dd39b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:54.881100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e29ef8-6d78-4074-9892-e46a1e9dd39b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:54.882500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e29ef8-6d78-4074-9892-e46a1e9dd39b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:54.891251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 169/332] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:54.897537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba5056-9ea0-4329-8839-780b2c1cf7e9 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:54.994796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba5056-9ea0-4329-8839-780b2c1cf7e9 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:55.028882 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df091126-1809-4076-b2dc-8ddcce513baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:55.029761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df091126-1809-4076-b2dc-8ddcce513baa None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:55.030039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df091126-1809-4076-b2dc-8ddcce513baa None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:55.030313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df091126-1809-4076-b2dc-8ddcce513baa None admin] PATH_INFO: `/v3/users/b948a48ac80347bf8a8c2bb2a26fe738` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:55.031509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df091126-1809-4076-b2dc-8ddcce513baa None admin] RBAC: Authorizing `identity:get_user(user_id=b948a48ac80347bf8a8c2bb2a26fe738)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:55.033163 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df091126-1809-4076-b2dc-8ddcce513baa None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:55.034998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 164/333] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:19:54 2022] GET /identity/v3/users/b948a48ac80347bf8a8c2bb2a26fe738 => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:55.041051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e29ef8-6d78-4074-9892-e46a1e9dd39b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:55.144487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e29ef8-6d78-4074-9892-e46a1e9dd39b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:55.181450 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8af99-083b-4316-8d6a-a76d4d817e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:55.182311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8af99-083b-4316-8d6a-a76d4d817e30 None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:55.182596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8af99-083b-4316-8d6a-a76d4d817e30 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:55.182892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8af99-083b-4316-8d6a-a76d4d817e30 None admin] PATH_INFO: `/v3/system/users/b948a48ac80347bf8a8c2bb2a26fe738/roles/2e236c62c0f041ab91e9fab86a52cd2d` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:55.184407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8af99-083b-4316-8d6a-a76d4d817e30 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b948a48ac80347bf8a8c2bb2a26fe738, role_id=2e236c62c0f041ab91e9fab86a52cd2d)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:55.185794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8af99-083b-4316-8d6a-a76d4d817e30 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:55.258185 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 170/334] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Mar 8 15:19:55 2022] PUT /identity/v3/system/users/b948a48ac80347bf8a8c2bb2a26fe738/roles/2e236c62c0f041ab91e9fab86a52cd2d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:19:57.579700 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22913ed-e8ab-4b5b-a89a-1228b2c56ffc None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:57.580280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22913ed-e8ab-4b5b-a89a-1228b2c56ffc None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:57.580280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22913ed-e8ab-4b5b-a89a-1228b2c56ffc None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:57.582228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 165/335] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:57.598186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5b980-0ae2-46f9-a522-61e7ffb193df None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:57.599144 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5b980-0ae2-46f9-a522-61e7ffb193df None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:57.607829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5b980-0ae2-46f9-a522-61e7ffb193df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:57.629852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-eda5b980-0ae2-46f9-a522-61e7ffb193df None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:57.631359 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-eda5b980-0ae2-46f9-a522-61e7ffb193df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:57.713611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 171/336] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:57.755687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22913ed-e8ab-4b5b-a89a-1228b2c56ffc None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:57.860243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22913ed-e8ab-4b5b-a89a-1228b2c56ffc None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:57.906549 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd09bf-5191-4a95-badb-22ed511d4b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:57.907739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd09bf-5191-4a95-badb-22ed511d4b88 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:57.908232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd09bf-5191-4a95-badb-22ed511d4b88 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:57.908692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd09bf-5191-4a95-badb-22ed511d4b88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:57.929252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd09bf-5191-4a95-badb-22ed511d4b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:57.937024 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-72bd09bf-5191-4a95-badb-22ed511d4b88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:19:57.938973 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 166/337] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:19:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:57.944940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5b980-0ae2-46f9-a522-61e7ffb193df None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:58.051569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5b980-0ae2-46f9-a522-61e7ffb193df None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:58.091258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac174bf-2918-4c15-a5d5-ade84645763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:58.092252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac174bf-2918-4c15-a5d5-ade84645763a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:58.092710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac174bf-2918-4c15-a5d5-ade84645763a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:58.093168 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac174bf-2918-4c15-a5d5-ade84645763a None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:58.094086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac174bf-2918-4c15-a5d5-ade84645763a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:58.094571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac174bf-2918-4c15-a5d5-ade84645763a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:58.096115 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac174bf-2918-4c15-a5d5-ade84645763a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:58.105869 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 172/338] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:19:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:58.112865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd09bf-5191-4a95-badb-22ed511d4b88 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:58.238093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75df63-9f58-4418-ab80-0e2aac87fab3 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:58.238695 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75df63-9f58-4418-ab80-0e2aac87fab3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:58.239219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75df63-9f58-4418-ab80-0e2aac87fab3 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:58.241477 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 173/339] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:19:58.246315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd09bf-5191-4a95-badb-22ed511d4b88 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:58.246902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517b989-f2f3-4ce7-8dba-ad8c9f24c6fb None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:58.247197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517b989-f2f3-4ce7-8dba-ad8c9f24c6fb None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:58.247480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517b989-f2f3-4ce7-8dba-ad8c9f24c6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:58.285828 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-5517b989-f2f3-4ce7-8dba-ad8c9f24c6fb None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:58.287095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-5517b989-f2f3-4ce7-8dba-ad8c9f24c6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:58.293435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ace641-e600-475e-af6a-5b332f2f16be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:58.294395 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ace641-e600-475e-af6a-5b332f2f16be None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:58.294861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ace641-e600-475e-af6a-5b332f2f16be None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:58.295408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ace641-e600-475e-af6a-5b332f2f16be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:58.415140 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ace641-e600-475e-af6a-5b332f2f16be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:58.416956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ace641-e600-475e-af6a-5b332f2f16be None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:58.450809 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 174/340] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:58.493649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517b989-f2f3-4ce7-8dba-ad8c9f24c6fb None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:58.552182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 167/341] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:58.559928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ace641-e600-475e-af6a-5b332f2f16be None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:58.662526 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ace641-e600-475e-af6a-5b332f2f16be None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:58.670878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517b989-f2f3-4ce7-8dba-ad8c9f24c6fb None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:58.701758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b1b37-596d-4477-a409-f5946aed82f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:58.703012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b1b37-596d-4477-a409-f5946aed82f7 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:58.703505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b1b37-596d-4477-a409-f5946aed82f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:58.703977 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b1b37-596d-4477-a409-f5946aed82f7 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:58.705474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b1b37-596d-4477-a409-f5946aed82f7 None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:58.707219 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b1b37-596d-4477-a409-f5946aed82f7 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:58.710495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 168/342] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:58 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:19:58.711931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f94e1e-0bb1-4b7b-b393-8d298e4f475f None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:58.712444 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f94e1e-0bb1-4b7b-b393-8d298e4f475f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:58.712941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f94e1e-0bb1-4b7b-b393-8d298e4f475f None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:58.714793 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 169/343] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:58.719007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f94e1e-0bb1-4b7b-b393-8d298e4f475f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:58.719126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9ea6d-0893-4769-acb2-ad1ba07b07a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:58.719126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ea6d-0893-4769-acb2-ad1ba07b07a1 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:58.719126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ea6d-0893-4769-acb2-ad1ba07b07a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:58.719350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9ea6d-0893-4769-acb2-ad1ba07b07a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:58.742507 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9ea6d-0893-4769-acb2-ad1ba07b07a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:58.750589 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-08c9ea6d-0893-4769-acb2-ad1ba07b07a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:58.752303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 175/344] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:19:58.753733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11f41c-b64a-4bcd-aa3d-bb4664929045 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:58.754168 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11f41c-b64a-4bcd-aa3d-bb4664929045 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:58.754588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11f41c-b64a-4bcd-aa3d-bb4664929045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:58.774658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ae11f41c-b64a-4bcd-aa3d-bb4664929045 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:58.776209 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ae11f41c-b64a-4bcd-aa3d-bb4664929045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:58.841697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f94e1e-0bb1-4b7b-b393-8d298e4f475f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:58.866364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 176/345] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:58.869091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76276f-9d48-4049-b5c4-f9ab59e8395b None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:58.869546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76276f-9d48-4049-b5c4-f9ab59e8395b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:58.869964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76276f-9d48-4049-b5c4-f9ab59e8395b None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:58.871837 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 177/346] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:58.872743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76276f-9d48-4049-b5c4-f9ab59e8395b None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:58.892804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2db999-15c6-4da7-8c68-2d8c5e85a759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:58.893656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db999-15c6-4da7-8c68-2d8c5e85a759 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:58.893938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db999-15c6-4da7-8c68-2d8c5e85a759 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:58.894207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2db999-15c6-4da7-8c68-2d8c5e85a759 None admin] PATH_INFO: `/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:58.903437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2db999-15c6-4da7-8c68-2d8c5e85a759 None admin] RBAC: Authorizing `identity:get_group(group_id=5a3d9e5fdef447b294ab24fc4c67ae8c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:58.906342 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2db999-15c6-4da7-8c68-2d8c5e85a759 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:58.908207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 170/347] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:19:58 2022] GET /identity/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:58.909606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad6a16-0a06-47c4-9e81-c36875c91546 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:58.910092 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad6a16-0a06-47c4-9e81-c36875c91546 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:58.910536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad6a16-0a06-47c4-9e81-c36875c91546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:58.930786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-95ad6a16-0a06-47c4-9e81-c36875c91546 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:58.932255 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-95ad6a16-0a06-47c4-9e81-c36875c91546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:58.985660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76276f-9d48-4049-b5c4-f9ab59e8395b None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:59.012482 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 171/348] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:59.013582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad6a16-0a06-47c4-9e81-c36875c91546 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:59.035165 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad91923-9691-49c5-a43c-29f126f4cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:59.035822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad91923-9691-49c5-a43c-29f126f4cc28 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:59.036108 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad91923-9691-49c5-a43c-29f126f4cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:59.036424 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad91923-9691-49c5-a43c-29f126f4cc28 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:59.037751 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad91923-9691-49c5-a43c-29f126f4cc28 None admin] RBAC: Adding query filter params (name=member) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:59.038004 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad91923-9691-49c5-a43c-29f126f4cc28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:59.039390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad91923-9691-49c5-a43c-29f126f4cc28 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:59.050620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 178/349] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:59.052188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad91923-9691-49c5-a43c-29f126f4cc28 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:59.150564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad6a16-0a06-47c4-9e81-c36875c91546 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:59.197032 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000b0cc-4f09-4e27-a9e4-e88371199ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:59.198206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b0cc-4f09-4e27-a9e4-e88371199ba4 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:59.198695 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b0cc-4f09-4e27-a9e4-e88371199ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:59.198972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b0cc-4f09-4e27-a9e4-e88371199ba4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:59.202122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad91923-9691-49c5-a43c-29f126f4cc28 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:59.214383 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000b0cc-4f09-4e27-a9e4-e88371199ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:59.223442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-b000b0cc-4f09-4e27-a9e4-e88371199ba4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:19:59.225284 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 172/350] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:19:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:59.226609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d608a8-842b-440e-82a0-e489afb9db39 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:59.226896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d608a8-842b-440e-82a0-e489afb9db39 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:59.227174 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d608a8-842b-440e-82a0-e489afb9db39 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:59.232170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 173/351] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:59.232170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d608a8-842b-440e-82a0-e489afb9db39 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:59.248772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f8c0-5fd5-481c-8774-54af4bdd4bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:59.249434 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f8c0-5fd5-481c-8774-54af4bdd4bc2 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:59.249717 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f8c0-5fd5-481c-8774-54af4bdd4bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:59.249987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f8c0-5fd5-481c-8774-54af4bdd4bc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:59.250814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f8c0-5fd5-481c-8774-54af4bdd4bc2 None admin] RBAC: Adding query filter params (group.id=5a3d9e5fdef447b294ab24fc4c67ae8c, role.id=21dc73c091ba46889022763efb51de4e, scope.project.id=1b979e84a2154694996d7c8a5aa5afd1) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:59.251120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f8c0-5fd5-481c-8774-54af4bdd4bc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:59.254017 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f8c0-5fd5-481c-8774-54af4bdd4bc2 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:59.259483 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 179/352] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Mar 8 15:19:59 2022] GET /identity/v3/role_assignments?group.id=5a3d9e5fdef447b294ab24fc4c67ae8c&scope.project.id=1b979e84a2154694996d7c8a5aa5afd1&role.id=21dc73c091ba46889022763efb51de4e => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:59.260325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f8c0-5fd5-481c-8774-54af4bdd4bc2 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:59.356068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d608a8-842b-440e-82a0-e489afb9db39 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:59.400520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b71067-f9de-424d-9af6-c8c014058a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:59.401363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f8c0-5fd5-481c-8774-54af4bdd4bc2 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:59.401919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b71067-f9de-424d-9af6-c8c014058a7d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:59.402420 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b71067-f9de-424d-9af6-c8c014058a7d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:59.403124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b71067-f9de-424d-9af6-c8c014058a7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:59.420549 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b71067-f9de-424d-9af6-c8c014058a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:19:59.430621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-42b71067-f9de-424d-9af6-c8c014058a7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:19:59.433310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 174/353] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:19:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:19:59.434539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b71067-f9de-424d-9af6-c8c014058a7d None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:59.445744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d075479-a487-40c0-9dc7-0148c49a8441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:59.446496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d075479-a487-40c0-9dc7-0148c49a8441 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:59.446847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d075479-a487-40c0-9dc7-0148c49a8441 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:59.447259 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d075479-a487-40c0-9dc7-0148c49a8441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:59.541499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d075479-a487-40c0-9dc7-0148c49a8441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:59.543097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d075479-a487-40c0-9dc7-0148c49a8441 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:59.569970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b71067-f9de-424d-9af6-c8c014058a7d None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:59.609410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a2ff3-8e67-4fb6-afe7-ead0f38fc535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:59.610083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a2ff3-8e67-4fb6-afe7-ead0f38fc535 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:59.610366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a2ff3-8e67-4fb6-afe7-ead0f38fc535 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:59.610642 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a2ff3-8e67-4fb6-afe7-ead0f38fc535 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:59.611396 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a2ff3-8e67-4fb6-afe7-ead0f38fc535 None admin] RBAC: Adding query filter params (name=member) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:59.611704 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a2ff3-8e67-4fb6-afe7-ead0f38fc535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:59.613112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a2ff3-8e67-4fb6-afe7-ead0f38fc535 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:59.621896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 175/354] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:19:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:59.623170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07351b-4a16-4368-ac5c-c723bb1aae55 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:59.623462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07351b-4a16-4368-ac5c-c723bb1aae55 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:59.623743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07351b-4a16-4368-ac5c-c723bb1aae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:59.643314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-8b07351b-4a16-4368-ac5c-c723bb1aae55 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:19:59.645086 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8b07351b-4a16-4368-ac5c-c723bb1aae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:19:59.659414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 180/355] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:19:59.660663 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d075479-a487-40c0-9dc7-0148c49a8441 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:59.715583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 176/356] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:19:59.716609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c381737-a01e-4ef7-8cbe-470afa782aca None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:59.716902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c381737-a01e-4ef7-8cbe-470afa782aca None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:59.717185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c381737-a01e-4ef7-8cbe-470afa782aca None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:59.723646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 177/357] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:19:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:19:59.724999 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c381737-a01e-4ef7-8cbe-470afa782aca None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:59.764018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d075479-a487-40c0-9dc7-0148c49a8441 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:59.803364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92618697-36ae-48ce-9412-8b5f069cd09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:59.804364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92618697-36ae-48ce-9412-8b5f069cd09b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:59.804803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92618697-36ae-48ce-9412-8b5f069cd09b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:59.805077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92618697-36ae-48ce-9412-8b5f069cd09b None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:59.805826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92618697-36ae-48ce-9412-8b5f069cd09b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:19:59.806131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92618697-36ae-48ce-9412-8b5f069cd09b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:59.807501 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92618697-36ae-48ce-9412-8b5f069cd09b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:59.820352 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 181/358] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:19:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:19:59.821195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92618697-36ae-48ce-9412-8b5f069cd09b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:19:59.845804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c381737-a01e-4ef7-8cbe-470afa782aca None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:59.891757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079e060-02f7-4a23-bb52-bf8be371032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:19:59.892135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079e060-02f7-4a23-bb52-bf8be371032a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:19:59.892527 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079e060-02f7-4a23-bb52-bf8be371032a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:19:59.892878 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079e060-02f7-4a23-bb52-bf8be371032a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:19:59.952026 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92618697-36ae-48ce-9412-8b5f069cd09b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:19:59.975768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079e060-02f7-4a23-bb52-bf8be371032a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:19:59.978108 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079e060-02f7-4a23-bb52-bf8be371032a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:19:59.996807 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751faac3-6896-4d4d-abbb-1359d540e66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:00.001046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751faac3-6896-4d4d-abbb-1359d540e66a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:00.001046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751faac3-6896-4d4d-abbb-1359d540e66a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:00.001046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751faac3-6896-4d4d-abbb-1359d540e66a None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:00.001046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751faac3-6896-4d4d-abbb-1359d540e66a None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:00.002143 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751faac3-6896-4d4d-abbb-1359d540e66a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:00.004690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 182/359] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:19:59 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:00.009212 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88e81f-0521-4455-860c-ddb49b23595f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:00.009457 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88e81f-0521-4455-860c-ddb49b23595f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:00.009796 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88e81f-0521-4455-860c-ddb49b23595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:00.028642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-de88e81f-0521-4455-860c-ddb49b23595f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:00.029810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-de88e81f-0521-4455-860c-ddb49b23595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:00.094122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 178/360] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:19:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:00.094896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079e060-02f7-4a23-bb52-bf8be371032a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:00.120910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 183/361] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:00.121825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88e81f-0521-4455-860c-ddb49b23595f None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:00.214187 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079e060-02f7-4a23-bb52-bf8be371032a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:00.256852 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66157570-1d02-4171-9425-7a1e2a70fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:00.257572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66157570-1d02-4171-9425-7a1e2a70fede None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:00.258253 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66157570-1d02-4171-9425-7a1e2a70fede None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:00.258253 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66157570-1d02-4171-9425-7a1e2a70fede None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:00.260622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88e81f-0521-4455-860c-ddb49b23595f None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:00.270820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66157570-1d02-4171-9425-7a1e2a70fede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:00.278133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-66157570-1d02-4171-9425-7a1e2a70fede None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 15:20:00.280956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 179/362] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:00.280956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66157570-1d02-4171-9425-7a1e2a70fede None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:00.303882 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aaf6d-950e-4cdf-aa3b-aa861e614212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:00.304572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aaf6d-950e-4cdf-aa3b-aa861e614212 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:00.305299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aaf6d-950e-4cdf-aa3b-aa861e614212 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:00.305636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aaf6d-950e-4cdf-aa3b-aa861e614212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:00.396894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0aaf6d-950e-4cdf-aa3b-aa861e614212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:00.398790 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0aaf6d-950e-4cdf-aa3b-aa861e614212 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:00.416772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66157570-1d02-4171-9425-7a1e2a70fede None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:00.464493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a59078-e975-4b7a-9aa7-f6eee17ecac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:00.466248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a59078-e975-4b7a-9aa7-f6eee17ecac3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:00.466780 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a59078-e975-4b7a-9aa7-f6eee17ecac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:00.467058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a59078-e975-4b7a-9aa7-f6eee17ecac3 None admin] PATH_INFO: `/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:00.468317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a59078-e975-4b7a-9aa7-f6eee17ecac3 None admin] RBAC: Authorizing `identity:get_group(group_id=5a3d9e5fdef447b294ab24fc4c67ae8c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:00.469767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a59078-e975-4b7a-9aa7-f6eee17ecac3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:00.471399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 180/363] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:00 2022] GET /identity/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:00.472170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a59078-e975-4b7a-9aa7-f6eee17ecac3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:00.516870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 184/364] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:00.517649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aaf6d-950e-4cdf-aa3b-aa861e614212 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:00.591971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a59078-e975-4b7a-9aa7-f6eee17ecac3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:00.620183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aaf6d-950e-4cdf-aa3b-aa861e614212 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:00.632888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa483e0-95ca-4f4b-89b8-e9ac38ab05fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:00.633759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa483e0-95ca-4f4b-89b8-e9ac38ab05fb None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:00.634040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa483e0-95ca-4f4b-89b8-e9ac38ab05fb None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:00.634314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa483e0-95ca-4f4b-89b8-e9ac38ab05fb None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:00.635513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa483e0-95ca-4f4b-89b8-e9ac38ab05fb None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:00.636977 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa483e0-95ca-4f4b-89b8-e9ac38ab05fb None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:00.638656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 181/365] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:00 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:00.639415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa483e0-95ca-4f4b-89b8-e9ac38ab05fb None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:00.655023 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c50ebd-4d24-44ce-b3cb-bf5284c90697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:00.655813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c50ebd-4d24-44ce-b3cb-bf5284c90697 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:00.656090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c50ebd-4d24-44ce-b3cb-bf5284c90697 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:00.656392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c50ebd-4d24-44ce-b3cb-bf5284c90697 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:00.667053 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c50ebd-4d24-44ce-b3cb-bf5284c90697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:00.673893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-23c50ebd-4d24-44ce-b3cb-bf5284c90697 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:20:00.675415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 185/366] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:00.676287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c50ebd-4d24-44ce-b3cb-bf5284c90697 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:00.741971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa483e0-95ca-4f4b-89b8-e9ac38ab05fb None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:00.777457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cc98e-9e9f-45df-b3bb-e8853b6ab6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:00.777653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c50ebd-4d24-44ce-b3cb-bf5284c90697 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:00.778047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cc98e-9e9f-45df-b3bb-e8853b6ab6f9 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:00.778321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cc98e-9e9f-45df-b3bb-e8853b6ab6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:00.778595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cc98e-9e9f-45df-b3bb-e8853b6ab6f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:00.779515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cc98e-9e9f-45df-b3bb-e8853b6ab6f9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:00.780528 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cc98e-9e9f-45df-b3bb-e8853b6ab6f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:00.781954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cc98e-9e9f-45df-b3bb-e8853b6ab6f9 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:00.791062 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 182/367] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:20:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:00.791886 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cc98e-9e9f-45df-b3bb-e8853b6ab6f9 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:00.817872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46e814-c105-43a7-be91-59bc1c7d9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:00.818867 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46e814-c105-43a7-be91-59bc1c7d9da2 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:00.819321 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46e814-c105-43a7-be91-59bc1c7d9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:00.819595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46e814-c105-43a7-be91-59bc1c7d9da2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:00.820509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46e814-c105-43a7-be91-59bc1c7d9da2 None admin] RBAC: Adding query filter params (group.id=5a3d9e5fdef447b294ab24fc4c67ae8c, role.id=ab135a02f63c4a138c6b116ad4f9c8d0, scope.project.id=1b979e84a2154694996d7c8a5aa5afd1) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:00.820819 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46e814-c105-43a7-be91-59bc1c7d9da2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:00.823503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46e814-c105-43a7-be91-59bc1c7d9da2 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:00.830636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 186/368] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Mar 8 15:20:00 2022] GET /identity/v3/role_assignments?group.id=5a3d9e5fdef447b294ab24fc4c67ae8c&scope.project.id=1b979e84a2154694996d7c8a5aa5afd1&role.id=ab135a02f63c4a138c6b116ad4f9c8d0 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:00.832056 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46e814-c105-43a7-be91-59bc1c7d9da2 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:00.924175 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cc98e-9e9f-45df-b3bb-e8853b6ab6f9 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:00.954713 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46e814-c105-43a7-be91-59bc1c7d9da2 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:00.965864 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297d1e5-e51a-4e3b-8462-4f6d3522def1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:00.966739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297d1e5-e51a-4e3b-8462-4f6d3522def1 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:00.967019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297d1e5-e51a-4e3b-8462-4f6d3522def1 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:00.967294 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297d1e5-e51a-4e3b-8462-4f6d3522def1 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:00.973016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297d1e5-e51a-4e3b-8462-4f6d3522def1 None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:00.975063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297d1e5-e51a-4e3b-8462-4f6d3522def1 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:00.977195 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 183/369] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:00 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:00.977990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297d1e5-e51a-4e3b-8462-4f6d3522def1 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:00.993612 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230019d7-982d-4a6c-a814-046f0e45689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:00.994522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230019d7-982d-4a6c-a814-046f0e45689b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:00.994818 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230019d7-982d-4a6c-a814-046f0e45689b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:00.995092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230019d7-982d-4a6c-a814-046f0e45689b None admin] PATH_INFO: `/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:00.996381 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230019d7-982d-4a6c-a814-046f0e45689b None admin] RBAC: Authorizing `identity:get_group(group_id=5a3d9e5fdef447b294ab24fc4c67ae8c)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:00.997956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230019d7-982d-4a6c-a814-046f0e45689b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:01.000023 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 187/370] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:00 2022] GET /identity/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:01.000942 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230019d7-982d-4a6c-a814-046f0e45689b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:01.104967 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297d1e5-e51a-4e3b-8462-4f6d3522def1 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:01.125283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230019d7-982d-4a6c-a814-046f0e45689b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:01.141533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b59538-5668-48e3-be0d-b1d44d16678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:01.142418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b59538-5668-48e3-be0d-b1d44d16678b None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:01.142418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b59538-5668-48e3-be0d-b1d44d16678b None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:01.142640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b59538-5668-48e3-be0d-b1d44d16678b None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:01.143390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b59538-5668-48e3-be0d-b1d44d16678b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:01.143748 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b59538-5668-48e3-be0d-b1d44d16678b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:01.145089 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b59538-5668-48e3-be0d-b1d44d16678b None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:01.158884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 184/371] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:01.159799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b59538-5668-48e3-be0d-b1d44d16678b None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:01.164462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0cb85-95e8-4c0b-a5a1-1bb2836a9842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:01.165520 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0cb85-95e8-4c0b-a5a1-1bb2836a9842 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:01.165939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0cb85-95e8-4c0b-a5a1-1bb2836a9842 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:01.166365 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0cb85-95e8-4c0b-a5a1-1bb2836a9842 None admin] PATH_INFO: `/v3/users/b948a48ac80347bf8a8c2bb2a26fe738` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:01.167709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0cb85-95e8-4c0b-a5a1-1bb2836a9842 None admin] RBAC: Authorizing `identity:get_user(user_id=b948a48ac80347bf8a8c2bb2a26fe738)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:01.169317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0cb85-95e8-4c0b-a5a1-1bb2836a9842 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:01.171076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 188/372] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:20:01 2022] GET /identity/v3/users/b948a48ac80347bf8a8c2bb2a26fe738 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:01.172025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0cb85-95e8-4c0b-a5a1-1bb2836a9842 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:01.265459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b59538-5668-48e3-be0d-b1d44d16678b None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:01.270407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0cb85-95e8-4c0b-a5a1-1bb2836a9842 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:01.299196 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9864c9-9176-4ee1-954f-d428d6efe391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:01.300056 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9864c9-9176-4ee1-954f-d428d6efe391 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:01.300373 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9864c9-9176-4ee1-954f-d428d6efe391 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:01.300698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9864c9-9176-4ee1-954f-d428d6efe391 None admin] PATH_INFO: `/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:01.301972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9864c9-9176-4ee1-954f-d428d6efe391 None admin] RBAC: Authorizing `identity:get_group(group_id=5a3d9e5fdef447b294ab24fc4c67ae8c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:01.303708 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9864c9-9176-4ee1-954f-d428d6efe391 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:01.305262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa601230-3853-4d21-abf0-ce0418e39657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:01.306063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa601230-3853-4d21-abf0-ce0418e39657 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:01.306560 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa601230-3853-4d21-abf0-ce0418e39657 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:01.306995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa601230-3853-4d21-abf0-ce0418e39657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:01.307968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa601230-3853-4d21-abf0-ce0418e39657 None admin] RBAC: Adding query filter params (group.id=5a3d9e5fdef447b294ab24fc4c67ae8c, role.id=ab135a02f63c4a138c6b116ad4f9c8d0, scope.project.id=0875194231ad4cbd89e6165cb46375c3) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:01.308446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa601230-3853-4d21-abf0-ce0418e39657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:01.310185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 185/373] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:01 2022] GET /identity/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:01.310320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa601230-3853-4d21-abf0-ce0418e39657 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:01.311012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9864c9-9176-4ee1-954f-d428d6efe391 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:01.316449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 189/374] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Mar 8 15:20:01 2022] GET /identity/v3/role_assignments?group.id=5a3d9e5fdef447b294ab24fc4c67ae8c&scope.project.id=0875194231ad4cbd89e6165cb46375c3&role.id=ab135a02f63c4a138c6b116ad4f9c8d0 => generated 260 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:01.317615 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa601230-3853-4d21-abf0-ce0418e39657 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:01.418831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9864c9-9176-4ee1-954f-d428d6efe391 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:01.424725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa601230-3853-4d21-abf0-ce0418e39657 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:01.454114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3dfbc-60df-4a29-9c99-1e830181e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:01.454919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3dfbc-60df-4a29-9c99-1e830181e0a4 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:01.455206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3dfbc-60df-4a29-9c99-1e830181e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:01.455485 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3dfbc-60df-4a29-9c99-1e830181e0a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:01.460645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec100f11-4317-4580-8275-ef66c188a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:01.464179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec100f11-4317-4580-8275-ef66c188a341 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:01.464179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec100f11-4317-4580-8275-ef66c188a341 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:01.464179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec100f11-4317-4580-8275-ef66c188a341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:01.464179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec100f11-4317-4580-8275-ef66c188a341 None admin] RBAC: Adding query filter params (role.id=2e236c62c0f041ab91e9fab86a52cd2d, user.id=b948a48ac80347bf8a8c2bb2a26fe738, scope.system=all) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:01.464179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec100f11-4317-4580-8275-ef66c188a341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:01.464540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec100f11-4317-4580-8275-ef66c188a341 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:01.477064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 190/375] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Mar 8 15:20:01 2022] GET /identity/v3/role_assignments?user.id=b948a48ac80347bf8a8c2bb2a26fe738&scope.system=all&role.id=2e236c62c0f041ab91e9fab86a52cd2d => generated 510 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:01.477922 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec100f11-4317-4580-8275-ef66c188a341 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:01.542493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3dfbc-60df-4a29-9c99-1e830181e0a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:01.543990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3dfbc-60df-4a29-9c99-1e830181e0a4 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:01.664347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 186/376] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:01.672912 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3dfbc-60df-4a29-9c99-1e830181e0a4 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:01.691342 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec100f11-4317-4580-8275-ef66c188a341 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:01.728519 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d0359-85ce-4f57-bab5-decc6d9b234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:01.729465 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d0359-85ce-4f57-bab5-decc6d9b234f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:01.729748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d0359-85ce-4f57-bab5-decc6d9b234f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:01.730025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d0359-85ce-4f57-bab5-decc6d9b234f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:01.731038 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d0359-85ce-4f57-bab5-decc6d9b234f None admin] RBAC: Adding query filter params (group.id=5a3d9e5fdef447b294ab24fc4c67ae8c, role.id=21dc73c091ba46889022763efb51de4e, scope.project.id=0875194231ad4cbd89e6165cb46375c3) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:01.731780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d0359-85ce-4f57-bab5-decc6d9b234f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:01.733544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d0359-85ce-4f57-bab5-decc6d9b234f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:01.743161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 191/377] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Mar 8 15:20:01 2022] GET /identity/v3/role_assignments?group.id=5a3d9e5fdef447b294ab24fc4c67ae8c&scope.project.id=0875194231ad4cbd89e6165cb46375c3&role.id=21dc73c091ba46889022763efb51de4e => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:01.766387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a8095-e345-400a-bf60-bac572f8a6e3 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:01.766697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a8095-e345-400a-bf60-bac572f8a6e3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:01.766943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a8095-e345-400a-bf60-bac572f8a6e3 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:01.769080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 192/378] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:20:01.774419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4256a9-057a-4956-a563-312d120dfe21 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:01.774725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4256a9-057a-4956-a563-312d120dfe21 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:01.774976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4256a9-057a-4956-a563-312d120dfe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:01.793733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3dfbc-60df-4a29-9c99-1e830181e0a4 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:01.804737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-1d4256a9-057a-4956-a563-312d120dfe21 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:01.806031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1d4256a9-057a-4956-a563-312d120dfe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:01.844548 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0723d99-89dc-4cf3-89a7-165fca245fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:01.845442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0723d99-89dc-4cf3-89a7-165fca245fcc None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:01.845722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0723d99-89dc-4cf3-89a7-165fca245fcc None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:01.845999 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0723d99-89dc-4cf3-89a7-165fca245fcc None admin] PATH_INFO: `/v3/projects/8327b1557fad4b78a6361ee1a7f6b2e4` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:01.848801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0723d99-89dc-4cf3-89a7-165fca245fcc None admin] RBAC: Authorizing `identity:get_project(project_id=8327b1557fad4b78a6361ee1a7f6b2e4)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:01.850331 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0723d99-89dc-4cf3-89a7-165fca245fcc None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:01.852399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 187/379] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:01 2022] GET /identity/v3/projects/8327b1557fad4b78a6361ee1a7f6b2e4 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:01.857546 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0723d99-89dc-4cf3-89a7-165fca245fcc None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:01.909244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 193/380] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:20:01.938369 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4256a9-057a-4956-a563-312d120dfe21 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:01.977311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0723d99-89dc-4cf3-89a7-165fca245fcc None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:02.023419 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d00d9-3bfc-4655-81fc-e89c175af2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:02.024344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d00d9-3bfc-4655-81fc-e89c175af2a2 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:02.024629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d00d9-3bfc-4655-81fc-e89c175af2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:02.024906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d00d9-3bfc-4655-81fc-e89c175af2a2 None admin] PATH_INFO: `/v3/groups/1adcd7b01cfd4c7e9ccfc278074726cb` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:02.035013 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d00d9-3bfc-4655-81fc-e89c175af2a2 None admin] RBAC: Authorizing `identity:get_group(group_id=1adcd7b01cfd4c7e9ccfc278074726cb)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:02.036526 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d00d9-3bfc-4655-81fc-e89c175af2a2 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:02.039612 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 188/381] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:01 2022] GET /identity/v3/groups/1adcd7b01cfd4c7e9ccfc278074726cb => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:02.046500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d00d9-3bfc-4655-81fc-e89c175af2a2 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:02.147166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4256a9-057a-4956-a563-312d120dfe21 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:02.204193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d00d9-3bfc-4655-81fc-e89c175af2a2 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:02.219743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982918b-2129-44d6-8f17-d1f8cf55251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:02.220592 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982918b-2129-44d6-8f17-d1f8cf55251c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:02.220876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982918b-2129-44d6-8f17-d1f8cf55251c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:02.221154 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982918b-2129-44d6-8f17-d1f8cf55251c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:02.244913 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b45465-edc8-4512-949e-b503fec2f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:02.245564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b45465-edc8-4512-949e-b503fec2f62b None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:02.245844 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b45465-edc8-4512-949e-b503fec2f62b None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:02.246117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b45465-edc8-4512-949e-b503fec2f62b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:02.246945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b45465-edc8-4512-949e-b503fec2f62b None admin] RBAC: Adding query filter params (group.id=1adcd7b01cfd4c7e9ccfc278074726cb, role.id=24a7898c863141f1911792647b5274e3, scope.project.id=8327b1557fad4b78a6361ee1a7f6b2e4) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:02.247255 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b45465-edc8-4512-949e-b503fec2f62b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:02.248718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b45465-edc8-4512-949e-b503fec2f62b None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:02.251071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982918b-2129-44d6-8f17-d1f8cf55251c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:02.258431 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-a982918b-2129-44d6-8f17-d1f8cf55251c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:20:02.268072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 189/382] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Mar 8 15:20:02 2022] GET /identity/v3/role_assignments?group.id=1adcd7b01cfd4c7e9ccfc278074726cb&scope.project.id=8327b1557fad4b78a6361ee1a7f6b2e4&role.id=24a7898c863141f1911792647b5274e3 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:02.268234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 194/383] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:20:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:02.269562 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b45465-edc8-4512-949e-b503fec2f62b None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:02.373222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b45465-edc8-4512-949e-b503fec2f62b None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:02.412376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fd066-1d97-4b90-93c3-af23aed6d761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:02.413065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fd066-1d97-4b90-93c3-af23aed6d761 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:02.413344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fd066-1d97-4b90-93c3-af23aed6d761 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:02.413618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fd066-1d97-4b90-93c3-af23aed6d761 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:02.414366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fd066-1d97-4b90-93c3-af23aed6d761 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:02.414669 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fd066-1d97-4b90-93c3-af23aed6d761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:02.416042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fd066-1d97-4b90-93c3-af23aed6d761 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:02.425007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 190/384] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:02.430587 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982918b-2129-44d6-8f17-d1f8cf55251c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:02.550456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982918b-2129-44d6-8f17-d1f8cf55251c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:02.594432 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb6f3d-e3bc-4ad5-8046-9ed8a12adace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:02.595291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb6f3d-e3bc-4ad5-8046-9ed8a12adace None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:02.595571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb6f3d-e3bc-4ad5-8046-9ed8a12adace None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:02.595843 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb6f3d-e3bc-4ad5-8046-9ed8a12adace None admin] PATH_INFO: `/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:02.597053 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb6f3d-e3bc-4ad5-8046-9ed8a12adace None admin] RBAC: Authorizing `identity:get_group(group_id=5a3d9e5fdef447b294ab24fc4c67ae8c)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:02.598487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb6f3d-e3bc-4ad5-8046-9ed8a12adace None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:02.601001 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 195/385] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:02 2022] GET /identity/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:02.606402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fd066-1d97-4b90-93c3-af23aed6d761 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:02.710615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fd066-1d97-4b90-93c3-af23aed6d761 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:02.744512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88370525-a98c-4ee5-b012-4259ffef727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:02.745374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88370525-a98c-4ee5-b012-4259ffef727c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:02.745654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88370525-a98c-4ee5-b012-4259ffef727c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:02.745930 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88370525-a98c-4ee5-b012-4259ffef727c None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:02.747110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88370525-a98c-4ee5-b012-4259ffef727c None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:02.748566 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88370525-a98c-4ee5-b012-4259ffef727c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:02.750518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 191/386] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:02 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:02.756109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb6f3d-e3bc-4ad5-8046-9ed8a12adace None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:02.867682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb6f3d-e3bc-4ad5-8046-9ed8a12adace None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:02.908828 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3d630-acae-459d-9644-d4643abf1dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:02.909715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3d630-acae-459d-9644-d4643abf1dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:02.910037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3d630-acae-459d-9644-d4643abf1dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:02.910317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3d630-acae-459d-9644-d4643abf1dc5 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1/groups/5a3d9e5fdef447b294ab24fc4c67ae8c/roles/21dc73c091ba46889022763efb51de4e` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:02.914019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3d630-acae-459d-9644-d4643abf1dc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b979e84a2154694996d7c8a5aa5afd1, group_id=5a3d9e5fdef447b294ab24fc4c67ae8c, role_id=21dc73c091ba46889022763efb51de4e)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:02.915462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3d630-acae-459d-9644-d4643abf1dc5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:02.994510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 196/387] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Mar 8 15:20:02 2022] PUT /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1/groups/5a3d9e5fdef447b294ab24fc4c67ae8c/roles/21dc73c091ba46889022763efb51de4e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:20:03.926315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803918d-7eaa-4339-9045-b58ce5d96350 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:03.926830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803918d-7eaa-4339-9045-b58ce5d96350 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:03.926904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803918d-7eaa-4339-9045-b58ce5d96350 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:03.929486 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 192/388] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:03.934906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20c8a2-6f98-45da-823d-ad426963a021 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:03.935766 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20c8a2-6f98-45da-823d-ad426963a021 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:03.936282 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20c8a2-6f98-45da-823d-ad426963a021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:03.957068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-9b20c8a2-6f98-45da-823d-ad426963a021 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:03.958694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9b20c8a2-6f98-45da-823d-ad426963a021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:04.053594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 197/389] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:04.083972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803918d-7eaa-4339-9045-b58ce5d96350 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:04.216743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803918d-7eaa-4339-9045-b58ce5d96350 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:04.251546 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7527560-e519-49f9-a92d-c311d5aa90f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:04.252640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7527560-e519-49f9-a92d-c311d5aa90f0 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:04.253072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7527560-e519-49f9-a92d-c311d5aa90f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:04.253493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7527560-e519-49f9-a92d-c311d5aa90f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:04.263848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7527560-e519-49f9-a92d-c311d5aa90f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:04.271463 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-d7527560-e519-49f9-a92d-c311d5aa90f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:20:04.273160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 193/390] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:04.278935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20c8a2-6f98-45da-823d-ad426963a021 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:04.399204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20c8a2-6f98-45da-823d-ad426963a021 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:04.444862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968adc5-2834-4fbe-b191-75cc78b52366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:04.445827 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968adc5-2834-4fbe-b191-75cc78b52366 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:04.446263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968adc5-2834-4fbe-b191-75cc78b52366 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:04.446683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968adc5-2834-4fbe-b191-75cc78b52366 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:04.447594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968adc5-2834-4fbe-b191-75cc78b52366 None admin] RBAC: Adding query filter params (name=member) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:04.448062 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968adc5-2834-4fbe-b191-75cc78b52366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:04.449760 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968adc5-2834-4fbe-b191-75cc78b52366 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:04.459743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 198/391] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:20:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:04.465510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7527560-e519-49f9-a92d-c311d5aa90f0 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:04.568488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7527560-e519-49f9-a92d-c311d5aa90f0 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:04.601227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1d3ba-108e-4965-84a0-b6adc7ece1e5 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:04.601841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1d3ba-108e-4965-84a0-b6adc7ece1e5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:04.602343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1d3ba-108e-4965-84a0-b6adc7ece1e5 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:04.603602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad803a-ac3e-44fe-8dc8-7d901d11c3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:04.604492 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad803a-ac3e-44fe-8dc8-7d901d11c3d3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:04.604809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad803a-ac3e-44fe-8dc8-7d901d11c3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:04.605044 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad803a-ac3e-44fe-8dc8-7d901d11c3d3 None admin] PATH_INFO: `/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:04.605401 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 199/392] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:04.609316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad803a-ac3e-44fe-8dc8-7d901d11c3d3 None admin] RBAC: Authorizing `identity:get_group(group_id=5a3d9e5fdef447b294ab24fc4c67ae8c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:04.609316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad803a-ac3e-44fe-8dc8-7d901d11c3d3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:04.610870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a73591-446b-40e9-b107-960f5d5e828a None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:04.611366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a73591-446b-40e9-b107-960f5d5e828a None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:04.611556 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 194/393] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:04 2022] GET /identity/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:04.612028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a73591-446b-40e9-b107-960f5d5e828a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:04.616272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad803a-ac3e-44fe-8dc8-7d901d11c3d3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:04.643129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b6a73591-446b-40e9-b107-960f5d5e828a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:04.645200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b6a73591-446b-40e9-b107-960f5d5e828a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:04.714458 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 200/394] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:04.716222 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f691cd6-cada-46d7-8fda-4ca84a87200b None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:04.716678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f691cd6-cada-46d7-8fda-4ca84a87200b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:04.717120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f691cd6-cada-46d7-8fda-4ca84a87200b None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:04.719324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 201/395] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:04.729405 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01abea-35e5-4ae3-93ef-73ce77e9beb5 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:04.729956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01abea-35e5-4ae3-93ef-73ce77e9beb5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:04.730447 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01abea-35e5-4ae3-93ef-73ce77e9beb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:04.751135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-5f01abea-35e5-4ae3-93ef-73ce77e9beb5 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:04.752704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-5f01abea-35e5-4ae3-93ef-73ce77e9beb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:04.758810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad803a-ac3e-44fe-8dc8-7d901d11c3d3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:04.800244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc014bb3-f786-4357-98bf-e6b7de76799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:04.801277 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc014bb3-f786-4357-98bf-e6b7de76799e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:04.801568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc014bb3-f786-4357-98bf-e6b7de76799e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:04.801850 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc014bb3-f786-4357-98bf-e6b7de76799e None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:04.804779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc014bb3-f786-4357-98bf-e6b7de76799e None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:04.805346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc014bb3-f786-4357-98bf-e6b7de76799e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:04.811929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 195/396] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:04 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:04.811929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc014bb3-f786-4357-98bf-e6b7de76799e None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:04.830733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 202/397] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:04.832175 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01abea-35e5-4ae3-93ef-73ce77e9beb5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:04.933499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc014bb3-f786-4357-98bf-e6b7de76799e None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:04.944405 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01abea-35e5-4ae3-93ef-73ce77e9beb5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:04.976529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07ebc-22b3-470a-8d96-f97548bf5b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:04.977430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07ebc-22b3-470a-8d96-f97548bf5b39 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:04.977857 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07ebc-22b3-470a-8d96-f97548bf5b39 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:04.978148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e07ebc-22b3-470a-8d96-f97548bf5b39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:04.980780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133c312-6241-4025-aadc-164a89511689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:04.981884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133c312-6241-4025-aadc-164a89511689 None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:04.982391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133c312-6241-4025-aadc-164a89511689 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:04.982893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133c312-6241-4025-aadc-164a89511689 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1/groups/5a3d9e5fdef447b294ab24fc4c67ae8c/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:04.985440 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133c312-6241-4025-aadc-164a89511689 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b979e84a2154694996d7c8a5aa5afd1, group_id=5a3d9e5fdef447b294ab24fc4c67ae8c, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:04.987182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133c312-6241-4025-aadc-164a89511689 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:04.991136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e07ebc-22b3-470a-8d96-f97548bf5b39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:04.999492 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-72e07ebc-22b3-470a-8d96-f97548bf5b39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:20:05.001115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 196/398] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:05.006628 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07ebc-22b3-470a-8d96-f97548bf5b39 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:05.051088 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 203/399] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Mar 8 15:20:04 2022] PUT /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1/groups/5a3d9e5fdef447b294ab24fc4c67ae8c/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:20:05.057362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133c312-6241-4025-aadc-164a89511689 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:05.116872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e07ebc-22b3-470a-8d96-f97548bf5b39 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:05.161341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7bb61-5cff-4129-8c29-292f39a3760e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:05.162264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7bb61-5cff-4129-8c29-292f39a3760e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.162553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7bb61-5cff-4129-8c29-292f39a3760e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.162830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7bb61-5cff-4129-8c29-292f39a3760e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.188553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7bb61-5cff-4129-8c29-292f39a3760e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:05.203094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-01e7bb61-5cff-4129-8c29-292f39a3760e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:20:05.204454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 197/400] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:20:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:05.210684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7bb61-5cff-4129-8c29-292f39a3760e None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:05.310204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133c312-6241-4025-aadc-164a89511689 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:05.338314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7bb61-5cff-4129-8c29-292f39a3760e None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:05.352298 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78470e-87b1-4885-b0ae-a05d8ec5ff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:05.353060 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78470e-87b1-4885-b0ae-a05d8ec5ff8b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.353257 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78470e-87b1-4885-b0ae-a05d8ec5ff8b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.353530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78470e-87b1-4885-b0ae-a05d8ec5ff8b None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.354286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78470e-87b1-4885-b0ae-a05d8ec5ff8b None admin] RBAC: Adding query filter params (name=member) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:05.354864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78470e-87b1-4885-b0ae-a05d8ec5ff8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:05.356048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78470e-87b1-4885-b0ae-a05d8ec5ff8b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:05.370040 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 204/401] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:20:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:05.370040 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e6a9b-72e6-4efb-91bf-be91d300c747 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.370040 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e6a9b-72e6-4efb-91bf-be91d300c747 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.370040 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e6a9b-72e6-4efb-91bf-be91d300c747 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.370040 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 205/402] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:05.374766 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e6a9b-72e6-4efb-91bf-be91d300c747 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:05.387054 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddec46-9c5d-4367-a6cc-ad16c0ba1c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:05.387795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddec46-9c5d-4367-a6cc-ad16c0ba1c43 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.388079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddec46-9c5d-4367-a6cc-ad16c0ba1c43 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.388408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddec46-9c5d-4367-a6cc-ad16c0ba1c43 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.389226 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddec46-9c5d-4367-a6cc-ad16c0ba1c43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:05.389584 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddec46-9c5d-4367-a6cc-ad16c0ba1c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:05.391068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddec46-9c5d-4367-a6cc-ad16c0ba1c43 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:05.400743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 198/403] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:05.402057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a259-f672-458e-bae6-b393eb6e1bcd None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.402346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a259-f672-458e-bae6-b393eb6e1bcd None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.402622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168a259-f672-458e-bae6-b393eb6e1bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.429783 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-6168a259-f672-458e-bae6-b393eb6e1bcd None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:05.431007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-6168a259-f672-458e-bae6-b393eb6e1bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:05.494667 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e6a9b-72e6-4efb-91bf-be91d300c747 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:05.512302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 199/404] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:05.513251 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a259-f672-458e-bae6-b393eb6e1bcd None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:05.552898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467b628-c1ff-4a91-b6a6-912218c2efa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:05.554017 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467b628-c1ff-4a91-b6a6-912218c2efa4 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.554305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467b628-c1ff-4a91-b6a6-912218c2efa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.554780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467b628-c1ff-4a91-b6a6-912218c2efa4 None admin] PATH_INFO: `/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.559094 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467b628-c1ff-4a91-b6a6-912218c2efa4 None admin] RBAC: Authorizing `identity:get_group(group_id=5a3d9e5fdef447b294ab24fc4c67ae8c)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:05.559094 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467b628-c1ff-4a91-b6a6-912218c2efa4 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:05.560731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 206/405] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:05 2022] GET /identity/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:05.561502 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467b628-c1ff-4a91-b6a6-912218c2efa4 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:05.632086 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168a259-f672-458e-bae6-b393eb6e1bcd None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:05.666750 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281118aa-c0e2-4041-aa77-c5c1a1842a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:05.667945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281118aa-c0e2-4041-aa77-c5c1a1842a9c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.668469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281118aa-c0e2-4041-aa77-c5c1a1842a9c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.668915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281118aa-c0e2-4041-aa77-c5c1a1842a9c None admin] PATH_INFO: `/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.670372 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281118aa-c0e2-4041-aa77-c5c1a1842a9c None admin] RBAC: Authorizing `identity:get_group(group_id=5a3d9e5fdef447b294ab24fc4c67ae8c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:05.671998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281118aa-c0e2-4041-aa77-c5c1a1842a9c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:05.673876 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 200/406] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:05 2022] GET /identity/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:05.675007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281118aa-c0e2-4041-aa77-c5c1a1842a9c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:05.690325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467b628-c1ff-4a91-b6a6-912218c2efa4 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:05.735860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de86e41-cbed-41c8-b009-93325af9bce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:05.736669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de86e41-cbed-41c8-b009-93325af9bce5 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.736945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de86e41-cbed-41c8-b009-93325af9bce5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.737213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de86e41-cbed-41c8-b009-93325af9bce5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.750005 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de86e41-cbed-41c8-b009-93325af9bce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:05.757439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-8de86e41-cbed-41c8-b009-93325af9bce5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:20:05.758632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 207/407] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:05.759373 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de86e41-cbed-41c8-b009-93325af9bce5 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:05.786105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281118aa-c0e2-4041-aa77-c5c1a1842a9c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:05.820600 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9fa0b-2c56-42bc-96dc-915144640102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:05.821692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9fa0b-2c56-42bc-96dc-915144640102 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.822148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9fa0b-2c56-42bc-96dc-915144640102 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.822425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9fa0b-2c56-42bc-96dc-915144640102 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.823605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9fa0b-2c56-42bc-96dc-915144640102 None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:05.825081 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9fa0b-2c56-42bc-96dc-915144640102 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:05.826767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 201/408] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:05 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:05.827960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faa739-de05-4aae-b761-d1bad4433f63 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.828258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faa739-de05-4aae-b761-d1bad4433f63 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.828538 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faa739-de05-4aae-b761-d1bad4433f63 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.830419 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 202/409] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:05.831455 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faa739-de05-4aae-b761-d1bad4433f63 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:05.863655 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de86e41-cbed-41c8-b009-93325af9bce5 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:05.897152 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56cf42-fd66-4d58-bfcd-f27a6d335f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:05.897928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56cf42-fd66-4d58-bfcd-f27a6d335f35 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.898213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56cf42-fd66-4d58-bfcd-f27a6d335f35 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.898488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56cf42-fd66-4d58-bfcd-f27a6d335f35 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.899658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56cf42-fd66-4d58-bfcd-f27a6d335f35 None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:05.901123 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56cf42-fd66-4d58-bfcd-f27a6d335f35 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:05.907589 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 208/410] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:05 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:05.907589 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56cf42-fd66-4d58-bfcd-f27a6d335f35 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:05.932777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5faa739-de05-4aae-b761-d1bad4433f63 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:05.965099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c77e67-17ac-40e1-a25a-9a62d3b80074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:05.965760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c77e67-17ac-40e1-a25a-9a62d3b80074 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.966036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c77e67-17ac-40e1-a25a-9a62d3b80074 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.966307 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c77e67-17ac-40e1-a25a-9a62d3b80074 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.967045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c77e67-17ac-40e1-a25a-9a62d3b80074 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:05.967348 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c77e67-17ac-40e1-a25a-9a62d3b80074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:05.968736 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c77e67-17ac-40e1-a25a-9a62d3b80074 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:05.981042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 203/411] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:05.981042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa123d8-8c49-4ec9-9db1-49660f0c5d67 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:05.981042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa123d8-8c49-4ec9-9db1-49660f0c5d67 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:05.981042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa123d8-8c49-4ec9-9db1-49660f0c5d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:05.995385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-aaa123d8-8c49-4ec9-9db1-49660f0c5d67 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:05.996734 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-aaa123d8-8c49-4ec9-9db1-49660f0c5d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:06.007948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56cf42-fd66-4d58-bfcd-f27a6d335f35 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:06.045268 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568931d-a865-4211-b8bd-daf6fac310d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:06.046150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568931d-a865-4211-b8bd-daf6fac310d1 None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:06.046583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568931d-a865-4211-b8bd-daf6fac310d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:06.046860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568931d-a865-4211-b8bd-daf6fac310d1 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:06.049116 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568931d-a865-4211-b8bd-daf6fac310d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0875194231ad4cbd89e6165cb46375c3, group_id=5a3d9e5fdef447b294ab24fc4c67ae8c, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:06.051319 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568931d-a865-4211-b8bd-daf6fac310d1 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:06.063257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 204/412] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:06.064140 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa123d8-8c49-4ec9-9db1-49660f0c5d67 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:06.168281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa123d8-8c49-4ec9-9db1-49660f0c5d67 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:06.168708 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 209/413] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Mar 8 15:20:05 2022] PUT /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:20:06.169933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568931d-a865-4211-b8bd-daf6fac310d1 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:06.205713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06351720-b926-4cc8-8817-3a1cce8e673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:06.206773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06351720-b926-4cc8-8817-3a1cce8e673e None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:06.207150 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06351720-b926-4cc8-8817-3a1cce8e673e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:06.207520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06351720-b926-4cc8-8817-3a1cce8e673e None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c/roles/21dc73c091ba46889022763efb51de4e` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:06.210993 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06351720-b926-4cc8-8817-3a1cce8e673e None admin] RBAC: Authorizing `identity:create_grant(project_id=0875194231ad4cbd89e6165cb46375c3, group_id=5a3d9e5fdef447b294ab24fc4c67ae8c, role_id=21dc73c091ba46889022763efb51de4e)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:06.213429 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06351720-b926-4cc8-8817-3a1cce8e673e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:06.290034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 205/414] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Mar 8 15:20:06 2022] PUT /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c/roles/21dc73c091ba46889022763efb51de4e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:20:06.291074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06351720-b926-4cc8-8817-3a1cce8e673e None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:06.302652 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568931d-a865-4211-b8bd-daf6fac310d1 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:06.350278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca33e0-5d41-4b9d-90d3-72837e1d32f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:06.350278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca33e0-5d41-4b9d-90d3-72837e1d32f0 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:06.350773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca33e0-5d41-4b9d-90d3-72837e1d32f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:06.350773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca33e0-5d41-4b9d-90d3-72837e1d32f0 None admin] PATH_INFO: `/v3/groups/1adcd7b01cfd4c7e9ccfc278074726cb` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:06.353294 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca33e0-5d41-4b9d-90d3-72837e1d32f0 None admin] RBAC: Authorizing `identity:get_group(group_id=1adcd7b01cfd4c7e9ccfc278074726cb)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:06.354947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca33e0-5d41-4b9d-90d3-72837e1d32f0 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:06.355884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 210/415] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:06 2022] GET /identity/v3/groups/1adcd7b01cfd4c7e9ccfc278074726cb => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:06.361710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca33e0-5d41-4b9d-90d3-72837e1d32f0 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:06.469576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06351720-b926-4cc8-8817-3a1cce8e673e None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:06.492904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca33e0-5d41-4b9d-90d3-72837e1d32f0 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:06.513974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084c2d7-dc1b-4155-9027-c665527b09f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:06.515132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084c2d7-dc1b-4155-9027-c665527b09f5 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:06.515638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084c2d7-dc1b-4155-9027-c665527b09f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:06.516579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084c2d7-dc1b-4155-9027-c665527b09f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:06.532978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084c2d7-dc1b-4155-9027-c665527b09f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:06.534910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa00c68-f885-4b7a-aabb-ce5f6da7c8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:06.535809 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa00c68-f885-4b7a-aabb-ce5f6da7c8ca None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:06.536357 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa00c68-f885-4b7a-aabb-ce5f6da7c8ca None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:06.537274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa00c68-f885-4b7a-aabb-ce5f6da7c8ca None admin] PATH_INFO: `/v3/projects/8327b1557fad4b78a6361ee1a7f6b2e4` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:06.538464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa00c68-f885-4b7a-aabb-ce5f6da7c8ca None admin] RBAC: Authorizing `identity:get_project(project_id=8327b1557fad4b78a6361ee1a7f6b2e4)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:06.539898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa00c68-f885-4b7a-aabb-ce5f6da7c8ca None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:06.542056 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 211/416] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:06 2022] GET /identity/v3/projects/8327b1557fad4b78a6361ee1a7f6b2e4 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:06.542893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-6084c2d7-dc1b-4155-9027-c665527b09f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:20:06.552326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 206/417] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:20:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:06.554604 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa00c68-f885-4b7a-aabb-ce5f6da7c8ca None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:06.555974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084c2d7-dc1b-4155-9027-c665527b09f5 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:06.658102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa00c68-f885-4b7a-aabb-ce5f6da7c8ca None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:06.665938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084c2d7-dc1b-4155-9027-c665527b09f5 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:06.693528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2857096-5f4b-458d-85f2-3409306d99a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:06.694864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2857096-5f4b-458d-85f2-3409306d99a9 None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:06.695350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2857096-5f4b-458d-85f2-3409306d99a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:06.695822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2857096-5f4b-458d-85f2-3409306d99a9 None admin] PATH_INFO: `/v3/projects/8327b1557fad4b78a6361ee1a7f6b2e4/groups/1adcd7b01cfd4c7e9ccfc278074726cb/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:06.699046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2857096-5f4b-458d-85f2-3409306d99a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8327b1557fad4b78a6361ee1a7f6b2e4, group_id=1adcd7b01cfd4c7e9ccfc278074726cb, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:06.699603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65984f30-3be6-40d2-b5a7-12f8f4267b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:06.703205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65984f30-3be6-40d2-b5a7-12f8f4267b03 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:06.703205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65984f30-3be6-40d2-b5a7-12f8f4267b03 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:06.703205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65984f30-3be6-40d2-b5a7-12f8f4267b03 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:06.703205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65984f30-3be6-40d2-b5a7-12f8f4267b03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:06.703205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65984f30-3be6-40d2-b5a7-12f8f4267b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:06.703926 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65984f30-3be6-40d2-b5a7-12f8f4267b03 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:06.705439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2857096-5f4b-458d-85f2-3409306d99a9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:06.716188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 207/418] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:06.718396 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65984f30-3be6-40d2-b5a7-12f8f4267b03 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:06.782674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 212/419] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Mar 8 15:20:06 2022] PUT /identity/v3/projects/8327b1557fad4b78a6361ee1a7f6b2e4/groups/1adcd7b01cfd4c7e9ccfc278074726cb/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:20:06.840219 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65984f30-3be6-40d2-b5a7-12f8f4267b03 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:06.876797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a820a2-073f-41f6-a896-eb61f6a76e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:06.877846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a820a2-073f-41f6-a896-eb61f6a76e99 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:06.878334 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a820a2-073f-41f6-a896-eb61f6a76e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:06.878841 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a820a2-073f-41f6-a896-eb61f6a76e99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:06.952980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a820a2-073f-41f6-a896-eb61f6a76e99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:06.954828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a820a2-073f-41f6-a896-eb61f6a76e99 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:07.058849 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 208/420] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:07.065224 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2857096-5f4b-458d-85f2-3409306d99a9 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:07.182117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2857096-5f4b-458d-85f2-3409306d99a9 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:07.217390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac33c84-48d3-4aaa-b94f-5123440ae72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:07.218550 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac33c84-48d3-4aaa-b94f-5123440ae72d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:07.218973 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac33c84-48d3-4aaa-b94f-5123440ae72d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:07.219757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac33c84-48d3-4aaa-b94f-5123440ae72d None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:07.221293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac33c84-48d3-4aaa-b94f-5123440ae72d None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:07.222994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac33c84-48d3-4aaa-b94f-5123440ae72d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:07.225205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 213/421] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:07 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:07.230931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a820a2-073f-41f6-a896-eb61f6a76e99 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:07.334286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a820a2-073f-41f6-a896-eb61f6a76e99 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:07.382341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15577e7-5595-4781-9d19-7db3bc1b80cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:07.383493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15577e7-5595-4781-9d19-7db3bc1b80cb None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:07.383923 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15577e7-5595-4781-9d19-7db3bc1b80cb None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:07.384408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15577e7-5595-4781-9d19-7db3bc1b80cb None admin] PATH_INFO: `/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:07.385763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15577e7-5595-4781-9d19-7db3bc1b80cb None admin] RBAC: Authorizing `identity:get_group(group_id=5a3d9e5fdef447b294ab24fc4c67ae8c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:07.387348 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15577e7-5595-4781-9d19-7db3bc1b80cb None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:07.389130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 209/422] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:07 2022] GET /identity/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:07.397642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac33c84-48d3-4aaa-b94f-5123440ae72d None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:07.499851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac33c84-48d3-4aaa-b94f-5123440ae72d None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:07.534639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8e2d7-9ee5-4a8e-a076-fea608102ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:07.535536 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8e2d7-9ee5-4a8e-a076-fea608102ab8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:07.535966 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8e2d7-9ee5-4a8e-a076-fea608102ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:07.536443 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8e2d7-9ee5-4a8e-a076-fea608102ab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:07.537421 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8e2d7-9ee5-4a8e-a076-fea608102ab8 None admin] RBAC: Adding query filter params (group.id=5a3d9e5fdef447b294ab24fc4c67ae8c, role.id=21dc73c091ba46889022763efb51de4e, scope.project.id=1b979e84a2154694996d7c8a5aa5afd1) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:07.537905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8e2d7-9ee5-4a8e-a076-fea608102ab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:07.539485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8e2d7-9ee5-4a8e-a076-fea608102ab8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:07.546140 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 214/423] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Mar 8 15:20:07 2022] GET /identity/v3/role_assignments?group.id=5a3d9e5fdef447b294ab24fc4c67ae8c&scope.project.id=1b979e84a2154694996d7c8a5aa5afd1&role.id=21dc73c091ba46889022763efb51de4e => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:07.573965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0766d1f-84a6-4f84-88e4-7d2335d2dce1 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:07.574481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0766d1f-84a6-4f84-88e4-7d2335d2dce1 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:07.574928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0766d1f-84a6-4f84-88e4-7d2335d2dce1 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:07.576951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 210/424] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:07.582630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee89a9-d1d6-450b-b082-47d3f75dc1c4 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:07.583127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee89a9-d1d6-450b-b082-47d3f75dc1c4 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:07.583584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee89a9-d1d6-450b-b082-47d3f75dc1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:07.601397 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-17ee89a9-d1d6-450b-b082-47d3f75dc1c4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:07.602853 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-17ee89a9-d1d6-450b-b082-47d3f75dc1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:07.676526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 215/425] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:07.711747 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0766d1f-84a6-4f84-88e4-7d2335d2dce1 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:07.854939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0766d1f-84a6-4f84-88e4-7d2335d2dce1 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:07.895001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede9cbb-28ad-408f-8c9e-d9c1bf997a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:07.895838 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede9cbb-28ad-408f-8c9e-d9c1bf997a32 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:07.896122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede9cbb-28ad-408f-8c9e-d9c1bf997a32 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:07.896436 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede9cbb-28ad-408f-8c9e-d9c1bf997a32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:07.909413 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede9cbb-28ad-408f-8c9e-d9c1bf997a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:07.916820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-2ede9cbb-28ad-408f-8c9e-d9c1bf997a32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:20:07.918359 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 211/426] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:07.923736 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee89a9-d1d6-450b-b082-47d3f75dc1c4 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:08.046161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee89a9-d1d6-450b-b082-47d3f75dc1c4 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:08.084674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c80e78-ceb9-4601-9075-df0b20a81361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:08.085423 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c80e78-ceb9-4601-9075-df0b20a81361 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:08.085614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c80e78-ceb9-4601-9075-df0b20a81361 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:08.085888 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c80e78-ceb9-4601-9075-df0b20a81361 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:08.086635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c80e78-ceb9-4601-9075-df0b20a81361 None admin] RBAC: Adding query filter params (name=member) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:08.086937 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c80e78-ceb9-4601-9075-df0b20a81361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:08.088327 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c80e78-ceb9-4601-9075-df0b20a81361 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:08.097028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 216/427] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:20:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:08.103013 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede9cbb-28ad-408f-8c9e-d9c1bf997a32 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:08.201253 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede9cbb-28ad-408f-8c9e-d9c1bf997a32 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:08.236967 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dfdbb-c895-4d0d-a1ca-1d6786ee9645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:08.237614 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dfdbb-c895-4d0d-a1ca-1d6786ee9645 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:08.237893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dfdbb-c895-4d0d-a1ca-1d6786ee9645 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:08.238167 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650dfdbb-c895-4d0d-a1ca-1d6786ee9645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:08.304657 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dfdbb-c895-4d0d-a1ca-1d6786ee9645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:08.306110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650dfdbb-c895-4d0d-a1ca-1d6786ee9645 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:08.404609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 212/428] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:08.410006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c80e78-ceb9-4601-9075-df0b20a81361 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:08.513419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c80e78-ceb9-4601-9075-df0b20a81361 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:08.546664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65260f-7b46-4acf-a8e2-7fdb8c57aa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:08.547565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65260f-7b46-4acf-a8e2-7fdb8c57aa63 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:08.547846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65260f-7b46-4acf-a8e2-7fdb8c57aa63 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:08.548117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65260f-7b46-4acf-a8e2-7fdb8c57aa63 None admin] PATH_INFO: `/v3/projects/1b979e84a2154694996d7c8a5aa5afd1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:08.549418 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65260f-7b46-4acf-a8e2-7fdb8c57aa63 None admin] RBAC: Authorizing `identity:get_project(project_id=1b979e84a2154694996d7c8a5aa5afd1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:08.550847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65260f-7b46-4acf-a8e2-7fdb8c57aa63 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:08.560477 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 217/429] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:08 2022] GET /identity/v3/projects/1b979e84a2154694996d7c8a5aa5afd1 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:08.562444 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dfdbb-c895-4d0d-a1ca-1d6786ee9645 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:08.669635 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650dfdbb-c895-4d0d-a1ca-1d6786ee9645 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:08.703615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df76c4-0194-45e8-95fa-3045c1afe469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:08.704499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df76c4-0194-45e8-95fa-3045c1afe469 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:08.704783 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df76c4-0194-45e8-95fa-3045c1afe469 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:08.705055 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df76c4-0194-45e8-95fa-3045c1afe469 None admin] PATH_INFO: `/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:08.706232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df76c4-0194-45e8-95fa-3045c1afe469 None admin] RBAC: Authorizing `identity:get_group(group_id=5a3d9e5fdef447b294ab24fc4c67ae8c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:08.707663 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df76c4-0194-45e8-95fa-3045c1afe469 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:08.710013 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 213/430] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:08 2022] GET /identity/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:08.715548 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65260f-7b46-4acf-a8e2-7fdb8c57aa63 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:08.822268 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65260f-7b46-4acf-a8e2-7fdb8c57aa63 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:08.854692 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5d417-d2e8-4e12-8c98-f83058d60ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:08.855343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5d417-d2e8-4e12-8c98-f83058d60ef3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:08.855621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5d417-d2e8-4e12-8c98-f83058d60ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:08.855892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5d417-d2e8-4e12-8c98-f83058d60ef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:08.856739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5d417-d2e8-4e12-8c98-f83058d60ef3 None admin] RBAC: Adding query filter params (group.id=5a3d9e5fdef447b294ab24fc4c67ae8c, role.id=ab135a02f63c4a138c6b116ad4f9c8d0, scope.project.id=1b979e84a2154694996d7c8a5aa5afd1) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:08.857107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5d417-d2e8-4e12-8c98-f83058d60ef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:08.858475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5d417-d2e8-4e12-8c98-f83058d60ef3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:08.865652 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 218/431] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Mar 8 15:20:08 2022] GET /identity/v3/role_assignments?group.id=5a3d9e5fdef447b294ab24fc4c67ae8c&scope.project.id=1b979e84a2154694996d7c8a5aa5afd1&role.id=ab135a02f63c4a138c6b116ad4f9c8d0 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:08.945148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724c88-7221-485d-ab61-49d989f5a28f None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:08.945431 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724c88-7221-485d-ab61-49d989f5a28f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:08.945618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23724c88-7221-485d-ab61-49d989f5a28f None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:08.947738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 214/432] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:08.953384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823ff35-dbe8-4b9c-b570-1c6b57337854 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:08.953674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823ff35-dbe8-4b9c-b570-1c6b57337854 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:08.953958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823ff35-dbe8-4b9c-b570-1c6b57337854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:08.971905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-d823ff35-dbe8-4b9c-b570-1c6b57337854 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:08.973131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d823ff35-dbe8-4b9c-b570-1c6b57337854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:09.052472 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 219/433] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:20:09.070125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23724c88-7221-485d-ab61-49d989f5a28f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:09.136442 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824370b3-b925-405d-8355-93e3ae0c37f5 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:09.137049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824370b3-b925-405d-8355-93e3ae0c37f5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:09.137049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824370b3-b925-405d-8355-93e3ae0c37f5 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:09.139089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 220/434] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:20:09.144351 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65474cd1-ec16-487f-b331-2d5d08725b62 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:09.144889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65474cd1-ec16-487f-b331-2d5d08725b62 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:09.145173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65474cd1-ec16-487f-b331-2d5d08725b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:09.167659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-65474cd1-ec16-487f-b331-2d5d08725b62 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:09.169227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-65474cd1-ec16-487f-b331-2d5d08725b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:09.184702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23724c88-7221-485d-ab61-49d989f5a28f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:09.229381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58b224-be91-4b46-9b0c-33dba6f72be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:09.230367 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58b224-be91-4b46-9b0c-33dba6f72be0 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:09.230793 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58b224-be91-4b46-9b0c-33dba6f72be0 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:09.231199 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58b224-be91-4b46-9b0c-33dba6f72be0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:09.250067 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58b224-be91-4b46-9b0c-33dba6f72be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:09.258615 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 221/435] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:09.261639 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-bf58b224-be91-4b46-9b0c-33dba6f72be0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:20:09.263895 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 215/436] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:20:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:09.269658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65474cd1-ec16-487f-b331-2d5d08725b62 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:09.285042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58b224-be91-4b46-9b0c-33dba6f72be0 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:09.390071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65474cd1-ec16-487f-b331-2d5d08725b62 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:09.417201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58b224-be91-4b46-9b0c-33dba6f72be0 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:09.425381 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3cd28-cfd1-42cc-854d-00c3ef65cb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:09.425972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3cd28-cfd1-42cc-854d-00c3ef65cb61 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:09.426302 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3cd28-cfd1-42cc-854d-00c3ef65cb61 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:09.426576 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3cd28-cfd1-42cc-854d-00c3ef65cb61 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:09.427953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3cd28-cfd1-42cc-854d-00c3ef65cb61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:09.428456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3cd28-cfd1-42cc-854d-00c3ef65cb61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:09.429840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3cd28-cfd1-42cc-854d-00c3ef65cb61 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:09.440062 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 222/437] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:09.445467 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3cd28-cfd1-42cc-854d-00c3ef65cb61 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:09.458282 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533c3c2-6cd3-48bc-a602-77d40a52b70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:09.459476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533c3c2-6cd3-48bc-a602-77d40a52b70c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:09.459952 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533c3c2-6cd3-48bc-a602-77d40a52b70c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:09.460441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533c3c2-6cd3-48bc-a602-77d40a52b70c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:09.477236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533c3c2-6cd3-48bc-a602-77d40a52b70c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:09.484302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-5533c3c2-6cd3-48bc-a602-77d40a52b70c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 15:20:09.485467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 216/438] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:09.492124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533c3c2-6cd3-48bc-a602-77d40a52b70c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:09.561161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3cd28-cfd1-42cc-854d-00c3ef65cb61 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:09.594663 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07cef6-643e-49cc-ad6c-f67c3462803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:09.595311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07cef6-643e-49cc-ad6c-f67c3462803c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:09.595590 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07cef6-643e-49cc-ad6c-f67c3462803c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:09.595864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07cef6-643e-49cc-ad6c-f67c3462803c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:09.601541 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533c3c2-6cd3-48bc-a602-77d40a52b70c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:09.632369 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc31945-8701-46e9-8427-287f81d4e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:09.633018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc31945-8701-46e9-8427-287f81d4e435 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:09.633298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc31945-8701-46e9-8427-287f81d4e435 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:09.633572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc31945-8701-46e9-8427-287f81d4e435 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:09.634296 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc31945-8701-46e9-8427-287f81d4e435 None admin] RBAC: Adding query filter params (name=member) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:09.634599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc31945-8701-46e9-8427-287f81d4e435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:09.635948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc31945-8701-46e9-8427-287f81d4e435 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:09.643467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 217/439] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:20:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:09.644741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bc2af-1b79-417e-87b2-9d7e16a39b8f None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:09.645030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bc2af-1b79-417e-87b2-9d7e16a39b8f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:09.645303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bc2af-1b79-417e-87b2-9d7e16a39b8f None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:09.647738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 218/440] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:09.649230 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bc2af-1b79-417e-87b2-9d7e16a39b8f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:09.660366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07cef6-643e-49cc-ad6c-f67c3462803c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:09.662408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07cef6-643e-49cc-ad6c-f67c3462803c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:09.741994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bc2af-1b79-417e-87b2-9d7e16a39b8f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:09.753363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 223/441] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 15:20:09.754615 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f6fd-b3cf-4814-8129-2a6f44fa3d90 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:09.754919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f6fd-b3cf-4814-8129-2a6f44fa3d90 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:09.755207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f6fd-b3cf-4814-8129-2a6f44fa3d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:09.771253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-0087f6fd-b3cf-4814-8129-2a6f44fa3d90 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:09.772437 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0087f6fd-b3cf-4814-8129-2a6f44fa3d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:09.773342 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8bcd1-54c9-4e98-9d80-b9f12a65730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:09.773971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8bcd1-54c9-4e98-9d80-b9f12a65730e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:09.774253 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8bcd1-54c9-4e98-9d80-b9f12a65730e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:09.774524 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8bcd1-54c9-4e98-9d80-b9f12a65730e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:09.833650 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 224/442] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:09.834455 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087f6fd-b3cf-4814-8129-2a6f44fa3d90 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:09.839680 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8bcd1-54c9-4e98-9d80-b9f12a65730e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:09.841152 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8bcd1-54c9-4e98-9d80-b9f12a65730e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:09.926979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087f6fd-b3cf-4814-8129-2a6f44fa3d90 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:09.932062 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 219/443] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:09.932903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8bcd1-54c9-4e98-9d80-b9f12a65730e None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:09.959243 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171be75-f1be-4726-a470-cda71d4dbb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:09.960089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171be75-f1be-4726-a470-cda71d4dbb71 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:09.960403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171be75-f1be-4726-a470-cda71d4dbb71 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:09.960676 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171be75-f1be-4726-a470-cda71d4dbb71 None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:09.961850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171be75-f1be-4726-a470-cda71d4dbb71 None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:09.963274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171be75-f1be-4726-a470-cda71d4dbb71 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:09.964950 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 225/444] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:09 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:09.965694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171be75-f1be-4726-a470-cda71d4dbb71 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:10.036581 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8bcd1-54c9-4e98-9d80-b9f12a65730e None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:10.057233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171be75-f1be-4726-a470-cda71d4dbb71 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:10.069148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b08d7-da03-4557-a946-857faf39e8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:10.069924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b08d7-da03-4557-a946-857faf39e8b5 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:10.070205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b08d7-da03-4557-a946-857faf39e8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:10.070475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b08d7-da03-4557-a946-857faf39e8b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:10.080030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b08d7-da03-4557-a946-857faf39e8b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:10.087315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-543b08d7-da03-4557-a946-857faf39e8b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:20:10.088506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 220/445] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:10.089261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b08d7-da03-4557-a946-857faf39e8b5 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:10.095061 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13a57b-b777-4d0c-a9ee-be7f57fbc3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:10.095929 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13a57b-b777-4d0c-a9ee-be7f57fbc3cb None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:10.096231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13a57b-b777-4d0c-a9ee-be7f57fbc3cb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:10.096508 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13a57b-b777-4d0c-a9ee-be7f57fbc3cb None admin] PATH_INFO: `/v3/projects/0875194231ad4cbd89e6165cb46375c3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:10.097686 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13a57b-b777-4d0c-a9ee-be7f57fbc3cb None admin] RBAC: Authorizing `identity:get_project(project_id=0875194231ad4cbd89e6165cb46375c3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:10.099127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13a57b-b777-4d0c-a9ee-be7f57fbc3cb None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:10.101198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 226/446] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:09 2022] GET /identity/v3/projects/0875194231ad4cbd89e6165cb46375c3 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:10.102155 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13a57b-b777-4d0c-a9ee-be7f57fbc3cb None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:10.185004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b08d7-da03-4557-a946-857faf39e8b5 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:10.197044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13a57b-b777-4d0c-a9ee-be7f57fbc3cb None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:10.216944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbed81-03ce-4d99-8bd9-d6dcdff51d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:10.217779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbed81-03ce-4d99-8bd9-d6dcdff51d7b None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:10.218067 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbed81-03ce-4d99-8bd9-d6dcdff51d7b None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:10.218344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbed81-03ce-4d99-8bd9-d6dcdff51d7b None admin] PATH_INFO: `/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:10.219527 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbed81-03ce-4d99-8bd9-d6dcdff51d7b None admin] RBAC: Authorizing `identity:get_group(group_id=5a3d9e5fdef447b294ab24fc4c67ae8c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:10.220988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbed81-03ce-4d99-8bd9-d6dcdff51d7b None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:10.223581 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 221/447] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:10 2022] GET /identity/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:10.223581 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbed81-03ce-4d99-8bd9-d6dcdff51d7b None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:10.229316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5eade-ce9e-4054-99bc-60c4f86ce3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:10.229971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5eade-ce9e-4054-99bc-60c4f86ce3f0 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:10.230257 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5eade-ce9e-4054-99bc-60c4f86ce3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:10.230530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5eade-ce9e-4054-99bc-60c4f86ce3f0 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:10.231269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5eade-ce9e-4054-99bc-60c4f86ce3f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:10.231570 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5eade-ce9e-4054-99bc-60c4f86ce3f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:10.232953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5eade-ce9e-4054-99bc-60c4f86ce3f0 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:10.241508 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 227/448] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:10.241508 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5eade-ce9e-4054-99bc-60c4f86ce3f0 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:10.318540 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbed81-03ce-4d99-8bd9-d6dcdff51d7b None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:10.333592 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5eade-ce9e-4054-99bc-60c4f86ce3f0 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:10.348874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f5844-ecf4-47f8-bb64-ec317b3bf980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:10.349707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f5844-ecf4-47f8-bb64-ec317b3bf980 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:10.349987 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f5844-ecf4-47f8-bb64-ec317b3bf980 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:10.350260 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f5844-ecf4-47f8-bb64-ec317b3bf980 None admin] PATH_INFO: `/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:10.351421 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f5844-ecf4-47f8-bb64-ec317b3bf980 None admin] RBAC: Authorizing `identity:get_group(group_id=5a3d9e5fdef447b294ab24fc4c67ae8c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:10.352974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f5844-ecf4-47f8-bb64-ec317b3bf980 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:10.354559 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 222/449] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:10 2022] GET /identity/v3/groups/5a3d9e5fdef447b294ab24fc4c67ae8c => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:10.355317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f5844-ecf4-47f8-bb64-ec317b3bf980 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:10.365811 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8d3a1-e8c4-408b-a05c-2b72f1cb6d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:10.366459 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8d3a1-e8c4-408b-a05c-2b72f1cb6d75 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:10.366745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8d3a1-e8c4-408b-a05c-2b72f1cb6d75 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:10.367024 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8d3a1-e8c4-408b-a05c-2b72f1cb6d75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:10.367846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8d3a1-e8c4-408b-a05c-2b72f1cb6d75 None admin] RBAC: Adding query filter params (group.id=5a3d9e5fdef447b294ab24fc4c67ae8c, role.id=21dc73c091ba46889022763efb51de4e, scope.project.id=0875194231ad4cbd89e6165cb46375c3) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:10.368182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8d3a1-e8c4-408b-a05c-2b72f1cb6d75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:10.369651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8d3a1-e8c4-408b-a05c-2b72f1cb6d75 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:10.375567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 228/450] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Mar 8 15:20:10 2022] GET /identity/v3/role_assignments?group.id=5a3d9e5fdef447b294ab24fc4c67ae8c&scope.project.id=0875194231ad4cbd89e6165cb46375c3&role.id=21dc73c091ba46889022763efb51de4e => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:10.376377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8d3a1-e8c4-408b-a05c-2b72f1cb6d75 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:10.460593 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f5844-ecf4-47f8-bb64-ec317b3bf980 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:10.482350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8d3a1-e8c4-408b-a05c-2b72f1cb6d75 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:10.495791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62ce66-8d9d-417d-9d05-3b50434db9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:10.496490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62ce66-8d9d-417d-9d05-3b50434db9a8 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:10.496775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62ce66-8d9d-417d-9d05-3b50434db9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:10.497053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62ce66-8d9d-417d-9d05-3b50434db9a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:10.521121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c3c84-d8c5-4aa6-8e6c-8e4faa0f11e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:10.521788 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c3c84-d8c5-4aa6-8e6c-8e4faa0f11e2 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:10.522071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c3c84-d8c5-4aa6-8e6c-8e4faa0f11e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:10.522348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c3c84-d8c5-4aa6-8e6c-8e4faa0f11e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:10.523188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c3c84-d8c5-4aa6-8e6c-8e4faa0f11e2 None admin] RBAC: Adding query filter params (group.id=5a3d9e5fdef447b294ab24fc4c67ae8c, role.id=ab135a02f63c4a138c6b116ad4f9c8d0, scope.project.id=0875194231ad4cbd89e6165cb46375c3) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:10.523500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c3c84-d8c5-4aa6-8e6c-8e4faa0f11e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:10.525009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c3c84-d8c5-4aa6-8e6c-8e4faa0f11e2 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:10.540679 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 229/451] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Mar 8 15:20:10 2022] GET /identity/v3/role_assignments?group.id=5a3d9e5fdef447b294ab24fc4c67ae8c&scope.project.id=0875194231ad4cbd89e6165cb46375c3&role.id=ab135a02f63c4a138c6b116ad4f9c8d0 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:10.573280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62ce66-8d9d-417d-9d05-3b50434db9a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:10.574677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62ce66-8d9d-417d-9d05-3b50434db9a8 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:10.680335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 223/452] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:10.686471 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c3c84-d8c5-4aa6-8e6c-8e4faa0f11e2 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:10.787917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c3c84-d8c5-4aa6-8e6c-8e4faa0f11e2 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:10.820313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b8f0c-1a5d-45f8-b155-dcc6d4d5940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:10.821179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b8f0c-1a5d-45f8-b155-dcc6d4d5940c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:10.821458 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b8f0c-1a5d-45f8-b155-dcc6d4d5940c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:10.821731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b8f0c-1a5d-45f8-b155-dcc6d4d5940c None admin] PATH_INFO: `/v3/projects/8327b1557fad4b78a6361ee1a7f6b2e4` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:10.822916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b8f0c-1a5d-45f8-b155-dcc6d4d5940c None admin] RBAC: Authorizing `identity:get_project(project_id=8327b1557fad4b78a6361ee1a7f6b2e4)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:10.824425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b8f0c-1a5d-45f8-b155-dcc6d4d5940c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:10.826052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 230/453] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:20:10 2022] GET /identity/v3/projects/8327b1557fad4b78a6361ee1a7f6b2e4 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:10.831732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62ce66-8d9d-417d-9d05-3b50434db9a8 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:10.928347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62ce66-8d9d-417d-9d05-3b50434db9a8 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:10.960880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e1298-0830-4cef-aa07-441c1919bbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:10.961724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e1298-0830-4cef-aa07-441c1919bbca None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:10.962007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e1298-0830-4cef-aa07-441c1919bbca None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:10.962281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e1298-0830-4cef-aa07-441c1919bbca None admin] PATH_INFO: `/v3/groups/1adcd7b01cfd4c7e9ccfc278074726cb` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:10.963444 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e1298-0830-4cef-aa07-441c1919bbca None admin] RBAC: Authorizing `identity:get_group(group_id=1adcd7b01cfd4c7e9ccfc278074726cb)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:10.964903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e1298-0830-4cef-aa07-441c1919bbca None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:10.966488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 224/454] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Mar 8 15:20:10 2022] GET /identity/v3/groups/1adcd7b01cfd4c7e9ccfc278074726cb => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:10.972378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b8f0c-1a5d-45f8-b155-dcc6d4d5940c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:11.072561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b8f0c-1a5d-45f8-b155-dcc6d4d5940c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:11.104213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cfd2a-bd9c-46a6-8d65-4bf9ed0c2904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:11.104798 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cfd2a-bd9c-46a6-8d65-4bf9ed0c2904 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:11.105078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cfd2a-bd9c-46a6-8d65-4bf9ed0c2904 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:11.105351 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cfd2a-bd9c-46a6-8d65-4bf9ed0c2904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:11.106160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cfd2a-bd9c-46a6-8d65-4bf9ed0c2904 None admin] RBAC: Adding query filter params (group.id=1adcd7b01cfd4c7e9ccfc278074726cb, role.id=24a7898c863141f1911792647b5274e3, scope.project.id=8327b1557fad4b78a6361ee1a7f6b2e4) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:11.106469 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cfd2a-bd9c-46a6-8d65-4bf9ed0c2904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:11.107891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cfd2a-bd9c-46a6-8d65-4bf9ed0c2904 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:11.113384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 231/455] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Mar 8 15:20:10 2022] GET /identity/v3/role_assignments?group.id=1adcd7b01cfd4c7e9ccfc278074726cb&scope.project.id=8327b1557fad4b78a6361ee1a7f6b2e4&role.id=24a7898c863141f1911792647b5274e3 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:13.816067 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bb698-e86b-46e0-8764-4cee16dfdf8d None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:13.817631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bb698-e86b-46e0-8764-4cee16dfdf8d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:13.818116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bb698-e86b-46e0-8764-4cee16dfdf8d None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:13.820316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 225/456] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:13.826114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166bcfb-4502-408f-b4ec-b99d5ef68024 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:13.826984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166bcfb-4502-408f-b4ec-b99d5ef68024 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:13.827453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166bcfb-4502-408f-b4ec-b99d5ef68024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:13.853181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-5166bcfb-4502-408f-b4ec-b99d5ef68024 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:13.854688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-5166bcfb-4502-408f-b4ec-b99d5ef68024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:13.944967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 232/457] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:20:13.947591 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2825e5-95c6-4fff-8447-e9b771b8f410 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:13.948096 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2825e5-95c6-4fff-8447-e9b771b8f410 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:13.948594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2825e5-95c6-4fff-8447-e9b771b8f410 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:13.950535 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 226/458] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:13.955949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9662a0c-c95e-4e1e-bc2f-e04a236bae2e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:13.956486 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9662a0c-c95e-4e1e-bc2f-e04a236bae2e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:13.956976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9662a0c-c95e-4e1e-bc2f-e04a236bae2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:13.981095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b9662a0c-c95e-4e1e-bc2f-e04a236bae2e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:13.982595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b9662a0c-c95e-4e1e-bc2f-e04a236bae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:14.042070 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2825e5-95c6-4fff-8447-e9b771b8f410 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:14.064107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 233/459] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:14.117641 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9662a0c-c95e-4e1e-bc2f-e04a236bae2e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:14.237926 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2825e5-95c6-4fff-8447-e9b771b8f410 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:14.259725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9662a0c-c95e-4e1e-bc2f-e04a236bae2e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:14.304581 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3038-39bc-4fd8-aec4-6f209376cf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:14.306704 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3038-39bc-4fd8-aec4-6f209376cf59 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:14.307814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3038-39bc-4fd8-aec4-6f209376cf59 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:14.308311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3038-39bc-4fd8-aec4-6f209376cf59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:14.323884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456269e-f142-4452-a120-00ceff13ac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:14.325035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456269e-f142-4452-a120-00ceff13ac12 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:14.325518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456269e-f142-4452-a120-00ceff13ac12 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:14.325984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456269e-f142-4452-a120-00ceff13ac12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:14.327742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f3038-39bc-4fd8-aec4-6f209376cf59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:14.330468 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f3038-39bc-4fd8-aec4-6f209376cf59 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:14.346528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456269e-f142-4452-a120-00ceff13ac12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:14.349227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456269e-f142-4452-a120-00ceff13ac12 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:14.362213 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-ec1f3038-39bc-4fd8-aec4-6f209376cf59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:14.364801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 227/460] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:14.370679 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3038-39bc-4fd8-aec4-6f209376cf59 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:14.386868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-1456269e-f142-4452-a120-00ceff13ac12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:14.392298 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 234/461] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:14.405884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456269e-f142-4452-a120-00ceff13ac12 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:14.533688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3038-39bc-4fd8-aec4-6f209376cf59 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:14.579794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456269e-f142-4452-a120-00ceff13ac12 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:14.595280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84dd49-52f5-48d8-b13e-90661ad192a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:14.595947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84dd49-52f5-48d8-b13e-90661ad192a1 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:14.596248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84dd49-52f5-48d8-b13e-90661ad192a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:14.596520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84dd49-52f5-48d8-b13e-90661ad192a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:14.597237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84dd49-52f5-48d8-b13e-90661ad192a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:14.597697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84dd49-52f5-48d8-b13e-90661ad192a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:14.599764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84dd49-52f5-48d8-b13e-90661ad192a1 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:14.614848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 228/462] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:14.616907 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff38203-c3ae-4a79-82d5-f46e7320c749 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:14.617457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff38203-c3ae-4a79-82d5-f46e7320c749 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:14.617960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff38203-c3ae-4a79-82d5-f46e7320c749 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:14.620233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 229/463] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:14.621535 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebfc5b-5e7a-485a-bf77-1cd7eca68772 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:14.621958 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebfc5b-5e7a-485a-bf77-1cd7eca68772 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:14.622066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0beb6-dfc8-45ff-b9cd-a77df808f59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:14.622478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebfc5b-5e7a-485a-bf77-1cd7eca68772 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:14.622726 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0beb6-dfc8-45ff-b9cd-a77df808f59e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:14.623011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0beb6-dfc8-45ff-b9cd-a77df808f59e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:14.623284 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0beb6-dfc8-45ff-b9cd-a77df808f59e None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:14.624008 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0beb6-dfc8-45ff-b9cd-a77df808f59e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:14.624343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0beb6-dfc8-45ff-b9cd-a77df808f59e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:14.625189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 230/464] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:14.626012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebfc5b-5e7a-485a-bf77-1cd7eca68772 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:14.629308 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0beb6-dfc8-45ff-b9cd-a77df808f59e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:14.640565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 235/465] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:14.641863 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca171af-2840-4b5c-90c0-8117cef96e10 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:14.642156 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca171af-2840-4b5c-90c0-8117cef96e10 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:14.642437 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca171af-2840-4b5c-90c0-8117cef96e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:14.658700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-aca171af-2840-4b5c-90c0-8117cef96e10 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:14.659897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-aca171af-2840-4b5c-90c0-8117cef96e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:14.730143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebfc5b-5e7a-485a-bf77-1cd7eca68772 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:14.732312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 236/466] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:14.733638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1b6b4-8707-4171-8474-2eba8d1c38ac None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:14.733923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1b6b4-8707-4171-8474-2eba8d1c38ac None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:14.734192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1b6b4-8707-4171-8474-2eba8d1c38ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:14.757024 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-fbc1b6b4-8707-4171-8474-2eba8d1c38ac None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:14.758200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-fbc1b6b4-8707-4171-8474-2eba8d1c38ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:14.772919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4dcb6-4176-4480-bdca-0c969d45fc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:14.773845 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4dcb6-4176-4480-bdca-0c969d45fc50 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:14.774129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4dcb6-4176-4480-bdca-0c969d45fc50 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:14.774405 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4dcb6-4176-4480-bdca-0c969d45fc50 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:14.775539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4dcb6-4176-4480-bdca-0c969d45fc50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:14.777004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4dcb6-4176-4480-bdca-0c969d45fc50 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:14.822289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 237/467] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:14.823107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1b6b4-8707-4171-8474-2eba8d1c38ac None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:14.896379 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 231/468] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:20:14 2022] POST /identity/v3/users => generated 246 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:20:14.897772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4dcb6-4176-4480-bdca-0c969d45fc50 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:14.933081 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1b6b4-8707-4171-8474-2eba8d1c38ac None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:14.970398 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f6eb-99b1-4d40-87b6-34d3d00574e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:14.971389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f6eb-99b1-4d40-87b6-34d3d00574e9 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:14.971892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f6eb-99b1-4d40-87b6-34d3d00574e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:14.972376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8f6eb-99b1-4d40-87b6-34d3d00574e9 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:14.973326 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8f6eb-99b1-4d40-87b6-34d3d00574e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:14.975714 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8f6eb-99b1-4d40-87b6-34d3d00574e9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:15.008685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4dcb6-4176-4480-bdca-0c969d45fc50 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:15.044501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9b821-0963-4275-94e0-1d93517dca1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:15.045304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9b821-0963-4275-94e0-1d93517dca1c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:15.045586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9b821-0963-4275-94e0-1d93517dca1c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:15.045857 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9b821-0963-4275-94e0-1d93517dca1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:15.057878 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9b821-0963-4275-94e0-1d93517dca1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:15.059236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9b821-0963-4275-94e0-1d93517dca1c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:15.068703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 238/469] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:20:14 2022] POST /identity/v3/users => generated 248 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:20:15.070067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f6eb-99b1-4d40-87b6-34d3d00574e9 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:15.080215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-65b9b821-0963-4275-94e0-1d93517dca1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:15.080215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 232/470] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:15.088966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9b821-0963-4275-94e0-1d93517dca1c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:15.207735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9b821-0963-4275-94e0-1d93517dca1c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:15.220382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8f6eb-99b1-4d40-87b6-34d3d00574e9 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:15.248871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c102b-0a78-409c-9ef0-e94aefb0f75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:15.248871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c102b-0a78-409c-9ef0-e94aefb0f75e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:15.249198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c102b-0a78-409c-9ef0-e94aefb0f75e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:15.249445 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c102b-0a78-409c-9ef0-e94aefb0f75e None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:15.250124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c102b-0a78-409c-9ef0-e94aefb0f75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:15.250427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c102b-0a78-409c-9ef0-e94aefb0f75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:15.253021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c102b-0a78-409c-9ef0-e94aefb0f75e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:15.265821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 233/471] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:15.267003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209166a-5fe3-4c5f-b1e1-af74eec68671 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:15.267293 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209166a-5fe3-4c5f-b1e1-af74eec68671 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:15.267570 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209166a-5fe3-4c5f-b1e1-af74eec68671 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:15.271547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 234/472] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:15.272556 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209166a-5fe3-4c5f-b1e1-af74eec68671 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:15.278911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91bc0a-9705-49f6-ad55-a77f0943e28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:15.279707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91bc0a-9705-49f6-ad55-a77f0943e28d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:15.279986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91bc0a-9705-49f6-ad55-a77f0943e28d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:15.280288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91bc0a-9705-49f6-ad55-a77f0943e28d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:15.292675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91bc0a-9705-49f6-ad55-a77f0943e28d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:15.294418 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91bc0a-9705-49f6-ad55-a77f0943e28d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:15.312419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-ce91bc0a-9705-49f6-ad55-a77f0943e28d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:15.313631 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 239/473] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:15.319797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6e73d-9d73-4b32-8c72-837abb2d00e2 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:15.320093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6e73d-9d73-4b32-8c72-837abb2d00e2 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:15.320421 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6e73d-9d73-4b32-8c72-837abb2d00e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:15.342419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-f6f6e73d-9d73-4b32-8c72-837abb2d00e2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:15.344785 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f6f6e73d-9d73-4b32-8c72-837abb2d00e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:15.391256 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209166a-5fe3-4c5f-b1e1-af74eec68671 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:15.424618 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 240/474] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:15.425273 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6e73d-9d73-4b32-8c72-837abb2d00e2 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:15.432659 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb7bee-1d68-49a7-91a2-54b0204aa1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:15.433326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb7bee-1d68-49a7-91a2-54b0204aa1b3 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:15.433668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb7bee-1d68-49a7-91a2-54b0204aa1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:15.434002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb7bee-1d68-49a7-91a2-54b0204aa1b3 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:15.434726 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb7bee-1d68-49a7-91a2-54b0204aa1b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:15.436319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb7bee-1d68-49a7-91a2-54b0204aa1b3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:15.530365 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6e73d-9d73-4b32-8c72-837abb2d00e2 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:15.544181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 235/475] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:20:15 2022] POST /identity/v3/users => generated 249 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:20:15.544181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb7bee-1d68-49a7-91a2-54b0204aa1b3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:15.603100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9141534-f991-4cf2-b9ef-ab477fc3ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:15.603779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9141534-f991-4cf2-b9ef-ab477fc3ca7b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:15.604060 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9141534-f991-4cf2-b9ef-ab477fc3ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:15.604362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9141534-f991-4cf2-b9ef-ab477fc3ca7b None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:15.605095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9141534-f991-4cf2-b9ef-ab477fc3ca7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:15.607041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9141534-f991-4cf2-b9ef-ab477fc3ca7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:15.608604 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9141534-f991-4cf2-b9ef-ab477fc3ca7b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:15.641282 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 241/476] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:15.658431 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9141534-f991-4cf2-b9ef-ab477fc3ca7b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:15.755772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb7bee-1d68-49a7-91a2-54b0204aa1b3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:15.794627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4813f3-b8af-4693-95b5-73200f1c3a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:15.795640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4813f3-b8af-4693-95b5-73200f1c3a76 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:15.796125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4813f3-b8af-4693-95b5-73200f1c3a76 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:15.796632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4813f3-b8af-4693-95b5-73200f1c3a76 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:15.797595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4813f3-b8af-4693-95b5-73200f1c3a76 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:15.799243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4813f3-b8af-4693-95b5-73200f1c3a76 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:15.803670 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9141534-f991-4cf2-b9ef-ab477fc3ca7b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:15.838589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.sql.core [None req-7f4813f3-b8af-4693-95b5-73200f1c3a76 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 08 15:20:15.838589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 08 15:20:15.838589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [parameters: {'id': 'ce2c9834dc844f77b459093bbd6b4843', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 08 15:20:15.838589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79756) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 15:20:15.840600 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c1762-cf73-4676-8c53-bc816506ccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:15.841550 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c1762-cf73-4676-8c53-bc816506ccd0 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:15.842025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c1762-cf73-4676-8c53-bc816506ccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:15.842583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c1762-cf73-4676-8c53-bc816506ccd0 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:15.843555 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c1762-cf73-4676-8c53-bc816506ccd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:15.846164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c1762-cf73-4676-8c53-bc816506ccd0 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:15.853683 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-7f4813f3-b8af-4693-95b5-73200f1c3a76 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 08 15:20:15.855438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 236/477] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Mar 8 15:20:15 2022] POST /identity/v3/roles => generated 144 bytes in 314 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:15.861228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4813f3-b8af-4693-95b5-73200f1c3a76 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:15.932086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 242/478] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:20:15 2022] POST /identity/v3/users => generated 248 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:20:15.972832 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4813f3-b8af-4693-95b5-73200f1c3a76 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:16.015088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f4376-fcac-4507-bbd2-6dee2ebe1e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:16.016012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f4376-fcac-4507-bbd2-6dee2ebe1e48 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:16.016357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f4376-fcac-4507-bbd2-6dee2ebe1e48 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:16.016638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f4376-fcac-4507-bbd2-6dee2ebe1e48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:16.029059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f4376-fcac-4507-bbd2-6dee2ebe1e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:16.037955 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-562f4376-fcac-4507-bbd2-6dee2ebe1e48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 15:20:16.039227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 237/479] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:20:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:16.045328 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c1762-cf73-4676-8c53-bc816506ccd0 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:16.207366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c1762-cf73-4676-8c53-bc816506ccd0 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:16.241962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22642ca6-71ad-46d7-a2b9-8e9f55c88f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:16.242632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22642ca6-71ad-46d7-a2b9-8e9f55c88f5d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:16.242910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22642ca6-71ad-46d7-a2b9-8e9f55c88f5d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:16.243185 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22642ca6-71ad-46d7-a2b9-8e9f55c88f5d None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:16.243929 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22642ca6-71ad-46d7-a2b9-8e9f55c88f5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:16.244263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22642ca6-71ad-46d7-a2b9-8e9f55c88f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:16.245633 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22642ca6-71ad-46d7-a2b9-8e9f55c88f5d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:16.254527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 243/480] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:17.713810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da504e-c386-4189-b986-6e006e9d5591 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:17.714330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da504e-c386-4189-b986-6e006e9d5591 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:17.714589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da504e-c386-4189-b986-6e006e9d5591 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:17.716694 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 238/481] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:17.721961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496e15-3d44-4e11-b1f5-f7b10a97239f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:17.722394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496e15-3d44-4e11-b1f5-f7b10a97239f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:17.722563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496e15-3d44-4e11-b1f5-f7b10a97239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:17.749186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-36496e15-3d44-4e11-b1f5-f7b10a97239f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:17.750453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-36496e15-3d44-4e11-b1f5-f7b10a97239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:17.842451 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 244/482] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:17.895592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da504e-c386-4189-b986-6e006e9d5591 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:17.968737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bdb33-4b20-4103-b548-0229239c4d31 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:17.969028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bdb33-4b20-4103-b548-0229239c4d31 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:17.969225 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bdb33-4b20-4103-b548-0229239c4d31 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:17.971249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 245/483] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:17.977201 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcecc31-5269-4d0f-9e15-5ef6da701279 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:17.977480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcecc31-5269-4d0f-9e15-5ef6da701279 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:17.977747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcecc31-5269-4d0f-9e15-5ef6da701279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:18.009167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ddcecc31-5269-4d0f-9e15-5ef6da701279 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:18.010356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ddcecc31-5269-4d0f-9e15-5ef6da701279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:18.025674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da504e-c386-4189-b986-6e006e9d5591 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:18.087300 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1fa4-9bf7-4e0e-b8cf-c31760fd5277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:18.088092 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1fa4-9bf7-4e0e-b8cf-c31760fd5277 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:18.088398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1fa4-9bf7-4e0e-b8cf-c31760fd5277 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:18.088671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1fa4-9bf7-4e0e-b8cf-c31760fd5277 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:18.103393 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b1fa4-9bf7-4e0e-b8cf-c31760fd5277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:18.110235 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-5b6b1fa4-9bf7-4e0e-b8cf-c31760fd5277 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:18.111825 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 239/484] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:18.117684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1fa4-9bf7-4e0e-b8cf-c31760fd5277 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:18.143905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 246/485] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:18.184587 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcecc31-5269-4d0f-9e15-5ef6da701279 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:18.294787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1fa4-9bf7-4e0e-b8cf-c31760fd5277 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:18.335006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcecc31-5269-4d0f-9e15-5ef6da701279 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:18.340495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e04a5f-1b58-4360-9fce-e9dc91f11db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:18.341281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e04a5f-1b58-4360-9fce-e9dc91f11db3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:18.341665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e04a5f-1b58-4360-9fce-e9dc91f11db3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:18.342066 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e04a5f-1b58-4360-9fce-e9dc91f11db3 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:18.342926 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e04a5f-1b58-4360-9fce-e9dc91f11db3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:18.343765 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e04a5f-1b58-4360-9fce-e9dc91f11db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:18.345308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e04a5f-1b58-4360-9fce-e9dc91f11db3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:18.354329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 240/486] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:18.355978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651892e1-3763-43c3-8924-525590b0c557 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:18.360432 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651892e1-3763-43c3-8924-525590b0c557 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:18.360935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651892e1-3763-43c3-8924-525590b0c557 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:18.363056 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 241/487] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:18.364345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651892e1-3763-43c3-8924-525590b0c557 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:18.384496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445672c-a00a-4bf5-8afb-a5b11d2a6b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:18.385594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445672c-a00a-4bf5-8afb-a5b11d2a6b71 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:18.385884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445672c-a00a-4bf5-8afb-a5b11d2a6b71 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:18.386161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445672c-a00a-4bf5-8afb-a5b11d2a6b71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:18.399595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445672c-a00a-4bf5-8afb-a5b11d2a6b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:18.408060 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-2445672c-a00a-4bf5-8afb-a5b11d2a6b71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:18.414194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 247/488] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:18.414194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b737ad-af60-4908-8ed3-4ddda1fa5f60 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:18.414194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b737ad-af60-4908-8ed3-4ddda1fa5f60 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:18.414194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b737ad-af60-4908-8ed3-4ddda1fa5f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:18.431056 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-29b737ad-af60-4908-8ed3-4ddda1fa5f60 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:18.432750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-29b737ad-af60-4908-8ed3-4ddda1fa5f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:18.483950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651892e1-3763-43c3-8924-525590b0c557 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:18.523507 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 248/489] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:18.524500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b737ad-af60-4908-8ed3-4ddda1fa5f60 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:18.534629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5d9df-7418-4fdf-8904-9fec936fdd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:18.534629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5d9df-7418-4fdf-8904-9fec936fdd8e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:18.534629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5d9df-7418-4fdf-8904-9fec936fdd8e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:18.534629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5d9df-7418-4fdf-8904-9fec936fdd8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:18.558310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5d9df-7418-4fdf-8904-9fec936fdd8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:18.558310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5d9df-7418-4fdf-8904-9fec936fdd8e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:18.575262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-8be5d9df-7418-4fdf-8904-9fec936fdd8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:18.576935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 242/490] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:18.580610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5d9df-7418-4fdf-8904-9fec936fdd8e None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:18.703410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b737ad-af60-4908-8ed3-4ddda1fa5f60 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:18.738281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc25a1-b9c8-46d4-97ef-2d463b0ddcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:18.739866 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc25a1-b9c8-46d4-97ef-2d463b0ddcc8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:18.744178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc25a1-b9c8-46d4-97ef-2d463b0ddcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:18.744178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc25a1-b9c8-46d4-97ef-2d463b0ddcc8 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:18.744178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc25a1-b9c8-46d4-97ef-2d463b0ddcc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:18.744178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc25a1-b9c8-46d4-97ef-2d463b0ddcc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:18.744178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc25a1-b9c8-46d4-97ef-2d463b0ddcc8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:18.751661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 249/491] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:18.752331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc25a1-b9c8-46d4-97ef-2d463b0ddcc8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:18.782536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5d9df-7418-4fdf-8904-9fec936fdd8e None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:18.819291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e83b46-eae0-4bc6-b8fb-41b9982ea65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:18.820011 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e83b46-eae0-4bc6-b8fb-41b9982ea65a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:18.820441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e83b46-eae0-4bc6-b8fb-41b9982ea65a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:18.820727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e83b46-eae0-4bc6-b8fb-41b9982ea65a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:18.834006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e83b46-eae0-4bc6-b8fb-41b9982ea65a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:18.843235 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-15e83b46-eae0-4bc6-b8fb-41b9982ea65a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:18.848258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 243/492] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:18.849252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e83b46-eae0-4bc6-b8fb-41b9982ea65a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:18.863055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc25a1-b9c8-46d4-97ef-2d463b0ddcc8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:18.900996 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e034070-bb60-4e69-b64c-5e50b013dc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:18.901655 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e034070-bb60-4e69-b64c-5e50b013dc7b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:18.902303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e034070-bb60-4e69-b64c-5e50b013dc7b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:18.902581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e034070-bb60-4e69-b64c-5e50b013dc7b None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:18.903349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e034070-bb60-4e69-b64c-5e50b013dc7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:18.903715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e034070-bb60-4e69-b64c-5e50b013dc7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:18.905224 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e034070-bb60-4e69-b64c-5e50b013dc7b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:18.918280 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 250/493] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:18.923599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e034070-bb60-4e69-b64c-5e50b013dc7b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:18.981352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e83b46-eae0-4bc6-b8fb-41b9982ea65a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:19.014030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336543-fdd4-4be4-966f-1610515f3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:19.015119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336543-fdd4-4be4-966f-1610515f3194 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.015595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336543-fdd4-4be4-966f-1610515f3194 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.016059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336543-fdd4-4be4-966f-1610515f3194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.028133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336543-fdd4-4be4-966f-1610515f3194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:19.029609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05336543-fdd4-4be4-966f-1610515f3194 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:19.045579 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e034070-bb60-4e69-b64c-5e50b013dc7b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:19.045808 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-05336543-fdd4-4be4-966f-1610515f3194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:19.046948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 244/494] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:19.047717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336543-fdd4-4be4-966f-1610515f3194 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:19.083166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f6ca2-81a7-47d0-b580-2e214679ad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:19.083747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f6ca2-81a7-47d0-b580-2e214679ad67 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.084021 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f6ca2-81a7-47d0-b580-2e214679ad67 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.084397 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f6ca2-81a7-47d0-b580-2e214679ad67 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.085149 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f6ca2-81a7-47d0-b580-2e214679ad67 None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:19.085449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f6ca2-81a7-47d0-b580-2e214679ad67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:19.086813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f6ca2-81a7-47d0-b580-2e214679ad67 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:19.094636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 251/495] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:19.095972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42898b-fc24-42b9-90e4-5c9c48326ffb None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.096289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42898b-fc24-42b9-90e4-5c9c48326ffb None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.096567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42898b-fc24-42b9-90e4-5c9c48326ffb None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.102848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 252/496] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:19.103662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42898b-fc24-42b9-90e4-5c9c48326ffb None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:19.153518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336543-fdd4-4be4-966f-1610515f3194 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:19.186716 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25d135-bc83-4483-a466-898bb301b059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:19.187511 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25d135-bc83-4483-a466-898bb301b059 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.187795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25d135-bc83-4483-a466-898bb301b059 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.188077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25d135-bc83-4483-a466-898bb301b059 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.195682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25d135-bc83-4483-a466-898bb301b059 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:19.197167 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25d135-bc83-4483-a466-898bb301b059 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:19.202984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42898b-fc24-42b9-90e4-5c9c48326ffb None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:19.210226 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-3d25d135-bc83-4483-a466-898bb301b059 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 15:20:19.215939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 245/497] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:19.216540 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25d135-bc83-4483-a466-898bb301b059 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:19.235719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eac5cd-22bf-4359-a1d1-848485a67ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:19.236430 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eac5cd-22bf-4359-a1d1-848485a67ba1 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.236720 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eac5cd-22bf-4359-a1d1-848485a67ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.237001 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eac5cd-22bf-4359-a1d1-848485a67ba1 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.237725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eac5cd-22bf-4359-a1d1-848485a67ba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:19.238038 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eac5cd-22bf-4359-a1d1-848485a67ba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:19.240248 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eac5cd-22bf-4359-a1d1-848485a67ba1 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:19.251561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 253/498] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:19.252775 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fab271-8466-48a8-b278-7ad1ec0d92ad None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.253068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fab271-8466-48a8-b278-7ad1ec0d92ad None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.253349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fab271-8466-48a8-b278-7ad1ec0d92ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.270544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-03fab271-8466-48a8-b278-7ad1ec0d92ad None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:19.271704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-03fab271-8466-48a8-b278-7ad1ec0d92ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:19.310538 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25d135-bc83-4483-a466-898bb301b059 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:19.331948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 254/499] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:19.333439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fab271-8466-48a8-b278-7ad1ec0d92ad None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:19.350502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983d430-7088-496d-bc3f-3107fdf407b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:19.351289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983d430-7088-496d-bc3f-3107fdf407b6 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.351576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983d430-7088-496d-bc3f-3107fdf407b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.351857 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983d430-7088-496d-bc3f-3107fdf407b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.362499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983d430-7088-496d-bc3f-3107fdf407b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:19.364315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983d430-7088-496d-bc3f-3107fdf407b6 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:19.379853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-0983d430-7088-496d-bc3f-3107fdf407b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:19.381033 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 246/500] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:19.382270 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5366159-7b7f-4a35-aebb-cbe7471f744a None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.382555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5366159-7b7f-4a35-aebb-cbe7471f744a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.382831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5366159-7b7f-4a35-aebb-cbe7471f744a None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.384487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 247/501] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:19.385442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5366159-7b7f-4a35-aebb-cbe7471f744a None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:19.426882 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fab271-8466-48a8-b278-7ad1ec0d92ad None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:19.458105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67734c67-f129-4d58-a90e-3e9341345a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:19.458755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734c67-f129-4d58-a90e-3e9341345a88 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.459032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734c67-f129-4d58-a90e-3e9341345a88 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.459306 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67734c67-f129-4d58-a90e-3e9341345a88 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.460126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67734c67-f129-4d58-a90e-3e9341345a88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:19.460453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67734c67-f129-4d58-a90e-3e9341345a88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:19.461882 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67734c67-f129-4d58-a90e-3e9341345a88 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:19.481295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5366159-7b7f-4a35-aebb-cbe7471f744a None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:19.496364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 255/502] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Mar 8 15:20:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:19.497852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67734c67-f129-4d58-a90e-3e9341345a88 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:19.512696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c69af-b8a2-4a58-95c3-73a6244f8f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:19.513475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c69af-b8a2-4a58-95c3-73a6244f8f57 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.513756 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c69af-b8a2-4a58-95c3-73a6244f8f57 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.514027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c69af-b8a2-4a58-95c3-73a6244f8f57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.521742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c69af-b8a2-4a58-95c3-73a6244f8f57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:19.523172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c69af-b8a2-4a58-95c3-73a6244f8f57 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:19.536252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-ff1c69af-b8a2-4a58-95c3-73a6244f8f57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 15:20:19.537378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 248/503] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Mar 8 15:20:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:19.538134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c69af-b8a2-4a58-95c3-73a6244f8f57 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:19.589947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67734c67-f129-4d58-a90e-3e9341345a88 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:19.621830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71d6e4-335c-40bb-84a9-150389093f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:19.622604 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71d6e4-335c-40bb-84a9-150389093f24 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.622892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71d6e4-335c-40bb-84a9-150389093f24 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.623177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71d6e4-335c-40bb-84a9-150389093f24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.628630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c69af-b8a2-4a58-95c3-73a6244f8f57 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:19.633231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71d6e4-335c-40bb-84a9-150389093f24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:19.634698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71d6e4-335c-40bb-84a9-150389093f24 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:19.651400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-eb71d6e4-335c-40bb-84a9-150389093f24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:19.652611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 256/504] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:19.653771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeceee21-f62c-47f3-9e84-7b4b2db7d4e8 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.654057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeceee21-f62c-47f3-9e84-7b4b2db7d4e8 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.654336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeceee21-f62c-47f3-9e84-7b4b2db7d4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.660291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94f70a-28f6-4d05-869e-60081b424a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:19.660974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94f70a-28f6-4d05-869e-60081b424a18 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.661252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94f70a-28f6-4d05-869e-60081b424a18 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.661525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94f70a-28f6-4d05-869e-60081b424a18 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.662230 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94f70a-28f6-4d05-869e-60081b424a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:19.662531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94f70a-28f6-4d05-869e-60081b424a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:19.663874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94f70a-28f6-4d05-869e-60081b424a18 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:19.669999 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-eeceee21-f62c-47f3-9e84-7b4b2db7d4e8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:19.671187 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-eeceee21-f62c-47f3-9e84-7b4b2db7d4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:19.674997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 249/505] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:19.675768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94f70a-28f6-4d05-869e-60081b424a18 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:19.733656 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 257/506] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:19.734474 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeceee21-f62c-47f3-9e84-7b4b2db7d4e8 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:19.771763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94f70a-28f6-4d05-869e-60081b424a18 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:19.802902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc58cb-f86a-4c9f-bada-55e00b29f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:19.803561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc58cb-f86a-4c9f-bada-55e00b29f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.803841 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc58cb-f86a-4c9f-bada-55e00b29f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.804116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc58cb-f86a-4c9f-bada-55e00b29f9e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.825718 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeceee21-f62c-47f3-9e84-7b4b2db7d4e8 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:19.857294 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9b9cd-a3ab-47a9-8255-49050a82c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:19.857884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9b9cd-a3ab-47a9-8255-49050a82c5bb None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:19.858167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9b9cd-a3ab-47a9-8255-49050a82c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:19.858444 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9b9cd-a3ab-47a9-8255-49050a82c5bb None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:19.859270 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9b9cd-a3ab-47a9-8255-49050a82c5bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:19.859575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9b9cd-a3ab-47a9-8255-49050a82c5bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:19.861047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9b9cd-a3ab-47a9-8255-49050a82c5bb None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:19.866849 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc58cb-f86a-4c9f-bada-55e00b29f9e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:19.868301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc58cb-f86a-4c9f-bada-55e00b29f9e8 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:19.877314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 258/507] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Mar 8 15:20:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:19.878099 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9b9cd-a3ab-47a9-8255-49050a82c5bb None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:19.960771 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 250/508] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:19.961827 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc58cb-f86a-4c9f-bada-55e00b29f9e8 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:19.975130 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9b9cd-a3ab-47a9-8255-49050a82c5bb None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:20.008405 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0397-4fda-46a7-b7a5-7dfe6d090d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:20.009051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0397-4fda-46a7-b7a5-7dfe6d090d27 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:20.009329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0397-4fda-46a7-b7a5-7dfe6d090d27 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:20.009600 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0397-4fda-46a7-b7a5-7dfe6d090d27 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:20.010306 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b0397-4fda-46a7-b7a5-7dfe6d090d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:20.010606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b0397-4fda-46a7-b7a5-7dfe6d090d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:20.011984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b0397-4fda-46a7-b7a5-7dfe6d090d27 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:20.022796 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 259/509] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:20.023563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0397-4fda-46a7-b7a5-7dfe6d090d27 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:20.054664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc58cb-f86a-4c9f-bada-55e00b29f9e8 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:20.086983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76836b5c-b22a-422f-aba4-533ef1bdbb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:20.087760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76836b5c-b22a-422f-aba4-533ef1bdbb94 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:20.088044 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76836b5c-b22a-422f-aba4-533ef1bdbb94 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:20.088346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76836b5c-b22a-422f-aba4-533ef1bdbb94 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:20.097127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76836b5c-b22a-422f-aba4-533ef1bdbb94 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:20.098615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76836b5c-b22a-422f-aba4-533ef1bdbb94 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:20.112021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-76836b5c-b22a-422f-aba4-533ef1bdbb94 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 15:20:20.113159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 251/510] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:20.114738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76836b5c-b22a-422f-aba4-533ef1bdbb94 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:20.116772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0397-4fda-46a7-b7a5-7dfe6d090d27 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:20.149230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8f2ea-877f-45be-8b56-3f4e308fd688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:20.150019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8f2ea-877f-45be-8b56-3f4e308fd688 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:20.150300 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8f2ea-877f-45be-8b56-3f4e308fd688 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:20.150575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8f2ea-877f-45be-8b56-3f4e308fd688 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:20.160131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8f2ea-877f-45be-8b56-3f4e308fd688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:20.167057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-7ed8f2ea-877f-45be-8b56-3f4e308fd688 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:20.168234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 260/511] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:20.168997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8f2ea-877f-45be-8b56-3f4e308fd688 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:20.212426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76836b5c-b22a-422f-aba4-533ef1bdbb94 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:20.244352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2130f-3d41-4161-9bfa-17fb079c8f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:20.244979 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2130f-3d41-4161-9bfa-17fb079c8f04 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:20.245259 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2130f-3d41-4161-9bfa-17fb079c8f04 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:20.245529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2130f-3d41-4161-9bfa-17fb079c8f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:20.262053 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8f2ea-877f-45be-8b56-3f4e308fd688 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:20.292757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b151-a9e8-4d61-8729-b2cee365f5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:20.293526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b151-a9e8-4d61-8729-b2cee365f5a7 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:20.293805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b151-a9e8-4d61-8729-b2cee365f5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:20.294076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b151-a9e8-4d61-8729-b2cee365f5a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:20.304593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b151-a9e8-4d61-8729-b2cee365f5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:20.306049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b151-a9e8-4d61-8729-b2cee365f5a7 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:20.307548 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2130f-3d41-4161-9bfa-17fb079c8f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:20.308998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2130f-3d41-4161-9bfa-17fb079c8f04 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:20.322228 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-9c27b151-a9e8-4d61-8729-b2cee365f5a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:20.323370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 261/512] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:20.324116 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b151-a9e8-4d61-8729-b2cee365f5a7 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:20.399881 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 252/513] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:20.400743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2130f-3d41-4161-9bfa-17fb079c8f04 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:20.415895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b151-a9e8-4d61-8729-b2cee365f5a7 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:20.447269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc50b1-754d-482a-8772-be76c1fee269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:20.447924 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc50b1-754d-482a-8772-be76c1fee269 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:20.448241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc50b1-754d-482a-8772-be76c1fee269 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:20.448521 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc50b1-754d-482a-8772-be76c1fee269 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:20.449213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc50b1-754d-482a-8772-be76c1fee269 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:20.450630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc50b1-754d-482a-8772-be76c1fee269 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:20.491600 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2130f-3d41-4161-9bfa-17fb079c8f04 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:20.523851 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beda32-d2e8-4e34-8f0a-0f4ea762aa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:20.524533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beda32-d2e8-4e34-8f0a-0f4ea762aa8d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:20.524814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beda32-d2e8-4e34-8f0a-0f4ea762aa8d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:20.525088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7beda32-d2e8-4e34-8f0a-0f4ea762aa8d None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:20.525912 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7beda32-d2e8-4e34-8f0a-0f4ea762aa8d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:20.526217 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7beda32-d2e8-4e34-8f0a-0f4ea762aa8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:20.527636 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7beda32-d2e8-4e34-8f0a-0f4ea762aa8d None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:20.563122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 253/514] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Mar 8 15:20:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:20.563804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beda32-d2e8-4e34-8f0a-0f4ea762aa8d None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:20.580137 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 262/515] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:20:20 2022] POST /identity/v3/users => generated 247 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:20:20.580137 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc50b1-754d-482a-8772-be76c1fee269 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:20.672475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7beda32-d2e8-4e34-8f0a-0f4ea762aa8d None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:20.681567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc50b1-754d-482a-8772-be76c1fee269 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:20.710553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1df41-7d8a-4bb7-9810-4b2f364b7b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:20.711403 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1df41-7d8a-4bb7-9810-4b2f364b7b08 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:20.711511 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1df41-7d8a-4bb7-9810-4b2f364b7b08 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:20.711772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1df41-7d8a-4bb7-9810-4b2f364b7b08 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:20.712565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1df41-7d8a-4bb7-9810-4b2f364b7b08 None admin] RBAC: Adding query filter params (name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:20.712891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1df41-7d8a-4bb7-9810-4b2f364b7b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:20.714288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1df41-7d8a-4bb7-9810-4b2f364b7b08 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:20.722817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 254/516] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:20.724267 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1df41-7d8a-4bb7-9810-4b2f364b7b08 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:20.729658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238a770-9d4e-477c-9b77-23b68d1bd4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:20.730348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238a770-9d4e-477c-9b77-23b68d1bd4a3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:20.730632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238a770-9d4e-477c-9b77-23b68d1bd4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:20.730906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238a770-9d4e-477c-9b77-23b68d1bd4a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:20.731643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238a770-9d4e-477c-9b77-23b68d1bd4a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:20.731953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238a770-9d4e-477c-9b77-23b68d1bd4a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:20.733584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238a770-9d4e-477c-9b77-23b68d1bd4a3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:20.749731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 263/517] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:20.751026 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238a770-9d4e-477c-9b77-23b68d1bd4a3 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:20.825722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1df41-7d8a-4bb7-9810-4b2f364b7b08 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:20.850814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238a770-9d4e-477c-9b77-23b68d1bd4a3 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:20.859223 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcd044-e40b-4ab1-ae7a-00a7139c9021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:20.860004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcd044-e40b-4ab1-ae7a-00a7139c9021 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:20.860320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcd044-e40b-4ab1-ae7a-00a7139c9021 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:20.860705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcd044-e40b-4ab1-ae7a-00a7139c9021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:20.871598 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcd044-e40b-4ab1-ae7a-00a7139c9021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:20.873333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcd044-e40b-4ab1-ae7a-00a7139c9021 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:20.885172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdf6b5-16e5-4493-9972-a8487b8be5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:20.885811 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf6b5-16e5-4493-9972-a8487b8be5e5 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:20.886090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf6b5-16e5-4493-9972-a8487b8be5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:20.886364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdf6b5-16e5-4493-9972-a8487b8be5e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:20.891075 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-6bbcd044-e40b-4ab1-ae7a-00a7139c9021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:20.892821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 255/518] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:20.893822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcd044-e40b-4ab1-ae7a-00a7139c9021 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:20.955847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdf6b5-16e5-4493-9972-a8487b8be5e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:20.957934 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbdf6b5-16e5-4493-9972-a8487b8be5e5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:20.992325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcd044-e40b-4ab1-ae7a-00a7139c9021 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.024071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979026a3-46ad-4439-a782-46ec22bede34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:21.024883 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979026a3-46ad-4439-a782-46ec22bede34 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:21.025161 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979026a3-46ad-4439-a782-46ec22bede34 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:21.025434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979026a3-46ad-4439-a782-46ec22bede34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:21.036138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979026a3-46ad-4439-a782-46ec22bede34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:21.037605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979026a3-46ad-4439-a782-46ec22bede34 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:21.052834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 264/519] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:21.053558 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-979026a3-46ad-4439-a782-46ec22bede34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:21.054134 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdf6b5-16e5-4493-9972-a8487b8be5e5 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:21.059377 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 256/520] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:21.061595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979026a3-46ad-4439-a782-46ec22bede34 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:21.153417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdf6b5-16e5-4493-9972-a8487b8be5e5 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.163550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979026a3-46ad-4439-a782-46ec22bede34 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.186442 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b153e-a4bb-4653-baa2-e39f1b6f2779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:21.187444 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b153e-a4bb-4653-baa2-e39f1b6f2779 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:21.187873 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b153e-a4bb-4653-baa2-e39f1b6f2779 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:21.188322 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b153e-a4bb-4653-baa2-e39f1b6f2779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:21.196274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b153e-a4bb-4653-baa2-e39f1b6f2779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:21.197749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b153e-a4bb-4653-baa2-e39f1b6f2779 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:21.198526 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096225d-7bfe-41ff-bf64-c6a56352996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:21.199356 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096225d-7bfe-41ff-bf64-c6a56352996c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:21.199787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096225d-7bfe-41ff-bf64-c6a56352996c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:21.200249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096225d-7bfe-41ff-bf64-c6a56352996c None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:21.201129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096225d-7bfe-41ff-bf64-c6a56352996c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:21.201585 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096225d-7bfe-41ff-bf64-c6a56352996c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:21.203110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096225d-7bfe-41ff-bf64-c6a56352996c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:21.214813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-887b153e-a4bb-4653-baa2-e39f1b6f2779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:21.214813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 265/521] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:21.215260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b153e-a4bb-4653-baa2-e39f1b6f2779 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:21.225989 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 257/522] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:21.225989 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096225d-7bfe-41ff-bf64-c6a56352996c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:21.312636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b153e-a4bb-4653-baa2-e39f1b6f2779 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.320396 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096225d-7bfe-41ff-bf64-c6a56352996c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.345524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4b145-2aa1-4714-94cb-b68af3255d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:21.346332 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4b145-2aa1-4714-94cb-b68af3255d23 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:21.346602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4b145-2aa1-4714-94cb-b68af3255d23 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:21.346877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4b145-2aa1-4714-94cb-b68af3255d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:21.353397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981aed9-8013-4b4e-9c65-3dc77ae29930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:21.354052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981aed9-8013-4b4e-9c65-3dc77ae29930 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:21.354336 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981aed9-8013-4b4e-9c65-3dc77ae29930 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:21.354613 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981aed9-8013-4b4e-9c65-3dc77ae29930 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:21.355334 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981aed9-8013-4b4e-9c65-3dc77ae29930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:21.355638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981aed9-8013-4b4e-9c65-3dc77ae29930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:21.357013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4b145-2aa1-4714-94cb-b68af3255d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:21.357114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981aed9-8013-4b4e-9c65-3dc77ae29930 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:21.358440 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4b145-2aa1-4714-94cb-b68af3255d23 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:21.372678 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 258/523] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:21.372678 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981aed9-8013-4b4e-9c65-3dc77ae29930 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:21.374567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-ebd4b145-2aa1-4714-94cb-b68af3255d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:21.380204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 266/524] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:21.380204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4b145-2aa1-4714-94cb-b68af3255d23 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:21.472553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981aed9-8013-4b4e-9c65-3dc77ae29930 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.472953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4b145-2aa1-4714-94cb-b68af3255d23 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.503771 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2998c-5f00-4e17-8b5d-51830801af4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:21.504002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d79244-c5bf-462c-8770-326a08d6cbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:21.504983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2998c-5f00-4e17-8b5d-51830801af4e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:21.505266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d79244-c5bf-462c-8770-326a08d6cbd9 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:21.505369 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2998c-5f00-4e17-8b5d-51830801af4e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:21.505547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2998c-5f00-4e17-8b5d-51830801af4e None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:21.505644 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d79244-c5bf-462c-8770-326a08d6cbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:21.505795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d79244-c5bf-462c-8770-326a08d6cbd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:21.506326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2998c-5f00-4e17-8b5d-51830801af4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:21.506746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2998c-5f00-4e17-8b5d-51830801af4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:21.508190 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2998c-5f00-4e17-8b5d-51830801af4e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:21.512509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d79244-c5bf-462c-8770-326a08d6cbd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:21.513946 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d79244-c5bf-462c-8770-326a08d6cbd9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:21.530382 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 259/525] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:21.530382 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2998c-5f00-4e17-8b5d-51830801af4e None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:21.530621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-e3d79244-c5bf-462c-8770-326a08d6cbd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:21.530621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 267/526] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:21.530621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d79244-c5bf-462c-8770-326a08d6cbd9 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:21.627233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d79244-c5bf-462c-8770-326a08d6cbd9 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.630023 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2998c-5f00-4e17-8b5d-51830801af4e None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.659883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55aeed-b364-4c00-a953-84a872d69c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:21.660599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55aeed-b364-4c00-a953-84a872d69c06 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:21.660883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55aeed-b364-4c00-a953-84a872d69c06 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:21.661157 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55aeed-b364-4c00-a953-84a872d69c06 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:21.661863 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55aeed-b364-4c00-a953-84a872d69c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:21.662166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55aeed-b364-4c00-a953-84a872d69c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:21.662268 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f05c8b-0e0f-4380-8641-58a961473035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:21.663040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f05c8b-0e0f-4380-8641-58a961473035 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:21.663323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f05c8b-0e0f-4380-8641-58a961473035 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:21.663565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55aeed-b364-4c00-a953-84a872d69c06 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:21.663674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f05c8b-0e0f-4380-8641-58a961473035 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:21.670911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f05c8b-0e0f-4380-8641-58a961473035 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:21.672361 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f05c8b-0e0f-4380-8641-58a961473035 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:21.674602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 268/527] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:21.675398 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55aeed-b364-4c00-a953-84a872d69c06 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:21.691058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-80f05c8b-0e0f-4380-8641-58a961473035 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 15:20:21.697158 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 260/528] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:21.697158 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f05c8b-0e0f-4380-8641-58a961473035 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:21.778035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55aeed-b364-4c00-a953-84a872d69c06 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.794219 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f05c8b-0e0f-4380-8641-58a961473035 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.810689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b59435-892e-4c7e-9217-00b778ee5c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:21.811339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b59435-892e-4c7e-9217-00b778ee5c84 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:21.811622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b59435-892e-4c7e-9217-00b778ee5c84 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:21.811897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b59435-892e-4c7e-9217-00b778ee5c84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:21.812750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b59435-892e-4c7e-9217-00b778ee5c84 None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=2f9935443bcc4d34aeb56e5b77a96720) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:21.813063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b59435-892e-4c7e-9217-00b778ee5c84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:21.814503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b59435-892e-4c7e-9217-00b778ee5c84 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:21.820431 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 269/529] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/role_assignments?user.id=2f9935443bcc4d34aeb56e5b77a96720&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:21.820431 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b59435-892e-4c7e-9217-00b778ee5c84 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:21.839718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585f725-9ccc-48b3-a44e-a2715203ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:21.840815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585f725-9ccc-48b3-a44e-a2715203ab29 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:21.841107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585f725-9ccc-48b3-a44e-a2715203ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:21.841385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585f725-9ccc-48b3-a44e-a2715203ab29 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:21.842200 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585f725-9ccc-48b3-a44e-a2715203ab29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:21.842512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585f725-9ccc-48b3-a44e-a2715203ab29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:21.844862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585f725-9ccc-48b3-a44e-a2715203ab29 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:21.862009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 261/530] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:21.862916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585f725-9ccc-48b3-a44e-a2715203ab29 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:21.932091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b59435-892e-4c7e-9217-00b778ee5c84 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.968036 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f19fa-d690-4eda-ba36-d751d35e8e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:21.968886 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f19fa-d690-4eda-ba36-d751d35e8e55 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:21.969172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f19fa-d690-4eda-ba36-d751d35e8e55 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:21.969452 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f19fa-d690-4eda-ba36-d751d35e8e55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:21.977437 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f19fa-d690-4eda-ba36-d751d35e8e55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:21.978933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f19fa-d690-4eda-ba36-d751d35e8e55 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:21.986132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585f725-9ccc-48b3-a44e-a2715203ab29 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:21.993937 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-724f19fa-d690-4eda-ba36-d751d35e8e55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:21.995349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 270/531] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:22.000585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f19fa-d690-4eda-ba36-d751d35e8e55 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:22.031048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82292c73-d3fe-47cf-bfb4-aad7b690341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:22.031994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82292c73-d3fe-47cf-bfb4-aad7b690341a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:22.032518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82292c73-d3fe-47cf-bfb4-aad7b690341a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:22.032939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82292c73-d3fe-47cf-bfb4-aad7b690341a None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:22.033918 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82292c73-d3fe-47cf-bfb4-aad7b690341a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:22.034436 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82292c73-d3fe-47cf-bfb4-aad7b690341a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:22.036696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82292c73-d3fe-47cf-bfb4-aad7b690341a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:22.055459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 262/532] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:22.061010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82292c73-d3fe-47cf-bfb4-aad7b690341a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:22.109160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f19fa-d690-4eda-ba36-d751d35e8e55 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:22.155752 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f96de-3600-4c48-8d50-00eceea88410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:22.156591 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f96de-3600-4c48-8d50-00eceea88410 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:22.156877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f96de-3600-4c48-8d50-00eceea88410 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:22.157457 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f96de-3600-4c48-8d50-00eceea88410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:22.158305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f96de-3600-4c48-8d50-00eceea88410 None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=c4fb404cc61d49d3aaec429f4f9f4f94) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:22.158621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f96de-3600-4c48-8d50-00eceea88410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:22.161052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f96de-3600-4c48-8d50-00eceea88410 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:22.168865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 271/533] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:21 2022] GET /identity/v3/role_assignments?user.id=c4fb404cc61d49d3aaec429f4f9f4f94&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:22.170353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f96de-3600-4c48-8d50-00eceea88410 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:22.171888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82292c73-d3fe-47cf-bfb4-aad7b690341a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:22.209311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef32037-deaa-4b64-b891-8cab8ef6cd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:22.209981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef32037-deaa-4b64-b891-8cab8ef6cd3b None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:22.210260 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef32037-deaa-4b64-b891-8cab8ef6cd3b None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:22.210532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef32037-deaa-4b64-b891-8cab8ef6cd3b None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:22.211328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef32037-deaa-4b64-b891-8cab8ef6cd3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:22.211634 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef32037-deaa-4b64-b891-8cab8ef6cd3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:22.213172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef32037-deaa-4b64-b891-8cab8ef6cd3b None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:22.230960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 263/534] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:22.236754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef32037-deaa-4b64-b891-8cab8ef6cd3b None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:22.288422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f96de-3600-4c48-8d50-00eceea88410 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:22.323273 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdf9c1-59fb-4eee-992e-e65d2c9a639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:22.324009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdf9c1-59fb-4eee-992e-e65d2c9a639f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:22.324334 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdf9c1-59fb-4eee-992e-e65d2c9a639f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:22.324614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdf9c1-59fb-4eee-992e-e65d2c9a639f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:22.342756 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef32037-deaa-4b64-b891-8cab8ef6cd3b None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:22.378527 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1299e9f-faf4-47db-9d64-6d8f261b7683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:22.379649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1299e9f-faf4-47db-9d64-6d8f261b7683 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:22.380134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1299e9f-faf4-47db-9d64-6d8f261b7683 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:22.380648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1299e9f-faf4-47db-9d64-6d8f261b7683 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:22.381774 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1299e9f-faf4-47db-9d64-6d8f261b7683 None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=028d499ea279442d822c6723c367f459) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:22.382289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1299e9f-faf4-47db-9d64-6d8f261b7683 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:22.383912 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1299e9f-faf4-47db-9d64-6d8f261b7683 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:22.389913 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 264/535] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:22 2022] GET /identity/v3/role_assignments?user.id=028d499ea279442d822c6723c367f459&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:22.408661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdf9c1-59fb-4eee-992e-e65d2c9a639f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:22.410190 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdf9c1-59fb-4eee-992e-e65d2c9a639f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:22.522449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 272/536] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:22.527759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1299e9f-faf4-47db-9d64-6d8f261b7683 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:22.663754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1299e9f-faf4-47db-9d64-6d8f261b7683 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:22.704407 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e2d16-6e42-4bc0-a9a9-00bfb7f58292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:22.705201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e2d16-6e42-4bc0-a9a9-00bfb7f58292 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:22.705487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e2d16-6e42-4bc0-a9a9-00bfb7f58292 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:22.705762 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e2d16-6e42-4bc0-a9a9-00bfb7f58292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:22.721203 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e2d16-6e42-4bc0-a9a9-00bfb7f58292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:22.722662 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e2d16-6e42-4bc0-a9a9-00bfb7f58292 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:22.742505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-bb5e2d16-6e42-4bc0-a9a9-00bfb7f58292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:22.744093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 265/537] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:22.749362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdf9c1-59fb-4eee-992e-e65d2c9a639f None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:22.865074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdf9c1-59fb-4eee-992e-e65d2c9a639f None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:22.908837 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f1985-f722-4cbf-beb7-6ee57bf0f180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:22.909500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f1985-f722-4cbf-beb7-6ee57bf0f180 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:22.909780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f1985-f722-4cbf-beb7-6ee57bf0f180 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:22.910054 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f1985-f722-4cbf-beb7-6ee57bf0f180 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:22.911314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f1985-f722-4cbf-beb7-6ee57bf0f180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:22.911617 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f1985-f722-4cbf-beb7-6ee57bf0f180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:22.913012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f1985-f722-4cbf-beb7-6ee57bf0f180 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:22.928329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 273/538] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:22.933233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e2d16-6e42-4bc0-a9a9-00bfb7f58292 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:23.069714 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e2d16-6e42-4bc0-a9a9-00bfb7f58292 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:23.103788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60410f96-e509-4f02-9ac4-7abbff1661b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:23.104602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60410f96-e509-4f02-9ac4-7abbff1661b9 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:23.104880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60410f96-e509-4f02-9ac4-7abbff1661b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:23.105156 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60410f96-e509-4f02-9ac4-7abbff1661b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:23.111732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60410f96-e509-4f02-9ac4-7abbff1661b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:23.113227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60410f96-e509-4f02-9ac4-7abbff1661b9 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:23.126573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-60410f96-e509-4f02-9ac4-7abbff1661b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:23.128016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 266/539] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:23.133500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f1985-f722-4cbf-beb7-6ee57bf0f180 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:23.214169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524668f-a8bb-4506-8e2d-631eb2ee89a8 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:23.214363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524668f-a8bb-4506-8e2d-631eb2ee89a8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:23.214643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524668f-a8bb-4506-8e2d-631eb2ee89a8 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:23.216667 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 267/540] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:23.221591 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc84a1-1a92-4c7d-ad50-b940e3ec75a4 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:23.221882 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc84a1-1a92-4c7d-ad50-b940e3ec75a4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:23.222166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc84a1-1a92-4c7d-ad50-b940e3ec75a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:23.239607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-fbfc84a1-1a92-4c7d-ad50-b940e3ec75a4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:23.241117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-fbfc84a1-1a92-4c7d-ad50-b940e3ec75a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:23.306861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 268/541] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:23.329609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc84a1-1a92-4c7d-ad50-b940e3ec75a4 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:23.334268 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f1985-f722-4cbf-beb7-6ee57bf0f180 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:23.389517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623c747-93cb-487a-8743-fbea4ba6cbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:23.390182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623c747-93cb-487a-8743-fbea4ba6cbbc None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:23.390468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623c747-93cb-487a-8743-fbea4ba6cbbc None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:23.390749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623c747-93cb-487a-8743-fbea4ba6cbbc None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:23.391535 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623c747-93cb-487a-8743-fbea4ba6cbbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:23.391903 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623c747-93cb-487a-8743-fbea4ba6cbbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:23.393444 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623c747-93cb-487a-8743-fbea4ba6cbbc None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:23.420948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 274/542] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:23.426907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623c747-93cb-487a-8743-fbea4ba6cbbc None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:23.429802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc84a1-1a92-4c7d-ad50-b940e3ec75a4 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:23.466633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da6315-7ac3-45c4-8ff5-70465a3e6364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:23.467705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da6315-7ac3-45c4-8ff5-70465a3e6364 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:23.468172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da6315-7ac3-45c4-8ff5-70465a3e6364 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:23.468455 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da6315-7ac3-45c4-8ff5-70465a3e6364 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:23.478632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da6315-7ac3-45c4-8ff5-70465a3e6364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:23.485697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-14da6315-7ac3-45c4-8ff5-70465a3e6364 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:23.487019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 269/543] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:23.493091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da6315-7ac3-45c4-8ff5-70465a3e6364 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:23.544389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623c747-93cb-487a-8743-fbea4ba6cbbc None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:23.605053 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28f8cd-ec89-47ae-99c9-2811a963ed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:23.605974 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28f8cd-ec89-47ae-99c9-2811a963ed0e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:23.606544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28f8cd-ec89-47ae-99c9-2811a963ed0e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:23.609175 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28f8cd-ec89-47ae-99c9-2811a963ed0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:23.610236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28f8cd-ec89-47ae-99c9-2811a963ed0e None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=7acd143470fb416c8adc57351c5d0324) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:23.610711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28f8cd-ec89-47ae-99c9-2811a963ed0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:23.612333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28f8cd-ec89-47ae-99c9-2811a963ed0e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:23.625025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 275/544] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:23 2022] GET /identity/v3/role_assignments?user.id=7acd143470fb416c8adc57351c5d0324&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:23.653673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da6315-7ac3-45c4-8ff5-70465a3e6364 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:23.695497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71336127-2936-46ac-a30b-c4aca9c46e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:23.696508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71336127-2936-46ac-a30b-c4aca9c46e78 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:23.696930 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71336127-2936-46ac-a30b-c4aca9c46e78 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:23.697358 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71336127-2936-46ac-a30b-c4aca9c46e78 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:23.698271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71336127-2936-46ac-a30b-c4aca9c46e78 None admin] RBAC: Adding query filter params (name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:23.698738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71336127-2936-46ac-a30b-c4aca9c46e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:23.700330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71336127-2936-46ac-a30b-c4aca9c46e78 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:23.716254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 270/545] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:23.721991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28f8cd-ec89-47ae-99c9-2811a963ed0e None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:23.842784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28f8cd-ec89-47ae-99c9-2811a963ed0e None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:23.886916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb2045-af9d-44af-a708-87a6f52704a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:23.887993 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb2045-af9d-44af-a708-87a6f52704a6 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:23.888445 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb2045-af9d-44af-a708-87a6f52704a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:23.888873 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb2045-af9d-44af-a708-87a6f52704a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:23.903948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb2045-af9d-44af-a708-87a6f52704a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:23.905764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb2045-af9d-44af-a708-87a6f52704a6 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:23.927288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-8ccb2045-af9d-44af-a708-87a6f52704a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:23.929203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 276/546] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:23.937489 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71336127-2936-46ac-a30b-c4aca9c46e78 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:24.084127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71336127-2936-46ac-a30b-c4aca9c46e78 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:24.122447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f93e3-160e-47fb-9cda-cf66c017a520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:24.123370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f93e3-160e-47fb-9cda-cf66c017a520 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:24.123792 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f93e3-160e-47fb-9cda-cf66c017a520 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:24.124272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f93e3-160e-47fb-9cda-cf66c017a520 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:24.125122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f93e3-160e-47fb-9cda-cf66c017a520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:24.125630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f93e3-160e-47fb-9cda-cf66c017a520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:24.127131 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f93e3-160e-47fb-9cda-cf66c017a520 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:24.143933 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 271/547] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:24.149434 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb2045-af9d-44af-a708-87a6f52704a6 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:24.262429 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb2045-af9d-44af-a708-87a6f52704a6 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:24.301876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae226641-25d9-4751-91a8-9bb61a11e44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:24.302940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae226641-25d9-4751-91a8-9bb61a11e44e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:24.303370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae226641-25d9-4751-91a8-9bb61a11e44e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:24.303781 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae226641-25d9-4751-91a8-9bb61a11e44e None admin] PATH_INFO: `/v3/users/swift` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:24.311322 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae226641-25d9-4751-91a8-9bb61a11e44e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:24.312958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae226641-25d9-4751-91a8-9bb61a11e44e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:24.326724 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-ae226641-25d9-4751-91a8-9bb61a11e44e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 15:20:24.328416 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 277/548] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:24.334104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f93e3-160e-47fb-9cda-cf66c017a520 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:24.454532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f93e3-160e-47fb-9cda-cf66c017a520 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:24.461986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9a879-5c1f-42a9-9e73-b418eb2aeb2c None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:24.462441 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9a879-5c1f-42a9-9e73-b418eb2aeb2c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:24.462865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9a879-5c1f-42a9-9e73-b418eb2aeb2c None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:24.465032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 278/549] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:24.469897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d58f3e-e7b2-4d29-8cbc-13c9eb98cfce None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:24.470193 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d58f3e-e7b2-4d29-8cbc-13c9eb98cfce None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:24.470471 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d58f3e-e7b2-4d29-8cbc-13c9eb98cfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:24.490517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b6d58f3e-e7b2-4d29-8cbc-13c9eb98cfce None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:24.492521 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b6d58f3e-e7b2-4d29-8cbc-13c9eb98cfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:24.522222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2379d56-f398-4090-9c75-88ce3e361a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:24.522880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2379d56-f398-4090-9c75-88ce3e361a8a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:24.523162 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2379d56-f398-4090-9c75-88ce3e361a8a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:24.523438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2379d56-f398-4090-9c75-88ce3e361a8a None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:24.524299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2379d56-f398-4090-9c75-88ce3e361a8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:24.524607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2379d56-f398-4090-9c75-88ce3e361a8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:24.526042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2379d56-f398-4090-9c75-88ce3e361a8a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:24.561367 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 272/550] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Mar 8 15:20:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:24.566816 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2379d56-f398-4090-9c75-88ce3e361a8a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:24.618010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 279/551] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:24.665632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d58f3e-e7b2-4d29-8cbc-13c9eb98cfce None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:24.676648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2379d56-f398-4090-9c75-88ce3e361a8a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:24.716671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a680491-2578-4875-a909-0fb71290caf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:24.717834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a680491-2578-4875-a909-0fb71290caf5 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:24.718322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a680491-2578-4875-a909-0fb71290caf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:24.718827 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a680491-2578-4875-a909-0fb71290caf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:24.794329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a680491-2578-4875-a909-0fb71290caf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:24.796176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a680491-2578-4875-a909-0fb71290caf5 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:24.906179 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 273/552] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:24.912500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a680491-2578-4875-a909-0fb71290caf5 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:24.940638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d58f3e-e7b2-4d29-8cbc-13c9eb98cfce None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:25.017631 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b655b2-2f7e-4838-a85e-4818090497c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:25.018410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b655b2-2f7e-4838-a85e-4818090497c2 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.018692 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b655b2-2f7e-4838-a85e-4818090497c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.018964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b655b2-2f7e-4838-a85e-4818090497c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.040119 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b655b2-2f7e-4838-a85e-4818090497c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:25.047035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-08b655b2-2f7e-4838-a85e-4818090497c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:25.049595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 280/553] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:25.054336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb706cb-12a2-40d6-a0c9-1c480f6daf6c None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.054622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb706cb-12a2-40d6-a0c9-1c480f6daf6c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.054897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb706cb-12a2-40d6-a0c9-1c480f6daf6c None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.057088 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 281/554] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:25.057815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb706cb-12a2-40d6-a0c9-1c480f6daf6c None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:25.096815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a680491-2578-4875-a909-0fb71290caf5 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:25.132302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66f2ca-8538-4d98-b13a-827ad49954e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:25.132780 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66f2ca-8538-4d98-b13a-827ad49954e5 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.133060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66f2ca-8538-4d98-b13a-827ad49954e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.133332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66f2ca-8538-4d98-b13a-827ad49954e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.147617 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66f2ca-8538-4d98-b13a-827ad49954e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:25.149429 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66f2ca-8538-4d98-b13a-827ad49954e5 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:25.170450 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb706cb-12a2-40d6-a0c9-1c480f6daf6c None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:25.170960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-7d66f2ca-8538-4d98-b13a-827ad49954e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:25.176232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 274/555] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:25.177730 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee2c02-260d-45fc-bf43-05ef96d5a73c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.178015 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee2c02-260d-45fc-bf43-05ef96d5a73c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.178289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee2c02-260d-45fc-bf43-05ef96d5a73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.199769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-40ee2c02-260d-45fc-bf43-05ef96d5a73c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:25.202089 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-40ee2c02-260d-45fc-bf43-05ef96d5a73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:25.216047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd89214-3c83-45fb-8e9d-53bec9258504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:25.217053 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd89214-3c83-45fb-8e9d-53bec9258504 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.217341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd89214-3c83-45fb-8e9d-53bec9258504 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.217617 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd89214-3c83-45fb-8e9d-53bec9258504 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.218631 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd89214-3c83-45fb-8e9d-53bec9258504 None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:25.218940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd89214-3c83-45fb-8e9d-53bec9258504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:25.220502 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd89214-3c83-45fb-8e9d-53bec9258504 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:25.230697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 282/556] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:25.231741 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd89214-3c83-45fb-8e9d-53bec9258504 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:25.288583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 275/557] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:25.289755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee2c02-260d-45fc-bf43-05ef96d5a73c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:25.354848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd89214-3c83-45fb-8e9d-53bec9258504 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:25.395639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355993aa-d48a-476d-a6cd-17f2277446fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:25.396603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355993aa-d48a-476d-a6cd-17f2277446fd None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.396890 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355993aa-d48a-476d-a6cd-17f2277446fd None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.397172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355993aa-d48a-476d-a6cd-17f2277446fd None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.398355 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355993aa-d48a-476d-a6cd-17f2277446fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:25.398669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355993aa-d48a-476d-a6cd-17f2277446fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:25.400057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355993aa-d48a-476d-a6cd-17f2277446fd None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:25.401332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee2c02-260d-45fc-bf43-05ef96d5a73c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:25.417265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 283/558] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:25.417265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355993aa-d48a-476d-a6cd-17f2277446fd None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:25.440647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399588-6af9-460d-aca4-6c8fccd4b4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:25.441991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399588-6af9-460d-aca4-6c8fccd4b4a4 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.442270 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399588-6af9-460d-aca4-6c8fccd4b4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.442537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399588-6af9-460d-aca4-6c8fccd4b4a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.452081 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f399588-6af9-460d-aca4-6c8fccd4b4a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:25.453550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f399588-6af9-460d-aca4-6c8fccd4b4a4 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:25.469483 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-9f399588-6af9-460d-aca4-6c8fccd4b4a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:25.475399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 276/559] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:25.475399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215e126-fd13-4e12-8114-4d21fd3c75f2 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.475399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215e126-fd13-4e12-8114-4d21fd3c75f2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.475399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215e126-fd13-4e12-8114-4d21fd3c75f2 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.475399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 277/560] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:25.475399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215e126-fd13-4e12-8114-4d21fd3c75f2 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:25.516871 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355993aa-d48a-476d-a6cd-17f2277446fd None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:25.549820 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523af28-0d15-4930-8a76-c5030b8586f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:25.550529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523af28-0d15-4930-8a76-c5030b8586f8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.551464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523af28-0d15-4930-8a76-c5030b8586f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.551721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523af28-0d15-4930-8a76-c5030b8586f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.561613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523af28-0d15-4930-8a76-c5030b8586f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:25.569157 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-8523af28-0d15-4930-8a76-c5030b8586f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:25.570329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 284/561] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:25.571097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523af28-0d15-4930-8a76-c5030b8586f8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:25.579733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215e126-fd13-4e12-8114-4d21fd3c75f2 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:25.655308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cecf9f7-8da6-479c-af4c-4e32334e8bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:25.656092 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecf9f7-8da6-479c-af4c-4e32334e8bf2 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.656419 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecf9f7-8da6-479c-af4c-4e32334e8bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.656698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cecf9f7-8da6-479c-af4c-4e32334e8bf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.663782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cecf9f7-8da6-479c-af4c-4e32334e8bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:25.665272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cecf9f7-8da6-479c-af4c-4e32334e8bf2 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:25.678311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-3cecf9f7-8da6-479c-af4c-4e32334e8bf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:25.679476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 278/562] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:25.680710 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e4976-32b9-4119-ad85-7c5f07364b96 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.680994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e4976-32b9-4119-ad85-7c5f07364b96 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.681267 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e4976-32b9-4119-ad85-7c5f07364b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.693991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523af28-0d15-4930-8a76-c5030b8586f8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:25.698513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-032e4976-32b9-4119-ad85-7c5f07364b96 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:25.699726 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-032e4976-32b9-4119-ad85-7c5f07364b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:25.728401 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcafc2-79e3-4f0e-a9f0-12ed9f182e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:25.729063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcafc2-79e3-4f0e-a9f0-12ed9f182e60 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.729344 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcafc2-79e3-4f0e-a9f0-12ed9f182e60 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.729618 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcafc2-79e3-4f0e-a9f0-12ed9f182e60 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.730327 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcafc2-79e3-4f0e-a9f0-12ed9f182e60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:25.730628 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcafc2-79e3-4f0e-a9f0-12ed9f182e60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:25.732047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcafc2-79e3-4f0e-a9f0-12ed9f182e60 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:25.745000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 285/563] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:25.745936 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcafc2-79e3-4f0e-a9f0-12ed9f182e60 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:25.772836 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 279/564] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:25.774051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e4976-32b9-4119-ad85-7c5f07364b96 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:25.850300 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcafc2-79e3-4f0e-a9f0-12ed9f182e60 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:25.870091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e4976-32b9-4119-ad85-7c5f07364b96 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:25.883002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ecb74-e99a-4510-89f1-2a1e81b2cfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:25.883668 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ecb74-e99a-4510-89f1-2a1e81b2cfd2 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.883947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ecb74-e99a-4510-89f1-2a1e81b2cfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.884256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ecb74-e99a-4510-89f1-2a1e81b2cfd2 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.884991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ecb74-e99a-4510-89f1-2a1e81b2cfd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:25.885292 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ecb74-e99a-4510-89f1-2a1e81b2cfd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:25.886651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ecb74-e99a-4510-89f1-2a1e81b2cfd2 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:25.898730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 286/565] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:25.898730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ecb74-e99a-4510-89f1-2a1e81b2cfd2 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:25.906849 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36210f3-7675-402a-8f94-ba379b7578c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:25.907517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36210f3-7675-402a-8f94-ba379b7578c6 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:25.907802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36210f3-7675-402a-8f94-ba379b7578c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:25.908083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36210f3-7675-402a-8f94-ba379b7578c6 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:25.908906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36210f3-7675-402a-8f94-ba379b7578c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:25.909217 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36210f3-7675-402a-8f94-ba379b7578c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:25.911289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36210f3-7675-402a-8f94-ba379b7578c6 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:25.922778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 280/566] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:25.923586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36210f3-7675-402a-8f94-ba379b7578c6 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:25.995779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ecb74-e99a-4510-89f1-2a1e81b2cfd2 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:26.022671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36210f3-7675-402a-8f94-ba379b7578c6 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:26.029122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c20ea0-ccb1-4deb-8816-6fa226cc6226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:26.029917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c20ea0-ccb1-4deb-8816-6fa226cc6226 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.030200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c20ea0-ccb1-4deb-8816-6fa226cc6226 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.030476 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c20ea0-ccb1-4deb-8816-6fa226cc6226 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.038452 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c20ea0-ccb1-4deb-8816-6fa226cc6226 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:26.039916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c20ea0-ccb1-4deb-8816-6fa226cc6226 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:26.054388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-30c20ea0-ccb1-4deb-8816-6fa226cc6226 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 15:20:26.055015 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535fe52-7824-430b-97c6-1339166471ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:26.055813 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535fe52-7824-430b-97c6-1339166471ef None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.056091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535fe52-7824-430b-97c6-1339166471ef None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.061518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535fe52-7824-430b-97c6-1339166471ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.061693 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 287/567] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:26.061693 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c20ea0-ccb1-4deb-8816-6fa226cc6226 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:26.075821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535fe52-7824-430b-97c6-1339166471ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:26.083373 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-0535fe52-7824-430b-97c6-1339166471ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:26.084591 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 281/568] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:26.085385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535fe52-7824-430b-97c6-1339166471ef None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:26.170822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c20ea0-ccb1-4deb-8816-6fa226cc6226 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:26.192836 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535fe52-7824-430b-97c6-1339166471ef None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:26.206104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa750d2-c6b3-49a1-9644-6166e253352d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:26.207436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa750d2-c6b3-49a1-9644-6166e253352d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.207723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa750d2-c6b3-49a1-9644-6166e253352d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.207989 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa750d2-c6b3-49a1-9644-6166e253352d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.218653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa750d2-c6b3-49a1-9644-6166e253352d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:26.220123 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa750d2-c6b3-49a1-9644-6166e253352d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:26.227733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec8361-33b1-488b-9a9c-e66e83391942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:26.228416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8361-33b1-488b-9a9c-e66e83391942 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.228709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8361-33b1-488b-9a9c-e66e83391942 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.228986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8361-33b1-488b-9a9c-e66e83391942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.229809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec8361-33b1-488b-9a9c-e66e83391942 None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=10fc82e0c3f0414492c1df4381918877) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:26.230121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec8361-33b1-488b-9a9c-e66e83391942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:26.231535 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec8361-33b1-488b-9a9c-e66e83391942 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:26.248189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 282/569] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:26 2022] GET /identity/v3/role_assignments?user.id=10fc82e0c3f0414492c1df4381918877&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:26.248393 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-cfa750d2-c6b3-49a1-9644-6166e253352d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:26.248509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec8361-33b1-488b-9a9c-e66e83391942 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:26.248594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 288/570] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:26.248594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa750d2-c6b3-49a1-9644-6166e253352d None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:26.363907 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec8361-33b1-488b-9a9c-e66e83391942 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:26.381370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa750d2-c6b3-49a1-9644-6166e253352d None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:26.400090 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690faf3-c076-4653-8e51-822447626c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:26.400849 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690faf3-c076-4653-8e51-822447626c85 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.401204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690faf3-c076-4653-8e51-822447626c85 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.401553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690faf3-c076-4653-8e51-822447626c85 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.402560 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690faf3-c076-4653-8e51-822447626c85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:26.402959 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690faf3-c076-4653-8e51-822447626c85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:26.404618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690faf3-c076-4653-8e51-822447626c85 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:26.425280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 283/571] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Mar 8 15:20:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:26.426840 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690faf3-c076-4653-8e51-822447626c85 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:26.431104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd6eac-347f-409b-acc6-f11915c968b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:26.431778 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6eac-347f-409b-acc6-f11915c968b4 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.432059 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6eac-347f-409b-acc6-f11915c968b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.432374 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd6eac-347f-409b-acc6-f11915c968b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.433121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd6eac-347f-409b-acc6-f11915c968b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:26.433426 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd6eac-347f-409b-acc6-f11915c968b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:26.434812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cd6eac-347f-409b-acc6-f11915c968b4 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:26.446064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 289/572] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:26.446064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd6eac-347f-409b-acc6-f11915c968b4 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:26.540131 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690faf3-c076-4653-8e51-822447626c85 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:26.559968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd6eac-347f-409b-acc6-f11915c968b4 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:26.578037 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc977c4-1461-4b8a-854c-f3e66d1b095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:26.578696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc977c4-1461-4b8a-854c-f3e66d1b095c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.578981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc977c4-1461-4b8a-854c-f3e66d1b095c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.579254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc977c4-1461-4b8a-854c-f3e66d1b095c None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.580032 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc977c4-1461-4b8a-854c-f3e66d1b095c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:26.580362 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc977c4-1461-4b8a-854c-f3e66d1b095c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:26.581739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc977c4-1461-4b8a-854c-f3e66d1b095c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:26.593849 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0655f-e6d8-45fb-a5d3-9560df674872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:26.594729 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0655f-e6d8-45fb-a5d3-9560df674872 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.595080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0655f-e6d8-45fb-a5d3-9560df674872 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.595420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0655f-e6d8-45fb-a5d3-9560df674872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.599381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 284/573] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:26.600136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc977c4-1461-4b8a-854c-f3e66d1b095c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:26.606200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0655f-e6d8-45fb-a5d3-9560df674872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:26.607642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0655f-e6d8-45fb-a5d3-9560df674872 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:26.624351 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-e9e0655f-e6d8-45fb-a5d3-9560df674872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:26.625749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 290/574] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:26.627100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfce4be-3b69-45f3-9a20-d048084995d2 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.627384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfce4be-3b69-45f3-9a20-d048084995d2 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.627659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfce4be-3b69-45f3-9a20-d048084995d2 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.632275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 291/575] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:26.633439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfce4be-3b69-45f3-9a20-d048084995d2 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:26.700675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc977c4-1461-4b8a-854c-f3e66d1b095c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:26.732042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0203c15-08d6-4514-bc51-92ad0b4ba9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:26.732867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0203c15-08d6-4514-bc51-92ad0b4ba9b6 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.733151 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0203c15-08d6-4514-bc51-92ad0b4ba9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.733428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0203c15-08d6-4514-bc51-92ad0b4ba9b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.741807 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfce4be-3b69-45f3-9a20-d048084995d2 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:26.743902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0203c15-08d6-4514-bc51-92ad0b4ba9b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:26.745414 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0203c15-08d6-4514-bc51-92ad0b4ba9b6 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:26.761625 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-d0203c15-08d6-4514-bc51-92ad0b4ba9b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:26.767079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 285/576] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:26.767079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0203c15-08d6-4514-bc51-92ad0b4ba9b6 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:26.779454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e88cff-78a3-49c7-9ed6-0944599578b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:26.780337 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88cff-78a3-49c7-9ed6-0944599578b9 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.780638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88cff-78a3-49c7-9ed6-0944599578b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.780898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88cff-78a3-49c7-9ed6-0944599578b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.788191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e88cff-78a3-49c7-9ed6-0944599578b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:26.789639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e88cff-78a3-49c7-9ed6-0944599578b9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:26.803091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-a3e88cff-78a3-49c7-9ed6-0944599578b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 15:20:26.805800 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 292/577] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Mar 8 15:20:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:26.807459 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6fc09-1fd7-4bac-a3a7-0a778fa3bafe None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.808133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6fc09-1fd7-4bac-a3a7-0a778fa3bafe None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.808997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6fc09-1fd7-4bac-a3a7-0a778fa3bafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.828889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-06b6fc09-1fd7-4bac-a3a7-0a778fa3bafe None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:26.830516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-06b6fc09-1fd7-4bac-a3a7-0a778fa3bafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:26.858068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0203c15-08d6-4514-bc51-92ad0b4ba9b6 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:26.889786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42653071-a880-47c5-b4a9-7b2be8d4aa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:26.890434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42653071-a880-47c5-b4a9-7b2be8d4aa40 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:26.890771 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42653071-a880-47c5-b4a9-7b2be8d4aa40 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:26.891008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42653071-a880-47c5-b4a9-7b2be8d4aa40 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:26.891713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42653071-a880-47c5-b4a9-7b2be8d4aa40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:26.892016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42653071-a880-47c5-b4a9-7b2be8d4aa40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:26.893399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42653071-a880-47c5-b4a9-7b2be8d4aa40 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:26.893688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 293/578] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:26.897468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6fc09-1fd7-4bac-a3a7-0a778fa3bafe None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:26.912945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 286/579] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:26.912945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42653071-a880-47c5-b4a9-7b2be8d4aa40 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.001348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6fc09-1fd7-4bac-a3a7-0a778fa3bafe None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:27.010293 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42653071-a880-47c5-b4a9-7b2be8d4aa40 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:27.034999 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa4904-fd9f-4e04-89ab-ecd9c5632dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:27.035742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa4904-fd9f-4e04-89ab-ecd9c5632dd3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:27.036229 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa4904-fd9f-4e04-89ab-ecd9c5632dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:27.036456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa4904-fd9f-4e04-89ab-ecd9c5632dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:27.037258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa4904-fd9f-4e04-89ab-ecd9c5632dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:27.037626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa4904-fd9f-4e04-89ab-ecd9c5632dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:27.039092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa4904-fd9f-4e04-89ab-ecd9c5632dd3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:27.042937 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf2e8c-31e0-4c03-bcf5-db5f90fcf665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:27.043609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf2e8c-31e0-4c03-bcf5-db5f90fcf665 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:27.043895 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf2e8c-31e0-4c03-bcf5-db5f90fcf665 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:27.044198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf2e8c-31e0-4c03-bcf5-db5f90fcf665 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:27.045793 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf2e8c-31e0-4c03-bcf5-db5f90fcf665 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:27.045896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf2e8c-31e0-4c03-bcf5-db5f90fcf665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:27.047319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf2e8c-31e0-4c03-bcf5-db5f90fcf665 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:27.051175 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 294/580] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:27.052252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa4904-fd9f-4e04-89ab-ecd9c5632dd3 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.065023 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 287/581] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Mar 8 15:20:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:27.065859 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf2e8c-31e0-4c03-bcf5-db5f90fcf665 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.162148 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa4904-fd9f-4e04-89ab-ecd9c5632dd3 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:27.171359 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf2e8c-31e0-4c03-bcf5-db5f90fcf665 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:27.194665 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db43968-032f-4453-8f31-38abb386008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:27.195460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db43968-032f-4453-8f31-38abb386008e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:27.195745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db43968-032f-4453-8f31-38abb386008e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:27.196018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db43968-032f-4453-8f31-38abb386008e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:27.202544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db43968-032f-4453-8f31-38abb386008e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:27.203995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db43968-032f-4453-8f31-38abb386008e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:27.206919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942facf2-1b97-466d-ba26-a15be87509a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:27.208216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942facf2-1b97-466d-ba26-a15be87509a4 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:27.208682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942facf2-1b97-466d-ba26-a15be87509a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:27.209156 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942facf2-1b97-466d-ba26-a15be87509a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:27.217258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-7db43968-032f-4453-8f31-38abb386008e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:27.218427 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 295/582] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:27.219192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db43968-032f-4453-8f31-38abb386008e None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.224620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942facf2-1b97-466d-ba26-a15be87509a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:27.233177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-942facf2-1b97-466d-ba26-a15be87509a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:27.235087 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 288/583] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:27.236273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942facf2-1b97-466d-ba26-a15be87509a4 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.323246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db43968-032f-4453-8f31-38abb386008e None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:27.342908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942facf2-1b97-466d-ba26-a15be87509a4 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:27.356753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637412e8-910c-4051-891e-de5172462aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:27.357545 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637412e8-910c-4051-891e-de5172462aa3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:27.357827 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637412e8-910c-4051-891e-de5172462aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:27.358120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637412e8-910c-4051-891e-de5172462aa3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:27.365958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637412e8-910c-4051-891e-de5172462aa3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:27.367703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637412e8-910c-4051-891e-de5172462aa3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:27.381911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-637412e8-910c-4051-891e-de5172462aa3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 15:20:27.383161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 296/584] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:27.383783 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825fc4e-c355-421f-8723-38f7e7b74e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:27.383972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637412e8-910c-4051-891e-de5172462aa3 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.385053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825fc4e-c355-421f-8723-38f7e7b74e7f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:27.385343 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825fc4e-c355-421f-8723-38f7e7b74e7f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:27.385620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825fc4e-c355-421f-8723-38f7e7b74e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:27.399204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825fc4e-c355-421f-8723-38f7e7b74e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:27.400706 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825fc4e-c355-421f-8723-38f7e7b74e7f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:27.417709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-7825fc4e-c355-421f-8723-38f7e7b74e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:27.423561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 289/585] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:27.423561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825fc4e-c355-421f-8723-38f7e7b74e7f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.485380 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637412e8-910c-4051-891e-de5172462aa3 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:27.518834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2eca9-0cb9-48fa-abd3-b3bb8c6ad9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:27.519172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825fc4e-c355-421f-8723-38f7e7b74e7f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:27.520222 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2eca9-0cb9-48fa-abd3-b3bb8c6ad9ef None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:27.520515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2eca9-0cb9-48fa-abd3-b3bb8c6ad9ef None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:27.520797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2eca9-0cb9-48fa-abd3-b3bb8c6ad9ef None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:27.521577 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2eca9-0cb9-48fa-abd3-b3bb8c6ad9ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:27.521892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2eca9-0cb9-48fa-abd3-b3bb8c6ad9ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:27.523323 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2eca9-0cb9-48fa-abd3-b3bb8c6ad9ef None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:27.534716 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 297/586] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:27.540518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2eca9-0cb9-48fa-abd3-b3bb8c6ad9ef None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.552952 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64670248-a99b-4f7f-ac72-9f4cd8d4b0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:27.558555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64670248-a99b-4f7f-ac72-9f4cd8d4b0a1 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:27.558555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64670248-a99b-4f7f-ac72-9f4cd8d4b0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:27.558555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64670248-a99b-4f7f-ac72-9f4cd8d4b0a1 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:27.558555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64670248-a99b-4f7f-ac72-9f4cd8d4b0a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:27.558555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64670248-a99b-4f7f-ac72-9f4cd8d4b0a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:27.558555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64670248-a99b-4f7f-ac72-9f4cd8d4b0a1 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:27.565132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 290/587] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:27.565826 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64670248-a99b-4f7f-ac72-9f4cd8d4b0a1 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.638949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2eca9-0cb9-48fa-abd3-b3bb8c6ad9ef None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:27.663103 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64670248-a99b-4f7f-ac72-9f4cd8d4b0a1 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:27.671485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5785c-a50b-49f9-934b-f9780ed452e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:27.672196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5785c-a50b-49f9-934b-f9780ed452e5 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:27.672488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5785c-a50b-49f9-934b-f9780ed452e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:27.672765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5785c-a50b-49f9-934b-f9780ed452e5 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:27.673597 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5785c-a50b-49f9-934b-f9780ed452e5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:27.673905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5785c-a50b-49f9-934b-f9780ed452e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:27.675354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5785c-a50b-49f9-934b-f9780ed452e5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:27.692791 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 298/588] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Mar 8 15:20:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:27.693607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5785c-a50b-49f9-934b-f9780ed452e5 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.697782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a9b91-e6ca-4ae0-84e8-caca773654a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:27.698722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a9b91-e6ca-4ae0-84e8-caca773654a3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:27.699198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a9b91-e6ca-4ae0-84e8-caca773654a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:27.699667 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a9b91-e6ca-4ae0-84e8-caca773654a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:27.700610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a9b91-e6ca-4ae0-84e8-caca773654a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:27.701141 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a9b91-e6ca-4ae0-84e8-caca773654a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:27.702701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a9b91-e6ca-4ae0-84e8-caca773654a3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:27.715289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 291/589] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:27.716514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a9b91-e6ca-4ae0-84e8-caca773654a3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.801847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5785c-a50b-49f9-934b-f9780ed452e5 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:27.812870 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a9b91-e6ca-4ae0-84e8-caca773654a3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:27.835085 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dc047-4e7e-4dda-9147-b70935841818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:27.836320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dc047-4e7e-4dda-9147-b70935841818 None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:27.836805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dc047-4e7e-4dda-9147-b70935841818 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:27.837256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dc047-4e7e-4dda-9147-b70935841818 None admin] PATH_INFO: `/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/2f9935443bcc4d34aeb56e5b77a96720/roles/40ab2eed29104ad783efc00ea49ea5d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:27.845986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d343848-2f53-4567-809e-3a37f4f67699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:27.846764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d343848-2f53-4567-809e-3a37f4f67699 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:27.847048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d343848-2f53-4567-809e-3a37f4f67699 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:27.847327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d343848-2f53-4567-809e-3a37f4f67699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:27.853079 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dc047-4e7e-4dda-9147-b70935841818 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdaa0405e224334ac42dc4cde1c01c5, user_id=2f9935443bcc4d34aeb56e5b77a96720, role_id=40ab2eed29104ad783efc00ea49ea5d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:27.854754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dc047-4e7e-4dda-9147-b70935841818 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:27.858036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d343848-2f53-4567-809e-3a37f4f67699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:27.859231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d343848-2f53-4567-809e-3a37f4f67699 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:27.875774 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-1d343848-2f53-4567-809e-3a37f4f67699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:27.876966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 292/590] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:27.877742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d343848-2f53-4567-809e-3a37f4f67699 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.913235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 299/591] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:20:27 2022] PUT /identity/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/2f9935443bcc4d34aeb56e5b77a96720/roles/40ab2eed29104ad783efc00ea49ea5d0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:20:27.913235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dc047-4e7e-4dda-9147-b70935841818 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:27.999346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d343848-2f53-4567-809e-3a37f4f67699 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:28.014352 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dc047-4e7e-4dda-9147-b70935841818 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:28.038581 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b865e59-9450-4f61-a032-5ce997c2f0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:28.039539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b865e59-9450-4f61-a032-5ce997c2f0b8 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.039875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b865e59-9450-4f61-a032-5ce997c2f0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.040226 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b865e59-9450-4f61-a032-5ce997c2f0b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.057280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b865e59-9450-4f61-a032-5ce997c2f0b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:28.060722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b865e59-9450-4f61-a032-5ce997c2f0b8 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:28.060841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bef39-6bff-416a-bfdc-95099284b8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:28.060841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bef39-6bff-416a-bfdc-95099284b8ef None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.060841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bef39-6bff-416a-bfdc-95099284b8ef None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.060841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bef39-6bff-416a-bfdc-95099284b8ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.080934 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bef39-6bff-416a-bfdc-95099284b8ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:28.082426 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bef39-6bff-416a-bfdc-95099284b8ef None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:28.083964 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-6b865e59-9450-4f61-a032-5ce997c2f0b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:28.085639 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 293/592] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:28.086513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b865e59-9450-4f61-a032-5ce997c2f0b8 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:28.097753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-714bef39-6bff-416a-bfdc-95099284b8ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:28.099438 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 300/593] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:28.100292 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bef39-6bff-416a-bfdc-95099284b8ef None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:28.194279 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b865e59-9450-4f61-a032-5ce997c2f0b8 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:28.216479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bef39-6bff-416a-bfdc-95099284b8ef None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:28.239757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7806abf-951a-4bf6-92cd-af0f581534c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:28.240795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7806abf-951a-4bf6-92cd-af0f581534c7 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.241093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7806abf-951a-4bf6-92cd-af0f581534c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.241371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7806abf-951a-4bf6-92cd-af0f581534c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.242317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7806abf-951a-4bf6-92cd-af0f581534c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:28.242631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7806abf-951a-4bf6-92cd-af0f581534c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:28.244792 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7806abf-951a-4bf6-92cd-af0f581534c7 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:28.254517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5355126-cd03-4140-b420-5879e14809ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:28.255171 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5355126-cd03-4140-b420-5879e14809ba None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.255448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5355126-cd03-4140-b420-5879e14809ba None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.255717 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5355126-cd03-4140-b420-5879e14809ba None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.256530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5355126-cd03-4140-b420-5879e14809ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:28.256833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5355126-cd03-4140-b420-5879e14809ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:28.258188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5355126-cd03-4140-b420-5879e14809ba None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:28.259341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 294/594] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:28.260269 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7806abf-951a-4bf6-92cd-af0f581534c7 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:28.275592 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 301/595] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:28.276525 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5355126-cd03-4140-b420-5879e14809ba None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:28.361320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7806abf-951a-4bf6-92cd-af0f581534c7 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:28.374207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5355126-cd03-4140-b420-5879e14809ba None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:28.397606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88aa04-90fc-40bc-99d9-fdbfd2607703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:28.398318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88aa04-90fc-40bc-99d9-fdbfd2607703 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.398608 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88aa04-90fc-40bc-99d9-fdbfd2607703 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.398883 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88aa04-90fc-40bc-99d9-fdbfd2607703 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.399674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88aa04-90fc-40bc-99d9-fdbfd2607703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:28.399981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88aa04-90fc-40bc-99d9-fdbfd2607703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:28.401461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88aa04-90fc-40bc-99d9-fdbfd2607703 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:28.408385 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bc09f-84ee-4512-96f9-b8ae2d4ee4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:28.409171 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bc09f-84ee-4512-96f9-b8ae2d4ee4c5 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.409453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bc09f-84ee-4512-96f9-b8ae2d4ee4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.409728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bc09f-84ee-4512-96f9-b8ae2d4ee4c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.414845 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 295/596] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:28.415741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88aa04-90fc-40bc-99d9-fdbfd2607703 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:28.417110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bc09f-84ee-4512-96f9-b8ae2d4ee4c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:28.418555 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bc09f-84ee-4512-96f9-b8ae2d4ee4c5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:28.433742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-a04bc09f-84ee-4512-96f9-b8ae2d4ee4c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 15:20:28.439492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 302/597] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:28.440345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bc09f-84ee-4512-96f9-b8ae2d4ee4c5 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:28.514690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88aa04-90fc-40bc-99d9-fdbfd2607703 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:28.543741 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bc09f-84ee-4512-96f9-b8ae2d4ee4c5 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:28.548363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46ddea-c212-445f-a1cc-1288c0964d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:28.549158 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46ddea-c212-445f-a1cc-1288c0964d5a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.549437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46ddea-c212-445f-a1cc-1288c0964d5a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.549712 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46ddea-c212-445f-a1cc-1288c0964d5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.557158 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46ddea-c212-445f-a1cc-1288c0964d5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:28.558603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46ddea-c212-445f-a1cc-1288c0964d5a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:28.572251 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-de46ddea-c212-445f-a1cc-1288c0964d5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:28.573427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 296/598] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:28.574392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46ddea-c212-445f-a1cc-1288c0964d5a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:28.579051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8591d5-b806-4f4d-9918-b19ebf9e44d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:28.580219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8591d5-b806-4f4d-9918-b19ebf9e44d4 None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.580502 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8591d5-b806-4f4d-9918-b19ebf9e44d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.580776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8591d5-b806-4f4d-9918-b19ebf9e44d4 None admin] PATH_INFO: `/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/c4fb404cc61d49d3aaec429f4f9f4f94/roles/40ab2eed29104ad783efc00ea49ea5d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.595706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8591d5-b806-4f4d-9918-b19ebf9e44d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdaa0405e224334ac42dc4cde1c01c5, user_id=c4fb404cc61d49d3aaec429f4f9f4f94, role_id=40ab2eed29104ad783efc00ea49ea5d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:28.597406 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8591d5-b806-4f4d-9918-b19ebf9e44d4 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:28.643104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 303/599] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:20:28 2022] PUT /identity/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/c4fb404cc61d49d3aaec429f4f9f4f94/roles/40ab2eed29104ad783efc00ea49ea5d0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:20:28.643897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8591d5-b806-4f4d-9918-b19ebf9e44d4 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:28.686226 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46ddea-c212-445f-a1cc-1288c0964d5a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:28.732190 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6d18f-b971-4030-a7ae-8f150a920d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:28.733183 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6d18f-b971-4030-a7ae-8f150a920d5d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.733467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6d18f-b971-4030-a7ae-8f150a920d5d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.733744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6d18f-b971-4030-a7ae-8f150a920d5d None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.735668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6d18f-b971-4030-a7ae-8f150a920d5d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:28.736000 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6d18f-b971-4030-a7ae-8f150a920d5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:28.737520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6d18f-b971-4030-a7ae-8f150a920d5d None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:28.767637 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 297/600] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Mar 8 15:20:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:28.770178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c6b52-3959-4f2e-98dc-8327d7d89916 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.770471 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c6b52-3959-4f2e-98dc-8327d7d89916 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.770748 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c6b52-3959-4f2e-98dc-8327d7d89916 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.771370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8591d5-b806-4f4d-9918-b19ebf9e44d4 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:28.772907 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 298/601] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:28.773711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c6b52-3959-4f2e-98dc-8327d7d89916 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:28.809160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcc16d-71ef-44e8-8f84-99f06019537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:28.809831 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcc16d-71ef-44e8-8f84-99f06019537a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.810117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcc16d-71ef-44e8-8f84-99f06019537a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.810395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcc16d-71ef-44e8-8f84-99f06019537a None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.811189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcc16d-71ef-44e8-8f84-99f06019537a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:28.811499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcc16d-71ef-44e8-8f84-99f06019537a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:28.813616 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcc16d-71ef-44e8-8f84-99f06019537a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:28.825749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 304/602] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:28.827588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd146-18b4-44cf-ab15-72e8a7e00cc3 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.827588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd146-18b4-44cf-ab15-72e8a7e00cc3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.827588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd146-18b4-44cf-ab15-72e8a7e00cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.844715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-031cd146-18b4-44cf-ab15-72e8a7e00cc3 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:28.846279 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-031cd146-18b4-44cf-ab15-72e8a7e00cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:28.898928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c6b52-3959-4f2e-98dc-8327d7d89916 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:28.915744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 305/603] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:28.916946 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cd146-18b4-44cf-ab15-72e8a7e00cc3 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:28.934170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d53dba-4588-44f8-8fc7-c0a0b53d14c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:28.935051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d53dba-4588-44f8-8fc7-c0a0b53d14c1 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:28.935337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d53dba-4588-44f8-8fc7-c0a0b53d14c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:28.935654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d53dba-4588-44f8-8fc7-c0a0b53d14c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:28.946473 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d53dba-4588-44f8-8fc7-c0a0b53d14c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:28.947976 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d53dba-4588-44f8-8fc7-c0a0b53d14c1 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:28.965349 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-24d53dba-4588-44f8-8fc7-c0a0b53d14c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:28.966788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 299/604] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:28.967585 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d53dba-4588-44f8-8fc7-c0a0b53d14c1 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:29.018016 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cd146-18b4-44cf-ab15-72e8a7e00cc3 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:29.052620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765a91e-ed18-4646-b7b8-adbc5b35d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:29.053867 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765a91e-ed18-4646-b7b8-adbc5b35d6fb None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:29.054348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765a91e-ed18-4646-b7b8-adbc5b35d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:29.054825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765a91e-ed18-4646-b7b8-adbc5b35d6fb None admin] PATH_INFO: `/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/028d499ea279442d822c6723c367f459/roles/40ab2eed29104ad783efc00ea49ea5d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:29.069551 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765a91e-ed18-4646-b7b8-adbc5b35d6fb None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdaa0405e224334ac42dc4cde1c01c5, user_id=028d499ea279442d822c6723c367f459, role_id=40ab2eed29104ad783efc00ea49ea5d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:29.071324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765a91e-ed18-4646-b7b8-adbc5b35d6fb None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:29.071869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d53dba-4588-44f8-8fc7-c0a0b53d14c1 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:29.106775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de85e1-e6c3-406e-8968-7818bca37b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:29.107567 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de85e1-e6c3-406e-8968-7818bca37b21 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:29.107852 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de85e1-e6c3-406e-8968-7818bca37b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:29.108126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de85e1-e6c3-406e-8968-7818bca37b21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:29.118507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de85e1-e6c3-406e-8968-7818bca37b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:29.125497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-c3de85e1-e6c3-406e-8968-7818bca37b21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:29.130380 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 300/605] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:29.130380 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de85e1-e6c3-406e-8968-7818bca37b21 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:29.160656 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 306/606] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:20:28 2022] PUT /identity/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/028d499ea279442d822c6723c367f459/roles/40ab2eed29104ad783efc00ea49ea5d0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:20:29.162012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765a91e-ed18-4646-b7b8-adbc5b35d6fb None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:29.234603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de85e1-e6c3-406e-8968-7818bca37b21 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:29.269734 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70bffa-d67f-44a9-bb0a-67ea984a689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:29.270400 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70bffa-d67f-44a9-bb0a-67ea984a689c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:29.270625 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70bffa-d67f-44a9-bb0a-67ea984a689c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:29.270860 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70bffa-d67f-44a9-bb0a-67ea984a689c None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:29.271587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70bffa-d67f-44a9-bb0a-67ea984a689c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:29.272389 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70bffa-d67f-44a9-bb0a-67ea984a689c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:29.273320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70bffa-d67f-44a9-bb0a-67ea984a689c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:29.287408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 301/607] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:29.292996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70bffa-d67f-44a9-bb0a-67ea984a689c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:29.398521 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765a91e-ed18-4646-b7b8-adbc5b35d6fb None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:29.408896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70bffa-d67f-44a9-bb0a-67ea984a689c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:29.443291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da852d5f-c7f2-4293-9d3d-4420a8f46d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:29.444080 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da852d5f-c7f2-4293-9d3d-4420a8f46d50 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:29.444381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da852d5f-c7f2-4293-9d3d-4420a8f46d50 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:29.444661 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da852d5f-c7f2-4293-9d3d-4420a8f46d50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:29.445629 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76c345-4569-42ae-9cf6-be7535dd8702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:29.446574 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76c345-4569-42ae-9cf6-be7535dd8702 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:29.447054 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76c345-4569-42ae-9cf6-be7535dd8702 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:29.447529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76c345-4569-42ae-9cf6-be7535dd8702 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:29.448534 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76c345-4569-42ae-9cf6-be7535dd8702 None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:29.449096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76c345-4569-42ae-9cf6-be7535dd8702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:29.450713 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76c345-4569-42ae-9cf6-be7535dd8702 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:29.453329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da852d5f-c7f2-4293-9d3d-4420a8f46d50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:29.454672 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da852d5f-c7f2-4293-9d3d-4420a8f46d50 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:29.460846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 307/608] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:29.466405 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76c345-4569-42ae-9cf6-be7535dd8702 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:29.468254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-da852d5f-c7f2-4293-9d3d-4420a8f46d50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:29.469692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 302/609] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:29.475013 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da852d5f-c7f2-4293-9d3d-4420a8f46d50 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:29.583398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da852d5f-c7f2-4293-9d3d-4420a8f46d50 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:29.594348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76c345-4569-42ae-9cf6-be7535dd8702 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:29.619829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b7fe4-7386-4870-a775-6a8527708aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:29.620521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7fe4-7386-4870-a775-6a8527708aba None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:29.623501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7fe4-7386-4870-a775-6a8527708aba None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:29.623501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b7fe4-7386-4870-a775-6a8527708aba None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:29.623501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b7fe4-7386-4870-a775-6a8527708aba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:29.623501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b7fe4-7386-4870-a775-6a8527708aba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:29.623770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b7fe4-7386-4870-a775-6a8527708aba None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:29.638710 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 303/610] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:29.645343 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b7fe4-7386-4870-a775-6a8527708aba None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:29.687959 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774caf-3aae-4237-a943-f547864125a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:29.689168 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774caf-3aae-4237-a943-f547864125a1 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:29.689645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774caf-3aae-4237-a943-f547864125a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:29.690105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6774caf-3aae-4237-a943-f547864125a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:29.718620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774caf-3aae-4237-a943-f547864125a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:29.720091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6774caf-3aae-4237-a943-f547864125a1 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:29.757466 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b7fe4-7386-4870-a775-6a8527708aba None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:29.774246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-a6774caf-3aae-4237-a943-f547864125a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:29.775786 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 308/611] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:29.781078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774caf-3aae-4237-a943-f547864125a1 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:29.793733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace18439-2842-4178-a266-ce551d8bc982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:29.794620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace18439-2842-4178-a266-ce551d8bc982 None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:29.794958 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace18439-2842-4178-a266-ce551d8bc982 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:29.795232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace18439-2842-4178-a266-ce551d8bc982 None admin] PATH_INFO: `/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/7acd143470fb416c8adc57351c5d0324/roles/40ab2eed29104ad783efc00ea49ea5d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:29.812215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace18439-2842-4178-a266-ce551d8bc982 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdaa0405e224334ac42dc4cde1c01c5, user_id=7acd143470fb416c8adc57351c5d0324, role_id=40ab2eed29104ad783efc00ea49ea5d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:29.813686 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace18439-2842-4178-a266-ce551d8bc982 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:29.889850 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 304/612] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:20:29 2022] PUT /identity/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/7acd143470fb416c8adc57351c5d0324/roles/40ab2eed29104ad783efc00ea49ea5d0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:20:29.923747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6774caf-3aae-4237-a943-f547864125a1 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:29.960365 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c2cb9-dbfb-425b-b387-c5dfee78ee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:29.961023 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c2cb9-dbfb-425b-b387-c5dfee78ee74 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:29.961303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c2cb9-dbfb-425b-b387-c5dfee78ee74 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:29.961577 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c2cb9-dbfb-425b-b387-c5dfee78ee74 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:29.962291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c2cb9-dbfb-425b-b387-c5dfee78ee74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:29.962595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c2cb9-dbfb-425b-b387-c5dfee78ee74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:29.963984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c2cb9-dbfb-425b-b387-c5dfee78ee74 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:29.977778 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 309/613] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:29.985284 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace18439-2842-4178-a266-ce551d8bc982 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:30.128326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace18439-2842-4178-a266-ce551d8bc982 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:30.186371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf82a-6761-472e-8607-9e6751394d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:30.187178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf82a-6761-472e-8607-9e6751394d37 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:30.187458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf82a-6761-472e-8607-9e6751394d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:30.187729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf82a-6761-472e-8607-9e6751394d37 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:30.197471 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf82a-6761-472e-8607-9e6751394d37 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:30.199002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf82a-6761-472e-8607-9e6751394d37 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:30.214677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-caabf82a-6761-472e-8607-9e6751394d37 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 15:20:30.216114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 305/614] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:30.221668 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c2cb9-dbfb-425b-b387-c5dfee78ee74 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:30.324688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c2cb9-dbfb-425b-b387-c5dfee78ee74 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:30.359682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afd253-4442-4d7c-86bd-9aea9e1a72a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:30.360378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afd253-4442-4d7c-86bd-9aea9e1a72a5 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:30.360657 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afd253-4442-4d7c-86bd-9aea9e1a72a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:30.360930 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afd253-4442-4d7c-86bd-9aea9e1a72a5 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:30.361826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afd253-4442-4d7c-86bd-9aea9e1a72a5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:30.362129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afd253-4442-4d7c-86bd-9aea9e1a72a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:30.363909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afd253-4442-4d7c-86bd-9aea9e1a72a5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:30.382194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 310/615] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Mar 8 15:20:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:30.387202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf82a-6761-472e-8607-9e6751394d37 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:30.499779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956db6a5-99a5-4c9b-bff8-10f342ec9351 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:30.500297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956db6a5-99a5-4c9b-bff8-10f342ec9351 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:30.500503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956db6a5-99a5-4c9b-bff8-10f342ec9351 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:30.502610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 311/616] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:20:30.508326 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b1097-e48f-4cb5-b583-a262e416c0e9 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:30.508719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b1097-e48f-4cb5-b583-a262e416c0e9 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:30.509158 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b1097-e48f-4cb5-b583-a262e416c0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:30.517610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf82a-6761-472e-8607-9e6751394d37 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:30.534142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-311b1097-e48f-4cb5-b583-a262e416c0e9 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:30.535881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-311b1097-e48f-4cb5-b583-a262e416c0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:30.577166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8803a-fe4c-4948-bda5-2f4b4eef1d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:30.578187 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8803a-fe4c-4948-bda5-2f4b4eef1d33 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:30.578646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8803a-fe4c-4948-bda5-2f4b4eef1d33 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:30.579068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8803a-fe4c-4948-bda5-2f4b4eef1d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:30.605574 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8803a-fe4c-4948-bda5-2f4b4eef1d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:30.607274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8803a-fe4c-4948-bda5-2f4b4eef1d33 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:30.615553 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 312/617] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:20:30.637322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-b2e8803a-fe4c-4948-bda5-2f4b4eef1d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:30.639603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 306/618] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:30.643026 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b1097-e48f-4cb5-b583-a262e416c0e9 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:30.644053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8803a-fe4c-4948-bda5-2f4b4eef1d33 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:30.752523 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b1097-e48f-4cb5-b583-a262e416c0e9 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:30.798854 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6050c-f67b-4ef8-b826-2907cc00c2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:30.799655 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6050c-f67b-4ef8-b826-2907cc00c2d8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:30.799971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6050c-f67b-4ef8-b826-2907cc00c2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:30.801269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6050c-f67b-4ef8-b826-2907cc00c2d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:30.819348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6050c-f67b-4ef8-b826-2907cc00c2d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:30.826843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8803a-fe4c-4948-bda5-2f4b4eef1d33 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:30.833459 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-0fa6050c-f67b-4ef8-b826-2907cc00c2d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:30.834970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 313/619] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:30.840667 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6050c-f67b-4ef8-b826-2907cc00c2d8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:30.861364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192d2d-8b8f-4db0-ad33-4767e22ca290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:30.862363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192d2d-8b8f-4db0-ad33-4767e22ca290 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:30.863359 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192d2d-8b8f-4db0-ad33-4767e22ca290 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:30.863830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5192d2d-8b8f-4db0-ad33-4767e22ca290 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:30.864766 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192d2d-8b8f-4db0-ad33-4767e22ca290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:30.865271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192d2d-8b8f-4db0-ad33-4767e22ca290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:30.866838 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5192d2d-8b8f-4db0-ad33-4767e22ca290 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:30.879170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 307/620] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:30.885114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192d2d-8b8f-4db0-ad33-4767e22ca290 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:31.013476 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6050c-f67b-4ef8-b826-2907cc00c2d8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:31.065130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5192d2d-8b8f-4db0-ad33-4767e22ca290 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:31.095480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f11613-979c-4db8-a8e3-697c74dbb05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:31.096511 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f11613-979c-4db8-a8e3-697c74dbb05a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:31.096940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f11613-979c-4db8-a8e3-697c74dbb05a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:31.104165 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f11613-979c-4db8-a8e3-697c74dbb05a None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:31.104165 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f11613-979c-4db8-a8e3-697c74dbb05a None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:31.104165 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f11613-979c-4db8-a8e3-697c74dbb05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:31.104165 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f11613-979c-4db8-a8e3-697c74dbb05a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:31.119564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 314/621] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:31.124563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f11613-979c-4db8-a8e3-697c74dbb05a None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:31.132010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b36ac-4a64-4918-bc3f-28e362be26b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:31.133211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b36ac-4a64-4918-bc3f-28e362be26b3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:31.133630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b36ac-4a64-4918-bc3f-28e362be26b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:31.134106 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b36ac-4a64-4918-bc3f-28e362be26b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:31.144192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b36ac-4a64-4918-bc3f-28e362be26b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:31.146606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b36ac-4a64-4918-bc3f-28e362be26b3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:31.170937 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-156b36ac-4a64-4918-bc3f-28e362be26b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:31.180838 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 308/622] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:31.184744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b36ac-4a64-4918-bc3f-28e362be26b3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:31.296479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f11613-979c-4db8-a8e3-697c74dbb05a None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:31.335425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59f246-0cb8-480e-b5fc-fc72a8d2068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:31.336243 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f246-0cb8-480e-b5fc-fc72a8d2068b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:31.336689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f246-0cb8-480e-b5fc-fc72a8d2068b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:31.336964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f246-0cb8-480e-b5fc-fc72a8d2068b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:31.351044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59f246-0cb8-480e-b5fc-fc72a8d2068b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:31.353007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59f246-0cb8-480e-b5fc-fc72a8d2068b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:31.361129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b36ac-4a64-4918-bc3f-28e362be26b3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:31.370626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-ce59f246-0cb8-480e-b5fc-fc72a8d2068b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:31.372111 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 315/623] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:31.377721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d432f6f-99eb-4cc0-a9b2-e3ea987ec845 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:31.378007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d432f6f-99eb-4cc0-a9b2-e3ea987ec845 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:31.378283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d432f6f-99eb-4cc0-a9b2-e3ea987ec845 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:31.380812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 316/624] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:31.381525 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d432f6f-99eb-4cc0-a9b2-e3ea987ec845 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:31.400942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13e34-453c-49eb-8e28-2ae4c6e13f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:31.401911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13e34-453c-49eb-8e28-2ae4c6e13f18 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:31.402191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13e34-453c-49eb-8e28-2ae4c6e13f18 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:31.402464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13e34-453c-49eb-8e28-2ae4c6e13f18 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:31.403242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13e34-453c-49eb-8e28-2ae4c6e13f18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:31.403550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13e34-453c-49eb-8e28-2ae4c6e13f18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:31.405708 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13e34-453c-49eb-8e28-2ae4c6e13f18 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:31.420754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 309/625] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:31.422018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aee790-1284-4907-93d1-d1ec20e4441e None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:31.422309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aee790-1284-4907-93d1-d1ec20e4441e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:31.423021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aee790-1284-4907-93d1-d1ec20e4441e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:31.444780 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-67aee790-1284-4907-93d1-d1ec20e4441e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:31.446448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-67aee790-1284-4907-93d1-d1ec20e4441e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:31.484874 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d432f6f-99eb-4cc0-a9b2-e3ea987ec845 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:31.519815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5cc06-183b-49c1-ba47-d680abac3a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:31.520586 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5cc06-183b-49c1-ba47-d680abac3a94 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:31.520969 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5cc06-183b-49c1-ba47-d680abac3a94 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:31.521307 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5cc06-183b-49c1-ba47-d680abac3a94 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:31.522096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5cc06-183b-49c1-ba47-d680abac3a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:31.522500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5cc06-183b-49c1-ba47-d680abac3a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:31.523997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5cc06-183b-49c1-ba47-d680abac3a94 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:31.524381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 310/626] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:31.525251 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aee790-1284-4907-93d1-d1ec20e4441e None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:31.536814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 317/627] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:31.542223 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5cc06-183b-49c1-ba47-d680abac3a94 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:31.646603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aee790-1284-4907-93d1-d1ec20e4441e None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:31.646956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5cc06-183b-49c1-ba47-d680abac3a94 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:31.681327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ddc09-3d6b-4529-9a4c-4ab97bbfbc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:31.681669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e4984-e6f2-41e8-9406-7285abc3981b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:31.682112 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e4984-e6f2-41e8-9406-7285abc3981b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:31.682272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ddc09-3d6b-4529-9a4c-4ab97bbfbc9f None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:31.682460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ddc09-3d6b-4529-9a4c-4ab97bbfbc9f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:31.682609 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e4984-e6f2-41e8-9406-7285abc3981b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:31.682748 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ddc09-3d6b-4529-9a4c-4ab97bbfbc9f None admin] PATH_INFO: `/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/10fc82e0c3f0414492c1df4381918877/roles/40ab2eed29104ad783efc00ea49ea5d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:31.682895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e4984-e6f2-41e8-9406-7285abc3981b None admin] PATH_INFO: `/v3/users/glance` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:31.691896 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e4984-e6f2-41e8-9406-7285abc3981b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:31.693576 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e4984-e6f2-41e8-9406-7285abc3981b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:31.697188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ddc09-3d6b-4529-9a4c-4ab97bbfbc9f None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdaa0405e224334ac42dc4cde1c01c5, user_id=10fc82e0c3f0414492c1df4381918877, role_id=40ab2eed29104ad783efc00ea49ea5d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:31.698720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ddc09-3d6b-4529-9a4c-4ab97bbfbc9f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:31.707706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-452e4984-e6f2-41e8-9406-7285abc3981b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 15:20:31.708906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 318/628] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:31.709661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e4984-e6f2-41e8-9406-7285abc3981b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:31.784320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 311/629] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:20:31 2022] PUT /identity/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/10fc82e0c3f0414492c1df4381918877/roles/40ab2eed29104ad783efc00ea49ea5d0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:20:31.785968 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ddc09-3d6b-4529-9a4c-4ab97bbfbc9f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:31.865015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e4984-e6f2-41e8-9406-7285abc3981b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:31.936671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59c729-939e-41c2-88ae-e8fd27d130f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:31.937816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59c729-939e-41c2-88ae-e8fd27d130f5 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:31.938097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59c729-939e-41c2-88ae-e8fd27d130f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:31.938642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59c729-939e-41c2-88ae-e8fd27d130f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:31.952835 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59c729-939e-41c2-88ae-e8fd27d130f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:31.955955 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ddc09-3d6b-4529-9a4c-4ab97bbfbc9f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:31.961795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-7e59c729-939e-41c2-88ae-e8fd27d130f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:31.963362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 319/630] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:31.965208 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a412e22-a5fd-4e27-8b12-96b5d2b9fd18 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:31.965495 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a412e22-a5fd-4e27-8b12-96b5d2b9fd18 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:31.965772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a412e22-a5fd-4e27-8b12-96b5d2b9fd18 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:31.971977 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 320/631] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:31.973421 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a412e22-a5fd-4e27-8b12-96b5d2b9fd18 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:31.994785 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffaf0a-c9cb-4bd4-84d6-657571f3ad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:31.995458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffaf0a-c9cb-4bd4-84d6-657571f3ad34 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:31.995744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffaf0a-c9cb-4bd4-84d6-657571f3ad34 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:31.996024 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffaf0a-c9cb-4bd4-84d6-657571f3ad34 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:31.996896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffaf0a-c9cb-4bd4-84d6-657571f3ad34 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:31.997205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffaf0a-c9cb-4bd4-84d6-657571f3ad34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:31.998658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffaf0a-c9cb-4bd4-84d6-657571f3ad34 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:32.017021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 312/632] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Mar 8 15:20:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:32.018568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57ec5e-f127-4594-83fd-eaef0977b08c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:32.019603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57ec5e-f127-4594-83fd-eaef0977b08c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:32.020068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57ec5e-f127-4594-83fd-eaef0977b08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:32.037331 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-9e57ec5e-f127-4594-83fd-eaef0977b08c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:32.038817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9e57ec5e-f127-4594-83fd-eaef0977b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:32.089687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a412e22-a5fd-4e27-8b12-96b5d2b9fd18 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:32.120704 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 313/633] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:32.121474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57ec5e-f127-4594-83fd-eaef0977b08c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:32.132003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cb40-ede7-42fb-8266-0009455c4aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:32.133000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cb40-ede7-42fb-8266-0009455c4aea None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:32.133492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cb40-ede7-42fb-8266-0009455c4aea None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:32.133954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01cb40-ede7-42fb-8266-0009455c4aea None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:32.134915 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01cb40-ede7-42fb-8266-0009455c4aea None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:32.135420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01cb40-ede7-42fb-8266-0009455c4aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:32.137895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01cb40-ede7-42fb-8266-0009455c4aea None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:32.152479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 321/634] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:32.154170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cb40-ede7-42fb-8266-0009455c4aea None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:32.246627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57ec5e-f127-4594-83fd-eaef0977b08c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:32.270487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01cb40-ede7-42fb-8266-0009455c4aea None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:32.289085 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfdccc-de8c-442d-be2a-d50a5fd00d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:32.289865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfdccc-de8c-442d-be2a-d50a5fd00d56 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:32.290246 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfdccc-de8c-442d-be2a-d50a5fd00d56 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:32.290615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfdccc-de8c-442d-be2a-d50a5fd00d56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:32.305323 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1b9aa-3b52-4021-b122-fd0be300184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:32.306166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1b9aa-3b52-4021-b122-fd0be300184c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:32.306502 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1b9aa-3b52-4021-b122-fd0be300184c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:32.306779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1b9aa-3b52-4021-b122-fd0be300184c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:32.317698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1b9aa-3b52-4021-b122-fd0be300184c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:32.319321 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1b9aa-3b52-4021-b122-fd0be300184c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:32.336350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-f4f1b9aa-3b52-4021-b122-fd0be300184c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:32.337842 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 322/635] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:32.338699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1b9aa-3b52-4021-b122-fd0be300184c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:32.381456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfdccc-de8c-442d-be2a-d50a5fd00d56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:32.383023 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfdccc-de8c-442d-be2a-d50a5fd00d56 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:32.450271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1b9aa-3b52-4021-b122-fd0be300184c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:32.498489 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45ed7e-41d0-4ad1-b991-5f2d629febf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:32.499561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45ed7e-41d0-4ad1-b991-5f2d629febf8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:32.499789 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 314/636] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:32.500305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45ed7e-41d0-4ad1-b991-5f2d629febf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:32.500305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45ed7e-41d0-4ad1-b991-5f2d629febf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:32.500755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfdccc-de8c-442d-be2a-d50a5fd00d56 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:32.513194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45ed7e-41d0-4ad1-b991-5f2d629febf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:32.521647 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-1b45ed7e-41d0-4ad1-b991-5f2d629febf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:32.528691 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 323/637] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:32.529562 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45ed7e-41d0-4ad1-b991-5f2d629febf8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:32.602058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfdccc-de8c-442d-be2a-d50a5fd00d56 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:32.637001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745c395-f565-4c1c-ad32-eabf823b42d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:32.637664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745c395-f565-4c1c-ad32-eabf823b42d9 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:32.637943 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745c395-f565-4c1c-ad32-eabf823b42d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:32.638124 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45ed7e-41d0-4ad1-b991-5f2d629febf8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:32.638274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745c395-f565-4c1c-ad32-eabf823b42d9 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:32.638933 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745c395-f565-4c1c-ad32-eabf823b42d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:32.639236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745c395-f565-4c1c-ad32-eabf823b42d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:32.640744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745c395-f565-4c1c-ad32-eabf823b42d9 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:32.652738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 315/638] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:32.653568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745c395-f565-4c1c-ad32-eabf823b42d9 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:32.674829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140a951-f358-48fc-b001-427bea793c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:32.675678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140a951-f358-48fc-b001-427bea793c45 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:32.675962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140a951-f358-48fc-b001-427bea793c45 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:32.676303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140a951-f358-48fc-b001-427bea793c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:32.686780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140a951-f358-48fc-b001-427bea793c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:32.688343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140a951-f358-48fc-b001-427bea793c45 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:32.705064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-7140a951-f358-48fc-b001-427bea793c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:32.707104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 324/639] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:32.707939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140a951-f358-48fc-b001-427bea793c45 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:32.773867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745c395-f565-4c1c-ad32-eabf823b42d9 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:32.815604 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8111968-ad91-4e09-8c2f-c9db6866ae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:32.816980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111968-ad91-4e09-8c2f-c9db6866ae43 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:32.817271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111968-ad91-4e09-8c2f-c9db6866ae43 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:32.817548 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111968-ad91-4e09-8c2f-c9db6866ae43 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:32.817707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140a951-f358-48fc-b001-427bea793c45 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:32.818294 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8111968-ad91-4e09-8c2f-c9db6866ae43 None admin] RBAC: Adding query filter params (name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:32.818600 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8111968-ad91-4e09-8c2f-c9db6866ae43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:32.820954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8111968-ad91-4e09-8c2f-c9db6866ae43 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:32.831490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 316/640] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:32.832361 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8111968-ad91-4e09-8c2f-c9db6866ae43 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:32.865197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386950aa-e2fd-4126-b311-8eb4f8cb55e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:32.866112 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386950aa-e2fd-4126-b311-8eb4f8cb55e6 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:32.866388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386950aa-e2fd-4126-b311-8eb4f8cb55e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:32.866661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386950aa-e2fd-4126-b311-8eb4f8cb55e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:32.874255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386950aa-e2fd-4126-b311-8eb4f8cb55e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:32.875697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386950aa-e2fd-4126-b311-8eb4f8cb55e6 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:32.889776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-386950aa-e2fd-4126-b311-8eb4f8cb55e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 15:20:32.892325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 325/641] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Mar 8 15:20:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:32.892325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386950aa-e2fd-4126-b311-8eb4f8cb55e6 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:32.930192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8111968-ad91-4e09-8c2f-c9db6866ae43 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:32.962824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf439181-ae05-4eb9-ad70-41084152131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:32.963478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439181-ae05-4eb9-ad70-41084152131a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:32.963758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439181-ae05-4eb9-ad70-41084152131a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:32.964033 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439181-ae05-4eb9-ad70-41084152131a None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:32.964773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf439181-ae05-4eb9-ad70-41084152131a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:32.965077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf439181-ae05-4eb9-ad70-41084152131a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:32.966435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf439181-ae05-4eb9-ad70-41084152131a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:32.978294 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 317/642] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:32.979831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f909ed-a643-4ef2-a187-5071a67d6e71 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:32.980210 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f909ed-a643-4ef2-a187-5071a67d6e71 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:32.980582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f909ed-a643-4ef2-a187-5071a67d6e71 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:32.982423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 318/643] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:32.983057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f909ed-a643-4ef2-a187-5071a67d6e71 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:32.997499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386950aa-e2fd-4126-b311-8eb4f8cb55e6 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:33.031721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378da422-971d-4528-9920-465352081bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:33.032555 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378da422-971d-4528-9920-465352081bdb None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:33.032839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378da422-971d-4528-9920-465352081bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:33.033115 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378da422-971d-4528-9920-465352081bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:33.043447 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378da422-971d-4528-9920-465352081bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:33.044921 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378da422-971d-4528-9920-465352081bdb None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:33.062863 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-378da422-971d-4528-9920-465352081bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:33.069189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 326/644] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:33.069189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378da422-971d-4528-9920-465352081bdb None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:33.094751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f909ed-a643-4ef2-a187-5071a67d6e71 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:33.128974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5f70a-9a43-4704-976b-9836b1fba94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:33.129646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5f70a-9a43-4704-976b-9836b1fba94d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:33.129938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5f70a-9a43-4704-976b-9836b1fba94d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:33.130216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5f70a-9a43-4704-976b-9836b1fba94d None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:33.131043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5f70a-9a43-4704-976b-9836b1fba94d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:33.131359 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5f70a-9a43-4704-976b-9836b1fba94d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:33.132817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5f70a-9a43-4704-976b-9836b1fba94d None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:33.154488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 319/645] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Mar 8 15:20:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:33.154488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c764d-5a17-4f2a-9acd-49f89fcdbc5e None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:33.154488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c764d-5a17-4f2a-9acd-49f89fcdbc5e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:33.154488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c764d-5a17-4f2a-9acd-49f89fcdbc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:33.167915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b26c764d-5a17-4f2a-9acd-49f89fcdbc5e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:33.169160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b26c764d-5a17-4f2a-9acd-49f89fcdbc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:33.176197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378da422-971d-4528-9920-465352081bdb None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:33.207371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243f1d2-8c56-4e62-b1bb-c99fa344572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:33.208176 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243f1d2-8c56-4e62-b1bb-c99fa344572a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:33.208461 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243f1d2-8c56-4e62-b1bb-c99fa344572a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:33.208734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243f1d2-8c56-4e62-b1bb-c99fa344572a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:33.215205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243f1d2-8c56-4e62-b1bb-c99fa344572a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:33.216681 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243f1d2-8c56-4e62-b1bb-c99fa344572a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:33.230034 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-d243f1d2-8c56-4e62-b1bb-c99fa344572a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:33.235940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 327/646] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:33.235940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243f1d2-8c56-4e62-b1bb-c99fa344572a None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:33.238205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 320/647] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:33.239048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c764d-5a17-4f2a-9acd-49f89fcdbc5e None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:33.334038 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243f1d2-8c56-4e62-b1bb-c99fa344572a None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:33.337408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c764d-5a17-4f2a-9acd-49f89fcdbc5e None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:33.367706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7792d-df26-45a6-a217-5a07aba45b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:33.368412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7792d-df26-45a6-a217-5a07aba45b0a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:33.368678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7792d-df26-45a6-a217-5a07aba45b0a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:33.368957 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7792d-df26-45a6-a217-5a07aba45b0a None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:33.369674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7792d-df26-45a6-a217-5a07aba45b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:33.369982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7792d-df26-45a6-a217-5a07aba45b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:33.371375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7792d-df26-45a6-a217-5a07aba45b0a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:33.372453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b25782-858e-40ea-ba49-c45740e93105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:33.373295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b25782-858e-40ea-ba49-c45740e93105 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:33.373750 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b25782-858e-40ea-ba49-c45740e93105 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:33.374197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b25782-858e-40ea-ba49-c45740e93105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:33.382180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 328/648] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:33.382967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7792d-df26-45a6-a217-5a07aba45b0a None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:33.445715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b25782-858e-40ea-ba49-c45740e93105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:33.447160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b25782-858e-40ea-ba49-c45740e93105 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:33.477991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7792d-df26-45a6-a217-5a07aba45b0a None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:33.510075 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc18db7-4fb8-4783-92f9-34c0321093f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:33.510727 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc18db7-4fb8-4783-92f9-34c0321093f4 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:33.511006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc18db7-4fb8-4783-92f9-34c0321093f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:33.511276 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc18db7-4fb8-4783-92f9-34c0321093f4 None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:33.512047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc18db7-4fb8-4783-92f9-34c0321093f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:33.512377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc18db7-4fb8-4783-92f9-34c0321093f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:33.513809 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc18db7-4fb8-4783-92f9-34c0321093f4 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:33.530367 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 329/649] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:33.530367 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc18db7-4fb8-4783-92f9-34c0321093f4 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:33.547045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 321/650] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:33.549095 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b25782-858e-40ea-ba49-c45740e93105 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:33.629716 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc18db7-4fb8-4783-92f9-34c0321093f4 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:33.647257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b25782-858e-40ea-ba49-c45740e93105 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:33.666195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643852b-f759-4b23-b837-154b590ba686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:33.666977 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643852b-f759-4b23-b837-154b590ba686 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:33.667507 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643852b-f759-4b23-b837-154b590ba686 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:33.667507 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643852b-f759-4b23-b837-154b590ba686 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:33.677116 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643852b-f759-4b23-b837-154b590ba686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:33.680125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f5307-50e9-40c9-a57c-6fc59c21beae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:33.680939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f5307-50e9-40c9-a57c-6fc59c21beae None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:33.681221 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f5307-50e9-40c9-a57c-6fc59c21beae None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:33.681496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f5307-50e9-40c9-a57c-6fc59c21beae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:33.683925 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-7643852b-f759-4b23-b837-154b590ba686 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:33.690150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 330/651] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:33.690150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643852b-f759-4b23-b837-154b590ba686 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:33.690337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f5307-50e9-40c9-a57c-6fc59c21beae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:33.690407 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f5307-50e9-40c9-a57c-6fc59c21beae None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:33.704123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-063f5307-50e9-40c9-a57c-6fc59c21beae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 15:20:33.705649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 322/652] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:33.707011 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f5307-50e9-40c9-a57c-6fc59c21beae None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:33.790237 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643852b-f759-4b23-b837-154b590ba686 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:33.802187 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f5307-50e9-40c9-a57c-6fc59c21beae None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:33.828928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4214027-b452-4eb9-9eaf-dd96094aab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:33.829583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4214027-b452-4eb9-9eaf-dd96094aab01 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:33.829868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4214027-b452-4eb9-9eaf-dd96094aab01 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:33.830139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4214027-b452-4eb9-9eaf-dd96094aab01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:33.830967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4214027-b452-4eb9-9eaf-dd96094aab01 None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=2f9935443bcc4d34aeb56e5b77a96720) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:33.831800 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4214027-b452-4eb9-9eaf-dd96094aab01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:33.833372 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4214027-b452-4eb9-9eaf-dd96094aab01 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:33.839375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 331/653] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:33 2022] GET /identity/v3/role_assignments?user.id=2f9935443bcc4d34aeb56e5b77a96720&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:33.839783 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2d360-9de4-4f2e-ba5f-06aff149d416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:33.840173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4214027-b452-4eb9-9eaf-dd96094aab01 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:33.841199 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2d360-9de4-4f2e-ba5f-06aff149d416 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:33.841545 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2d360-9de4-4f2e-ba5f-06aff149d416 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:33.841890 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2d360-9de4-4f2e-ba5f-06aff149d416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:33.854279 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2d360-9de4-4f2e-ba5f-06aff149d416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:33.855957 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2d360-9de4-4f2e-ba5f-06aff149d416 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:33.875068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-66c2d360-9de4-4f2e-ba5f-06aff149d416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:33.881759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 323/654] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:33.882779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2d360-9de4-4f2e-ba5f-06aff149d416 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:33.962643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4214027-b452-4eb9-9eaf-dd96094aab01 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:33.988555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2d360-9de4-4f2e-ba5f-06aff149d416 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:33.998657 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c28381-ccad-4d5f-a3e7-ebdb3532b1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:33.999537 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c28381-ccad-4d5f-a3e7-ebdb3532b1c3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:33.999815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c28381-ccad-4d5f-a3e7-ebdb3532b1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.000190 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c28381-ccad-4d5f-a3e7-ebdb3532b1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.001100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c28381-ccad-4d5f-a3e7-ebdb3532b1c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:34.001733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c28381-ccad-4d5f-a3e7-ebdb3532b1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:34.002978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c28381-ccad-4d5f-a3e7-ebdb3532b1c3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:34.016838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 332/655] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:34.016838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c28381-ccad-4d5f-a3e7-ebdb3532b1c3 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:34.039125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817b79c-139c-40f2-83b9-1d13f372bfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:34.039851 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817b79c-139c-40f2-83b9-1d13f372bfb2 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:34.040134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817b79c-139c-40f2-83b9-1d13f372bfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.040433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817b79c-139c-40f2-83b9-1d13f372bfb2 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.041264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817b79c-139c-40f2-83b9-1d13f372bfb2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:34.041655 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817b79c-139c-40f2-83b9-1d13f372bfb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:34.042994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817b79c-139c-40f2-83b9-1d13f372bfb2 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:34.063710 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 324/656] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Mar 8 15:20:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:34.064522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817b79c-139c-40f2-83b9-1d13f372bfb2 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:34.161733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c28381-ccad-4d5f-a3e7-ebdb3532b1c3 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:34.189441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817b79c-139c-40f2-83b9-1d13f372bfb2 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:34.195675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1d3a3-b89e-4cd3-86f1-0d76c35f353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:34.196361 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1d3a3-b89e-4cd3-86f1-0d76c35f353d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:34.196644 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1d3a3-b89e-4cd3-86f1-0d76c35f353d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.197035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1d3a3-b89e-4cd3-86f1-0d76c35f353d None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.197758 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1d3a3-b89e-4cd3-86f1-0d76c35f353d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:34.198062 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1d3a3-b89e-4cd3-86f1-0d76c35f353d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:34.199424 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e1d3a3-b89e-4cd3-86f1-0d76c35f353d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:34.212510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 333/657] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:34.212510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1d3a3-b89e-4cd3-86f1-0d76c35f353d None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:34.223443 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862df72b-6ec4-4d0f-aca7-c07af64c6bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:34.224272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862df72b-6ec4-4d0f-aca7-c07af64c6bad None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:34.224559 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862df72b-6ec4-4d0f-aca7-c07af64c6bad None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.224832 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862df72b-6ec4-4d0f-aca7-c07af64c6bad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.234675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862df72b-6ec4-4d0f-aca7-c07af64c6bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:34.236122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862df72b-6ec4-4d0f-aca7-c07af64c6bad None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:34.253313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-862df72b-6ec4-4d0f-aca7-c07af64c6bad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:34.254493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 325/658] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:34.255782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66bfdd-cd89-446c-8c46-b9645624a698 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:34.256070 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66bfdd-cd89-446c-8c46-b9645624a698 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.256372 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66bfdd-cd89-446c-8c46-b9645624a698 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.258186 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 326/659] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:34.258870 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66bfdd-cd89-446c-8c46-b9645624a698 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:34.321487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1d3a3-b89e-4cd3-86f1-0d76c35f353d None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:34.356594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b954d861-e2b3-448a-80d1-3b05113a6d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:34.356920 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66bfdd-cd89-446c-8c46-b9645624a698 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:34.357244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954d861-e2b3-448a-80d1-3b05113a6d7e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:34.357527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954d861-e2b3-448a-80d1-3b05113a6d7e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.357802 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b954d861-e2b3-448a-80d1-3b05113a6d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.390596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f7c63-169f-4796-a12e-b6e1ef48d00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:34.391441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f7c63-169f-4796-a12e-b6e1ef48d00b None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:34.391662 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f7c63-169f-4796-a12e-b6e1ef48d00b None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.391927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f7c63-169f-4796-a12e-b6e1ef48d00b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.399042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f7c63-169f-4796-a12e-b6e1ef48d00b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:34.400508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f7c63-169f-4796-a12e-b6e1ef48d00b None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:34.413871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-708f7c63-169f-4796-a12e-b6e1ef48d00b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:34.419752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 327/660] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:34.419752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f7c63-169f-4796-a12e-b6e1ef48d00b None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:34.428517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954d861-e2b3-448a-80d1-3b05113a6d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:34.430070 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b954d861-e2b3-448a-80d1-3b05113a6d7e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:34.508077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f7c63-169f-4796-a12e-b6e1ef48d00b None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:34.528173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 334/661] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:34.528173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48062112-9005-4538-b9c8-6211494f5715 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:34.528173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48062112-9005-4538-b9c8-6211494f5715 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.528173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48062112-9005-4538-b9c8-6211494f5715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.546471 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-48062112-9005-4538-b9c8-6211494f5715 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:34.547759 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-48062112-9005-4538-b9c8-6211494f5715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:34.548423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b538910-efea-4400-8962-2acc3011ea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:34.549083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b538910-efea-4400-8962-2acc3011ea78 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:34.549360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b538910-efea-4400-8962-2acc3011ea78 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.549688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b538910-efea-4400-8962-2acc3011ea78 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.550461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b538910-efea-4400-8962-2acc3011ea78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:34.550763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b538910-efea-4400-8962-2acc3011ea78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:34.552118 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b538910-efea-4400-8962-2acc3011ea78 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:34.568073 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 328/662] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:34.568073 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b538910-efea-4400-8962-2acc3011ea78 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:34.620023 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 335/663] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:34.620908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48062112-9005-4538-b9c8-6211494f5715 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:34.678109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b538910-efea-4400-8962-2acc3011ea78 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:34.711247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a78558-76b1-4687-941a-deaeb8946457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:34.711896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a78558-76b1-4687-941a-deaeb8946457 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:34.712217 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a78558-76b1-4687-941a-deaeb8946457 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.712466 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a78558-76b1-4687-941a-deaeb8946457 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.713234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a78558-76b1-4687-941a-deaeb8946457 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:34.714452 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a78558-76b1-4687-941a-deaeb8946457 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:34.715889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a78558-76b1-4687-941a-deaeb8946457 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:34.722629 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48062112-9005-4538-b9c8-6211494f5715 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:34.732749 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 329/664] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:34.732749 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a78558-76b1-4687-941a-deaeb8946457 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:34.763922 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b44a-878b-43a6-8233-bc30da5bfe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:34.764979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b44a-878b-43a6-8233-bc30da5bfe8c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:34.765431 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b44a-878b-43a6-8233-bc30da5bfe8c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.765848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b44a-878b-43a6-8233-bc30da5bfe8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.777291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7b44a-878b-43a6-8233-bc30da5bfe8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:34.778743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7b44a-878b-43a6-8233-bc30da5bfe8c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:34.794940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-a5f7b44a-878b-43a6-8233-bc30da5bfe8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:34.796429 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 336/665] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:34.797058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b44a-878b-43a6-8233-bc30da5bfe8c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:34.832385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a78558-76b1-4687-941a-deaeb8946457 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:34.863836 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03287418-ac91-493b-9c3f-b52908df0852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:34.864648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03287418-ac91-493b-9c3f-b52908df0852 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:34.864929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03287418-ac91-493b-9c3f-b52908df0852 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.865201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03287418-ac91-493b-9c3f-b52908df0852 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.872542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03287418-ac91-493b-9c3f-b52908df0852 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:34.873964 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03287418-ac91-493b-9c3f-b52908df0852 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:34.887291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-03287418-ac91-493b-9c3f-b52908df0852 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 15:20:34.888474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 330/666] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:34.889214 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03287418-ac91-493b-9c3f-b52908df0852 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:34.895165 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b44a-878b-43a6-8233-bc30da5bfe8c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:34.928234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389c362-e44c-4376-bcec-cc5e3bb10fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:34.928956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389c362-e44c-4376-bcec-cc5e3bb10fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:34.929235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389c362-e44c-4376-bcec-cc5e3bb10fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:34.929508 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389c362-e44c-4376-bcec-cc5e3bb10fb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:34.939639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389c362-e44c-4376-bcec-cc5e3bb10fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:34.946991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-3389c362-e44c-4376-bcec-cc5e3bb10fb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:34.948178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 337/667] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:34.952297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389c362-e44c-4376-bcec-cc5e3bb10fb7 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:34.984928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03287418-ac91-493b-9c3f-b52908df0852 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:35.016790 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf418f-e716-4f63-960f-d33ca3da2940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:35.017440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf418f-e716-4f63-960f-d33ca3da2940 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:35.017718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf418f-e716-4f63-960f-d33ca3da2940 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:35.017992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf418f-e716-4f63-960f-d33ca3da2940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:35.019463 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf418f-e716-4f63-960f-d33ca3da2940 None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=c4fb404cc61d49d3aaec429f4f9f4f94) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:35.019814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf418f-e716-4f63-960f-d33ca3da2940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:35.021286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf418f-e716-4f63-960f-d33ca3da2940 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:35.032185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 331/668] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:34 2022] GET /identity/v3/role_assignments?user.id=c4fb404cc61d49d3aaec429f4f9f4f94&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:35.032185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf418f-e716-4f63-960f-d33ca3da2940 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:35.052988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389c362-e44c-4376-bcec-cc5e3bb10fb7 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:35.091021 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce9587-b89d-4db2-bdef-4a969bc4684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:35.091772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce9587-b89d-4db2-bdef-4a969bc4684b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:35.092062 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce9587-b89d-4db2-bdef-4a969bc4684b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:35.092375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce9587-b89d-4db2-bdef-4a969bc4684b None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:35.093135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce9587-b89d-4db2-bdef-4a969bc4684b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:35.093441 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce9587-b89d-4db2-bdef-4a969bc4684b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:35.094914 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce9587-b89d-4db2-bdef-4a969bc4684b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:35.109271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 338/669] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:35.110225 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce9587-b89d-4db2-bdef-4a969bc4684b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:35.146107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf418f-e716-4f63-960f-d33ca3da2940 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:35.181585 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9566e92-48ca-4095-9a22-210ea4b28b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:35.182234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9566e92-48ca-4095-9a22-210ea4b28b29 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:35.182513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9566e92-48ca-4095-9a22-210ea4b28b29 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:35.182786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9566e92-48ca-4095-9a22-210ea4b28b29 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:35.183619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9566e92-48ca-4095-9a22-210ea4b28b29 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:35.183924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9566e92-48ca-4095-9a22-210ea4b28b29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:35.185486 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9566e92-48ca-4095-9a22-210ea4b28b29 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:35.205879 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 332/670] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Mar 8 15:20:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:35.206903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9566e92-48ca-4095-9a22-210ea4b28b29 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:35.220183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce9587-b89d-4db2-bdef-4a969bc4684b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:35.255455 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f890e-6205-4f98-88ce-8d452e0c38fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:35.256126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f890e-6205-4f98-88ce-8d452e0c38fd None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:35.256437 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f890e-6205-4f98-88ce-8d452e0c38fd None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:35.256715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f890e-6205-4f98-88ce-8d452e0c38fd None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:35.257457 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f890e-6205-4f98-88ce-8d452e0c38fd None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:35.257759 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f890e-6205-4f98-88ce-8d452e0c38fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:35.259133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f890e-6205-4f98-88ce-8d452e0c38fd None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:35.267652 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 339/671] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:35.268487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f890e-6205-4f98-88ce-8d452e0c38fd None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:35.320831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9566e92-48ca-4095-9a22-210ea4b28b29 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:35.359143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec525d6e-f0cd-4178-aa64-e42cfdd21403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:35.359963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec525d6e-f0cd-4178-aa64-e42cfdd21403 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:35.360277 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec525d6e-f0cd-4178-aa64-e42cfdd21403 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:35.360553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec525d6e-f0cd-4178-aa64-e42cfdd21403 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:35.367900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec525d6e-f0cd-4178-aa64-e42cfdd21403 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:35.369354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec525d6e-f0cd-4178-aa64-e42cfdd21403 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:35.382686 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-ec525d6e-f0cd-4178-aa64-e42cfdd21403 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:35.384139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 333/672] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:35.384139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec525d6e-f0cd-4178-aa64-e42cfdd21403 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:35.393365 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f890e-6205-4f98-88ce-8d452e0c38fd None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:35.441412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5853f9-5f1d-43a9-a7cb-40ab02dba673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:35.442066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5853f9-5f1d-43a9-a7cb-40ab02dba673 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:35.443478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5853f9-5f1d-43a9-a7cb-40ab02dba673 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:35.443757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5853f9-5f1d-43a9-a7cb-40ab02dba673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:35.510734 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec525d6e-f0cd-4178-aa64-e42cfdd21403 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:35.512793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5853f9-5f1d-43a9-a7cb-40ab02dba673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:35.514246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5853f9-5f1d-43a9-a7cb-40ab02dba673 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:35.556175 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dd5a6-6ead-4e56-a9e6-9e6d25e07736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:35.557791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dd5a6-6ead-4e56-a9e6-9e6d25e07736 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:35.564991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dd5a6-6ead-4e56-a9e6-9e6d25e07736 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:35.564991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dd5a6-6ead-4e56-a9e6-9e6d25e07736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:35.573233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dd5a6-6ead-4e56-a9e6-9e6d25e07736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:35.575699 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dd5a6-6ead-4e56-a9e6-9e6d25e07736 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:35.596761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-f34dd5a6-6ead-4e56-a9e6-9e6d25e07736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:35.599111 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 334/673] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:35.600560 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dd5a6-6ead-4e56-a9e6-9e6d25e07736 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:35.613877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 340/674] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:35.614850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5853f9-5f1d-43a9-a7cb-40ab02dba673 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:35.710309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dd5a6-6ead-4e56-a9e6-9e6d25e07736 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:35.728740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5853f9-5f1d-43a9-a7cb-40ab02dba673 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:35.747420 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc805af1-cbc0-4775-9c27-b0c509e9e863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:35.748505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc805af1-cbc0-4775-9c27-b0c509e9e863 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:35.748902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc805af1-cbc0-4775-9c27-b0c509e9e863 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:35.749274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc805af1-cbc0-4775-9c27-b0c509e9e863 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:35.750318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc805af1-cbc0-4775-9c27-b0c509e9e863 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:35.750892 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc805af1-cbc0-4775-9c27-b0c509e9e863 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:35.752346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc805af1-cbc0-4775-9c27-b0c509e9e863 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:35.772041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 335/675] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:35.772041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc805af1-cbc0-4775-9c27-b0c509e9e863 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:35.776195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87825377-ceb8-494e-94c3-a05493395346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:35.776860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87825377-ceb8-494e-94c3-a05493395346 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:35.777138 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87825377-ceb8-494e-94c3-a05493395346 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:35.777410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87825377-ceb8-494e-94c3-a05493395346 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:35.778129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87825377-ceb8-494e-94c3-a05493395346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:35.778433 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87825377-ceb8-494e-94c3-a05493395346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:35.779798 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87825377-ceb8-494e-94c3-a05493395346 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:35.792395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 341/676] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:35.793326 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87825377-ceb8-494e-94c3-a05493395346 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:35.877714 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc805af1-cbc0-4775-9c27-b0c509e9e863 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:35.891184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87825377-ceb8-494e-94c3-a05493395346 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:35.916121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a423e-1398-4e28-b55e-a51779b41faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:35.917907 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a423e-1398-4e28-b55e-a51779b41faa None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:35.918761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a423e-1398-4e28-b55e-a51779b41faa None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:35.919395 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a423e-1398-4e28-b55e-a51779b41faa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:35.925702 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6e18c-5faa-44e3-a167-3d81e77ba129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:35.926376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6e18c-5faa-44e3-a167-3d81e77ba129 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:35.926653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6e18c-5faa-44e3-a167-3d81e77ba129 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:35.926923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6e18c-5faa-44e3-a167-3d81e77ba129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:35.927775 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6e18c-5faa-44e3-a167-3d81e77ba129 None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=028d499ea279442d822c6723c367f459) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:35.928086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6e18c-5faa-44e3-a167-3d81e77ba129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:35.929629 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6e18c-5faa-44e3-a167-3d81e77ba129 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:35.935538 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a423e-1398-4e28-b55e-a51779b41faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:35.944180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 342/677] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:35 2022] GET /identity/v3/role_assignments?user.id=028d499ea279442d822c6723c367f459&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:35.944180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6e18c-5faa-44e3-a167-3d81e77ba129 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:35.944447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a423e-1398-4e28-b55e-a51779b41faa None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:35.979475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-2a9a423e-1398-4e28-b55e-a51779b41faa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:35.984800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 336/678] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:35.993220 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a423e-1398-4e28-b55e-a51779b41faa None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:36.118642 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a423e-1398-4e28-b55e-a51779b41faa None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:36.139386 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6e18c-5faa-44e3-a167-3d81e77ba129 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:36.173208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f9d95-1a05-4c7a-bbfb-ac0a462381b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:36.173872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f9d95-1a05-4c7a-bbfb-ac0a462381b0 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:36.174153 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f9d95-1a05-4c7a-bbfb-ac0a462381b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:36.174426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f9d95-1a05-4c7a-bbfb-ac0a462381b0 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:36.175181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f9d95-1a05-4c7a-bbfb-ac0a462381b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:36.175485 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f9d95-1a05-4c7a-bbfb-ac0a462381b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:36.176879 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f9d95-1a05-4c7a-bbfb-ac0a462381b0 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:36.183238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fb338-6d26-42d6-9499-1975ebaebed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:36.184337 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fb338-6d26-42d6-9499-1975ebaebed1 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:36.184823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fb338-6d26-42d6-9499-1975ebaebed1 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:36.185318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fb338-6d26-42d6-9499-1975ebaebed1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:36.188654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 337/679] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:36.194311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fb338-6d26-42d6-9499-1975ebaebed1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:36.196024 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fb338-6d26-42d6-9499-1975ebaebed1 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:36.201183 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f9d95-1a05-4c7a-bbfb-ac0a462381b0 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:36.211522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-d33fb338-6d26-42d6-9499-1975ebaebed1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 15:20:36.212412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 343/680] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:36.217983 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fb338-6d26-42d6-9499-1975ebaebed1 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:36.326621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f9d95-1a05-4c7a-bbfb-ac0a462381b0 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:36.330945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fb338-6d26-42d6-9499-1975ebaebed1 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:36.370505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49805640-d03f-4d77-8545-e886fb135102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:36.371790 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49805640-d03f-4d77-8545-e886fb135102 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:36.372074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49805640-d03f-4d77-8545-e886fb135102 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:36.372626 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49805640-d03f-4d77-8545-e886fb135102 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:36.376356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7d5cc-e66b-4d94-9cbf-4936f4b0ef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:36.377027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7d5cc-e66b-4d94-9cbf-4936f4b0ef69 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:36.377310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7d5cc-e66b-4d94-9cbf-4936f4b0ef69 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:36.377585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7d5cc-e66b-4d94-9cbf-4936f4b0ef69 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:36.378974 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7d5cc-e66b-4d94-9cbf-4936f4b0ef69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:36.379284 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7d5cc-e66b-4d94-9cbf-4936f4b0ef69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:36.380755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7d5cc-e66b-4d94-9cbf-4936f4b0ef69 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:36.380865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49805640-d03f-4d77-8545-e886fb135102 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:36.382426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49805640-d03f-4d77-8545-e886fb135102 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:36.400010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-49805640-d03f-4d77-8545-e886fb135102 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:36.400473 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 344/681] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Mar 8 15:20:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:36.401830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698291-8dd7-418a-a764-6309f979aed6 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:36.402188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698291-8dd7-418a-a764-6309f979aed6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:36.402476 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8698291-8dd7-418a-a764-6309f979aed6 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:36.404382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 345/682] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:36.406471 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8698291-8dd7-418a-a764-6309f979aed6 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:36.407289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 338/683] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:36.412390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706e6b-dc85-4bdb-9415-20e1494a8992 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:36.412681 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706e6b-dc85-4bdb-9415-20e1494a8992 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:36.412960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a706e6b-dc85-4bdb-9415-20e1494a8992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:36.434108 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-9a706e6b-dc85-4bdb-9415-20e1494a8992 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:36.435454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9a706e6b-dc85-4bdb-9415-20e1494a8992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:36.516561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 339/684] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:20:36.517439 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a706e6b-dc85-4bdb-9415-20e1494a8992 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:36.541295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8698291-8dd7-418a-a764-6309f979aed6 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:36.577024 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1ccaa-1d08-43e3-9ce6-c87e9e3f9abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:36.577580 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1ccaa-1d08-43e3-9ce6-c87e9e3f9abb None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:36.577878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1ccaa-1d08-43e3-9ce6-c87e9e3f9abb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:36.578141 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1ccaa-1d08-43e3-9ce6-c87e9e3f9abb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:36.636104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a706e6b-dc85-4bdb-9415-20e1494a8992 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:36.644257 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1ccaa-1d08-43e3-9ce6-c87e9e3f9abb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:36.645705 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1ccaa-1d08-43e3-9ce6-c87e9e3f9abb None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:36.671295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208e52b-7c72-4460-a347-dc52e9f68b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:36.672281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208e52b-7c72-4460-a347-dc52e9f68b6c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:36.672761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208e52b-7c72-4460-a347-dc52e9f68b6c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:36.673248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208e52b-7c72-4460-a347-dc52e9f68b6c None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:36.674238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208e52b-7c72-4460-a347-dc52e9f68b6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:36.674738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208e52b-7c72-4460-a347-dc52e9f68b6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:36.677022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208e52b-7c72-4460-a347-dc52e9f68b6c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:36.691521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 340/685] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:36.693005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208e52b-7c72-4460-a347-dc52e9f68b6c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:36.747953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 346/686] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:36.752495 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1ccaa-1d08-43e3-9ce6-c87e9e3f9abb None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:36.802446 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208e52b-7c72-4460-a347-dc52e9f68b6c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:36.840936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5256f2e-baee-417a-b25a-56b6fb24c4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:36.842079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5256f2e-baee-417a-b25a-56b6fb24c4f7 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:36.842568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5256f2e-baee-417a-b25a-56b6fb24c4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:36.843043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5256f2e-baee-417a-b25a-56b6fb24c4f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:36.845835 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1ccaa-1d08-43e3-9ce6-c87e9e3f9abb None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:36.856799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5256f2e-baee-417a-b25a-56b6fb24c4f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:36.858551 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5256f2e-baee-417a-b25a-56b6fb24c4f7 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:36.875806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-a5256f2e-baee-417a-b25a-56b6fb24c4f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:36.877698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 341/687] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:36.879256 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5256f2e-baee-417a-b25a-56b6fb24c4f7 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:36.886341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b2a05-5d72-44fb-ac51-57d5ee277fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:36.886999 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b2a05-5d72-44fb-ac51-57d5ee277fe3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:36.887281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b2a05-5d72-44fb-ac51-57d5ee277fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:36.887558 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b2a05-5d72-44fb-ac51-57d5ee277fe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:36.888444 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b2a05-5d72-44fb-ac51-57d5ee277fe3 None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=7acd143470fb416c8adc57351c5d0324) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:36.888755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b2a05-5d72-44fb-ac51-57d5ee277fe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:36.890211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227b2a05-5d72-44fb-ac51-57d5ee277fe3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:36.904359 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 347/688] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:36 2022] GET /identity/v3/role_assignments?user.id=7acd143470fb416c8adc57351c5d0324&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:36.905383 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b2a05-5d72-44fb-ac51-57d5ee277fe3 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:37.016982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5256f2e-baee-417a-b25a-56b6fb24c4f7 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:37.037418 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b2a05-5d72-44fb-ac51-57d5ee277fe3 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:37.077090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5254c-350c-4162-803a-c7e1645e2dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:37.077770 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5254c-350c-4162-803a-c7e1645e2dd8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:37.078055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5254c-350c-4162-803a-c7e1645e2dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:37.078333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5254c-350c-4162-803a-c7e1645e2dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:37.084170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5254c-350c-4162-803a-c7e1645e2dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:37.084170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5254c-350c-4162-803a-c7e1645e2dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:37.084170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5254c-350c-4162-803a-c7e1645e2dd8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:37.092244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3ecbf-f441-4d6e-ad2c-91c555479fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:37.092244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3ecbf-f441-4d6e-ad2c-91c555479fca None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:37.092244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3ecbf-f441-4d6e-ad2c-91c555479fca None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:37.092244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3ecbf-f441-4d6e-ad2c-91c555479fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:37.095360 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 348/689] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:37.109473 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3ecbf-f441-4d6e-ad2c-91c555479fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:37.110956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3ecbf-f441-4d6e-ad2c-91c555479fca None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:37.113821 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5254c-350c-4162-803a-c7e1645e2dd8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:37.130757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-5ed3ecbf-f441-4d6e-ad2c-91c555479fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:37.132444 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 342/690] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:37.137661 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3ecbf-f441-4d6e-ad2c-91c555479fca None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:37.260305 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3ecbf-f441-4d6e-ad2c-91c555479fca None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:37.280743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5254c-350c-4162-803a-c7e1645e2dd8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:37.306586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c401bb-1eec-439d-867d-469b2d03d2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:37.307508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c401bb-1eec-439d-867d-469b2d03d2c2 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:37.307806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c401bb-1eec-439d-867d-469b2d03d2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:37.308088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c401bb-1eec-439d-867d-469b2d03d2c2 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:37.308869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c401bb-1eec-439d-867d-469b2d03d2c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:37.309231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c401bb-1eec-439d-867d-469b2d03d2c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:37.311156 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c401bb-1eec-439d-867d-469b2d03d2c2 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:37.318980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f45a8-87ea-4d56-b781-730a9095ec02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:37.319920 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f45a8-87ea-4d56-b781-730a9095ec02 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:37.320448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f45a8-87ea-4d56-b781-730a9095ec02 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:37.320916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f45a8-87ea-4d56-b781-730a9095ec02 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:37.321825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f45a8-87ea-4d56-b781-730a9095ec02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:37.323475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f45a8-87ea-4d56-b781-730a9095ec02 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:37.325193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 343/691] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:37.334091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c401bb-1eec-439d-867d-469b2d03d2c2 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:37.448988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 349/692] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:20:37 2022] POST /identity/v3/users => generated 254 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:20:37.453980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c401bb-1eec-439d-867d-469b2d03d2c2 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:37.492036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b11b88-32f0-4616-a13f-b762ddd40896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:37.493190 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b11b88-32f0-4616-a13f-b762ddd40896 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:37.493641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b11b88-32f0-4616-a13f-b762ddd40896 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:37.494055 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b11b88-32f0-4616-a13f-b762ddd40896 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:37.501700 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b11b88-32f0-4616-a13f-b762ddd40896 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:37.503463 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b11b88-32f0-4616-a13f-b762ddd40896 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:37.517580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-36b11b88-32f0-4616-a13f-b762ddd40896 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:37.519971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 344/693] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:37.525891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f45a8-87ea-4d56-b781-730a9095ec02 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:37.583215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9743c0-ede0-47ee-8a38-439a76e92b5d None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:37.583498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9743c0-ede0-47ee-8a38-439a76e92b5d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:37.583778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9743c0-ede0-47ee-8a38-439a76e92b5d None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:37.586208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 345/694] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:20:37.591675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f429ea4-4882-44c6-9180-5a93dd0c7731 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:37.591988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f429ea4-4882-44c6-9180-5a93dd0c7731 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:37.592265 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f429ea4-4882-44c6-9180-5a93dd0c7731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:37.637285 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f45a8-87ea-4d56-b781-730a9095ec02 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:37.637529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-1f429ea4-4882-44c6-9180-5a93dd0c7731 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:37.638513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-1f429ea4-4882-44c6-9180-5a93dd0c7731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:37.674583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac07af5-a75e-469c-9189-ea988c4e090d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:37.675917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac07af5-a75e-469c-9189-ea988c4e090d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:37.676368 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac07af5-a75e-469c-9189-ea988c4e090d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:37.676776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac07af5-a75e-469c-9189-ea988c4e090d None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:37.677739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac07af5-a75e-469c-9189-ea988c4e090d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:37.678188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac07af5-a75e-469c-9189-ea988c4e090d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:37.679780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac07af5-a75e-469c-9189-ea988c4e090d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:37.694262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 350/695] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:37.700425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac07af5-a75e-469c-9189-ea988c4e090d None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:37.758508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 346/696] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:20:37.781885 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f429ea4-4882-44c6-9180-5a93dd0c7731 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:37.805051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac07af5-a75e-469c-9189-ea988c4e090d None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:37.840749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a619d76-7389-46f3-91af-b26e8bb69cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:37.841630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a619d76-7389-46f3-91af-b26e8bb69cb0 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:37.842075 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a619d76-7389-46f3-91af-b26e8bb69cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:37.842527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a619d76-7389-46f3-91af-b26e8bb69cb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:37.843527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a619d76-7389-46f3-91af-b26e8bb69cb0 None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=10fc82e0c3f0414492c1df4381918877) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:37.843974 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a619d76-7389-46f3-91af-b26e8bb69cb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:37.845610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a619d76-7389-46f3-91af-b26e8bb69cb0 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:37.852058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 351/697] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:37 2022] GET /identity/v3/role_assignments?user.id=10fc82e0c3f0414492c1df4381918877&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:37.889109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f429ea4-4882-44c6-9180-5a93dd0c7731 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:37.929397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5479a-f3d7-4d0b-996b-abf64cf4d671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:37.930579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5479a-f3d7-4d0b-996b-abf64cf4d671 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:37.931106 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5479a-f3d7-4d0b-996b-abf64cf4d671 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:37.931700 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5479a-f3d7-4d0b-996b-abf64cf4d671 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:37.943904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5479a-f3d7-4d0b-996b-abf64cf4d671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:37.951428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-98e5479a-f3d7-4d0b-996b-abf64cf4d671 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:20:37.953356 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 347/698] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:37.960009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a619d76-7389-46f3-91af-b26e8bb69cb0 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:38.074326 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a619d76-7389-46f3-91af-b26e8bb69cb0 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:38.115449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee99d9-8073-4ded-9ee2-a1dd60f46227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:38.116107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee99d9-8073-4ded-9ee2-a1dd60f46227 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:38.116490 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee99d9-8073-4ded-9ee2-a1dd60f46227 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:38.116763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee99d9-8073-4ded-9ee2-a1dd60f46227 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:38.117547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee99d9-8073-4ded-9ee2-a1dd60f46227 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:38.117853 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee99d9-8073-4ded-9ee2-a1dd60f46227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:38.119392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee99d9-8073-4ded-9ee2-a1dd60f46227 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:38.129104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 352/699] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:38.134979 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5479a-f3d7-4d0b-996b-abf64cf4d671 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:38.247892 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5479a-f3d7-4d0b-996b-abf64cf4d671 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:38.282126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760b337-a77e-47ac-a89f-85a758829457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:38.282975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760b337-a77e-47ac-a89f-85a758829457 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:38.283256 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760b337-a77e-47ac-a89f-85a758829457 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:38.283526 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760b337-a77e-47ac-a89f-85a758829457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:38.294346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760b337-a77e-47ac-a89f-85a758829457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:38.295799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760b337-a77e-47ac-a89f-85a758829457 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:38.312388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-7760b337-a77e-47ac-a89f-85a758829457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:38.313862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 348/700] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:38.320003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee99d9-8073-4ded-9ee2-a1dd60f46227 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:38.421454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee99d9-8073-4ded-9ee2-a1dd60f46227 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:38.457409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf107cb8-e5fb-4f5f-b94d-84112984abc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:38.458129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf107cb8-e5fb-4f5f-b94d-84112984abc8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:38.458410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf107cb8-e5fb-4f5f-b94d-84112984abc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:38.458682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf107cb8-e5fb-4f5f-b94d-84112984abc8 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:38.459454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf107cb8-e5fb-4f5f-b94d-84112984abc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:38.459761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf107cb8-e5fb-4f5f-b94d-84112984abc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:38.461189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf107cb8-e5fb-4f5f-b94d-84112984abc8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:38.473614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 353/701] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:38.479005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760b337-a77e-47ac-a89f-85a758829457 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:38.592715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760b337-a77e-47ac-a89f-85a758829457 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:38.636591 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52365434-6b9c-489f-a902-8c02e8638f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:38.637375 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52365434-6b9c-489f-a902-8c02e8638f1a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:38.637656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52365434-6b9c-489f-a902-8c02e8638f1a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:38.638172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52365434-6b9c-489f-a902-8c02e8638f1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:38.647538 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52365434-6b9c-489f-a902-8c02e8638f1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:38.648998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52365434-6b9c-489f-a902-8c02e8638f1a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:38.655408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10879a-0150-41cd-88d9-d16f9c3d08eb None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:38.655672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10879a-0150-41cd-88d9-d16f9c3d08eb None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:38.655950 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10879a-0150-41cd-88d9-d16f9c3d08eb None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:38.657921 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 354/702] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:20:38.663896 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3810343-9ff4-4ab8-a305-07b6516fc853 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:38.664270 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3810343-9ff4-4ab8-a305-07b6516fc853 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:38.664550 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3810343-9ff4-4ab8-a305-07b6516fc853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:38.669378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-52365434-6b9c-489f-a902-8c02e8638f1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 15:20:38.670866 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 349/703] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Mar 8 15:20:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:38.676684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52365434-6b9c-489f-a902-8c02e8638f1a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:38.697130 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-a3810343-9ff4-4ab8-a305-07b6516fc853 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:38.700992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a3810343-9ff4-4ab8-a305-07b6516fc853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:38.802951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52365434-6b9c-489f-a902-8c02e8638f1a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:38.836246 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118feefd-1af2-4927-824b-84cd8f247cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:38.836911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118feefd-1af2-4927-824b-84cd8f247cfa None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:38.837190 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118feefd-1af2-4927-824b-84cd8f247cfa None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:38.837462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118feefd-1af2-4927-824b-84cd8f247cfa None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:38.838282 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118feefd-1af2-4927-824b-84cd8f247cfa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:38.838583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118feefd-1af2-4927-824b-84cd8f247cfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:38.840006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118feefd-1af2-4927-824b-84cd8f247cfa None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:38.848564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 355/704] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:38.859306 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 350/705] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Mar 8 15:20:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:38.864987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3810343-9ff4-4ab8-a305-07b6516fc853 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:38.877010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118feefd-1af2-4927-824b-84cd8f247cfa None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:38.975396 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118feefd-1af2-4927-824b-84cd8f247cfa None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:39.009429 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b629bd-950b-4713-938b-bcfc99037be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:39.010215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b629bd-950b-4713-938b-bcfc99037be3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:39.010494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b629bd-950b-4713-938b-bcfc99037be3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:39.010765 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b629bd-950b-4713-938b-bcfc99037be3 None admin] PATH_INFO: `/v3/services/network` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:39.011417 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b629bd-950b-4713-938b-bcfc99037be3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:39.012817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b629bd-950b-4713-938b-bcfc99037be3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:39.025854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-f8b629bd-950b-4713-938b-bcfc99037be3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 15:20:39.027311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 351/706] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:38 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:39.033424 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b629bd-950b-4713-938b-bcfc99037be3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:39.062342 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3810343-9ff4-4ab8-a305-07b6516fc853 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:39.130994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd555f6b-133b-4945-ae8e-04ddcca1cba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:39.131712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd555f6b-133b-4945-ae8e-04ddcca1cba9 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:39.131999 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd555f6b-133b-4945-ae8e-04ddcca1cba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:39.132340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd555f6b-133b-4945-ae8e-04ddcca1cba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:39.228717 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd555f6b-133b-4945-ae8e-04ddcca1cba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:39.231623 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b629bd-950b-4713-938b-bcfc99037be3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:39.233796 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd555f6b-133b-4945-ae8e-04ddcca1cba9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:39.277969 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7a4eb-d0ea-46f3-bdba-5ea174400e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:39.278647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7a4eb-d0ea-46f3-bdba-5ea174400e8a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:39.278931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7a4eb-d0ea-46f3-bdba-5ea174400e8a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:39.279276 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7a4eb-d0ea-46f3-bdba-5ea174400e8a None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:39.279987 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7a4eb-d0ea-46f3-bdba-5ea174400e8a None admin] RBAC: Adding query filter params (name=network) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:39.280379 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7a4eb-d0ea-46f3-bdba-5ea174400e8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:39.281838 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7a4eb-d0ea-46f3-bdba-5ea174400e8a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:39.286947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 352/707] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:20:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:39.292320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7a4eb-d0ea-46f3-bdba-5ea174400e8a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:39.414079 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 356/708] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:39.419395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd555f6b-133b-4945-ae8e-04ddcca1cba9 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:39.510504 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7a4eb-d0ea-46f3-bdba-5ea174400e8a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:39.581151 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd555f6b-133b-4945-ae8e-04ddcca1cba9 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:39.584851 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9cf6e-aea5-47e1-9765-1f258879f6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:39.585745 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9cf6e-aea5-47e1-9765-1f258879f6bc None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:39.585852 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9cf6e-aea5-47e1-9765-1f258879f6bc None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:39.586104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9cf6e-aea5-47e1-9765-1f258879f6bc None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:39.586881 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9cf6e-aea5-47e1-9765-1f258879f6bc None admin] RBAC: Adding query filter params (type=network) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:39.587189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9cf6e-aea5-47e1-9765-1f258879f6bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:39.588610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9cf6e-aea5-47e1-9765-1f258879f6bc None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:39.598952 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 353/709] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:20:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:39.627412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba3e27-f0b2-4b14-a12e-6df7ffa6150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:39.629030 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba3e27-f0b2-4b14-a12e-6df7ffa6150a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:39.629320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba3e27-f0b2-4b14-a12e-6df7ffa6150a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:39.629602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba3e27-f0b2-4b14-a12e-6df7ffa6150a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:39.647428 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba3e27-f0b2-4b14-a12e-6df7ffa6150a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:39.648958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba3e27-f0b2-4b14-a12e-6df7ffa6150a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:39.668645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-43ba3e27-f0b2-4b14-a12e-6df7ffa6150a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:39.670235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 357/710] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:39.677333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9cf6e-aea5-47e1-9765-1f258879f6bc None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:39.802996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9cf6e-aea5-47e1-9765-1f258879f6bc None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:39.839727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fce987-37a9-4aa3-9b67-3e37a6c3a0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:39.840443 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fce987-37a9-4aa3-9b67-3e37a6c3a0dd None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:39.840725 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fce987-37a9-4aa3-9b67-3e37a6c3a0dd None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:39.841004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fce987-37a9-4aa3-9b67-3e37a6c3a0dd None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:39.841744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fce987-37a9-4aa3-9b67-3e37a6c3a0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:39.842051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fce987-37a9-4aa3-9b67-3e37a6c3a0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:39.843439 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fce987-37a9-4aa3-9b67-3e37a6c3a0dd None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:39.857451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 354/711] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:39.865362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba3e27-f0b2-4b14-a12e-6df7ffa6150a None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:39.904662 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c3f7d-2ca4-4d5a-a213-8ecb479a7e4d None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:39.904965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c3f7d-2ca4-4d5a-a213-8ecb479a7e4d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:39.905222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c3f7d-2ca4-4d5a-a213-8ecb479a7e4d None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:39.907236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 355/712] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:20:39.920910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187d4ba-d2ba-4930-b0b1-ed9ac76bcfc8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:39.921260 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187d4ba-d2ba-4930-b0b1-ed9ac76bcfc8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:39.921659 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187d4ba-d2ba-4930-b0b1-ed9ac76bcfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:39.943619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5187d4ba-d2ba-4930-b0b1-ed9ac76bcfc8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:39.944822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5187d4ba-d2ba-4930-b0b1-ed9ac76bcfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:39.990876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba3e27-f0b2-4b14-a12e-6df7ffa6150a None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:40.014886 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 356/713] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:20:40.035592 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042a718-7b97-4da4-803e-6d6ed1ceeb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:40.036468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042a718-7b97-4da4-803e-6d6ed1ceeb12 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:40.036768 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042a718-7b97-4da4-803e-6d6ed1ceeb12 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:40.037058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042a718-7b97-4da4-803e-6d6ed1ceeb12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:40.038192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187d4ba-d2ba-4930-b0b1-ed9ac76bcfc8 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:40.048733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042a718-7b97-4da4-803e-6d6ed1ceeb12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:40.050734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042a718-7b97-4da4-803e-6d6ed1ceeb12 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:40.068722 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-2042a718-7b97-4da4-803e-6d6ed1ceeb12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:40.073721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 358/714] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:40.086086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042a718-7b97-4da4-803e-6d6ed1ceeb12 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:40.229730 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187d4ba-d2ba-4930-b0b1-ed9ac76bcfc8 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:40.251595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042a718-7b97-4da4-803e-6d6ed1ceeb12 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:40.295478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db1b8c-143d-4174-a2b4-40e7e50ffebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:40.296313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1b8c-143d-4174-a2b4-40e7e50ffebd None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:40.296599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1b8c-143d-4174-a2b4-40e7e50ffebd None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:40.296875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1b8c-143d-4174-a2b4-40e7e50ffebd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:40.297531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db1b8c-143d-4174-a2b4-40e7e50ffebd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:40.298909 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db1b8c-143d-4174-a2b4-40e7e50ffebd None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:40.310661 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-64db1b8c-143d-4174-a2b4-40e7e50ffebd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 15:20:40.312243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 357/715] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Mar 8 15:20:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:40.322724 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affaaab-2e8d-4040-82d2-65cfdd2cd6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:40.323680 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affaaab-2e8d-4040-82d2-65cfdd2cd6d9 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:40.324214 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affaaab-2e8d-4040-82d2-65cfdd2cd6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:40.324686 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affaaab-2e8d-4040-82d2-65cfdd2cd6d9 None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:40.325126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db1b8c-143d-4174-a2b4-40e7e50ffebd None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:40.325985 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affaaab-2e8d-4040-82d2-65cfdd2cd6d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:40.326488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affaaab-2e8d-4040-82d2-65cfdd2cd6d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:40.328124 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affaaab-2e8d-4040-82d2-65cfdd2cd6d9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:40.341271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 359/716] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:40.347732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affaaab-2e8d-4040-82d2-65cfdd2cd6d9 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:40.518097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affaaab-2e8d-4040-82d2-65cfdd2cd6d9 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:40.522605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db1b8c-143d-4174-a2b4-40e7e50ffebd None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:40.569521 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19555b39-ffb8-43f6-8179-d17079db89ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:40.570607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19555b39-ffb8-43f6-8179-d17079db89ab None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:40.571090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19555b39-ffb8-43f6-8179-d17079db89ab None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:40.571565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19555b39-ffb8-43f6-8179-d17079db89ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:40.572709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19555b39-ffb8-43f6-8179-d17079db89ab None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=c4fb404cc61d49d3aaec429f4f9f4f94) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:40.577874 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19555b39-ffb8-43f6-8179-d17079db89ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:40.579835 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19555b39-ffb8-43f6-8179-d17079db89ab None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:40.587187 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 360/717] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:40 2022] GET /identity/v3/role_assignments?user.id=c4fb404cc61d49d3aaec429f4f9f4f94&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=24a7898c863141f1911792647b5274e3 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:40.603946 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc547a-912f-4a21-ba8c-d0b8244cd881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:40.605029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc547a-912f-4a21-ba8c-d0b8244cd881 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:40.605453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc547a-912f-4a21-ba8c-d0b8244cd881 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:40.605868 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc547a-912f-4a21-ba8c-d0b8244cd881 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:40.606741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc547a-912f-4a21-ba8c-d0b8244cd881 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:40.607200 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc547a-912f-4a21-ba8c-d0b8244cd881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:40.608834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc547a-912f-4a21-ba8c-d0b8244cd881 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:40.617007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 358/718] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Mar 8 15:20:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:40.623230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19555b39-ffb8-43f6-8179-d17079db89ab None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:40.713880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb793-3ba3-4512-9a7b-d5bf94c35519 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:40.714750 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb793-3ba3-4512-9a7b-d5bf94c35519 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:40.715170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb793-3ba3-4512-9a7b-d5bf94c35519 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:40.717142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 359/719] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:20:40.738732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e988a7-a046-4820-b551-5fa24c46f12b None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:40.739102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e988a7-a046-4820-b551-5fa24c46f12b None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:40.739287 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e988a7-a046-4820-b551-5fa24c46f12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:40.759454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19555b39-ffb8-43f6-8179-d17079db89ab None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:40.788191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f9e988a7-a046-4820-b551-5fa24c46f12b None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:40.789728 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f9e988a7-a046-4820-b551-5fa24c46f12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:40.795984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e3a46-864e-46cb-8a81-0dcee60b6a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:40.796897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e3a46-864e-46cb-8a81-0dcee60b6a0b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:40.797386 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e3a46-864e-46cb-8a81-0dcee60b6a0b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:40.797811 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e3a46-864e-46cb-8a81-0dcee60b6a0b None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:40.798666 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e3a46-864e-46cb-8a81-0dcee60b6a0b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:40.799110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e3a46-864e-46cb-8a81-0dcee60b6a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:40.801309 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e3a46-864e-46cb-8a81-0dcee60b6a0b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:40.807715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 361/720] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Mar 8 15:20:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:40.886929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 360/721] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:40.931291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e3a46-864e-46cb-8a81-0dcee60b6a0b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:40.961191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369cb72-3d3d-41bf-b8b1-533fd4650609 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:40.961528 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369cb72-3d3d-41bf-b8b1-533fd4650609 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:40.961759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369cb72-3d3d-41bf-b8b1-533fd4650609 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:40.963927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 361/722] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:20:40.968979 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a4fa9-04f0-4346-98dd-679b31f12efb None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:40.969268 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a4fa9-04f0-4346-98dd-679b31f12efb None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:40.969550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a4fa9-04f0-4346-98dd-679b31f12efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:40.997275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-1c7a4fa9-04f0-4346-98dd-679b31f12efb None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:40.998501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-1c7a4fa9-04f0-4346-98dd-679b31f12efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:41.045161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e3a46-864e-46cb-8a81-0dcee60b6a0b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:41.081428 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972d50-b159-48bb-bd2e-240c85541df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:41.082515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972d50-b159-48bb-bd2e-240c85541df7 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:41.082977 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972d50-b159-48bb-bd2e-240c85541df7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:41.083455 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972d50-b159-48bb-bd2e-240c85541df7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:41.098124 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de972d50-b159-48bb-bd2e-240c85541df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:41.103975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 362/723] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 15:20:41.105627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-de972d50-b159-48bb-bd2e-240c85541df7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:41.107266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 362/724] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:41.116169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a4fa9-04f0-4346-98dd-679b31f12efb None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:41.144915 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972d50-b159-48bb-bd2e-240c85541df7 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:41.234628 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a4fa9-04f0-4346-98dd-679b31f12efb None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:41.272994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d171511-3051-406a-8ecc-0c6ec9b22e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:41.273672 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d171511-3051-406a-8ecc-0c6ec9b22e78 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:41.273961 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d171511-3051-406a-8ecc-0c6ec9b22e78 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:41.274242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d171511-3051-406a-8ecc-0c6ec9b22e78 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:41.274995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d171511-3051-406a-8ecc-0c6ec9b22e78 None admin] RBAC: Adding query filter params (name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:41.275305 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d171511-3051-406a-8ecc-0c6ec9b22e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:41.276709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d171511-3051-406a-8ecc-0c6ec9b22e78 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:41.286762 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 363/725] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:41.297152 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d171511-3051-406a-8ecc-0c6ec9b22e78 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:41.333183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972d50-b159-48bb-bd2e-240c85541df7 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:41.369091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526eaf7-895c-4705-bd51-efdf1312d5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:41.370253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526eaf7-895c-4705-bd51-efdf1312d5dd None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:41.370728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526eaf7-895c-4705-bd51-efdf1312d5dd None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:41.371200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526eaf7-895c-4705-bd51-efdf1312d5dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:41.405025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526eaf7-895c-4705-bd51-efdf1312d5dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:41.416189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-5526eaf7-895c-4705-bd51-efdf1312d5dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:20:41.417910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 363/726] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:41.425808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526eaf7-895c-4705-bd51-efdf1312d5dd None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:41.426165 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d171511-3051-406a-8ecc-0c6ec9b22e78 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:41.460996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adf63e-da82-4758-a186-6e9a47080b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:41.462026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adf63e-da82-4758-a186-6e9a47080b7d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:41.462492 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adf63e-da82-4758-a186-6e9a47080b7d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:41.462918 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adf63e-da82-4758-a186-6e9a47080b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:41.473946 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adf63e-da82-4758-a186-6e9a47080b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:41.475569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adf63e-da82-4758-a186-6e9a47080b7d None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:41.492188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-b7adf63e-da82-4758-a186-6e9a47080b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:41.493912 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 364/727] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:41.500291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adf63e-da82-4758-a186-6e9a47080b7d None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:41.589174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526eaf7-895c-4705-bd51-efdf1312d5dd None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:41.642958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d2d00-307f-4ec8-8b6b-62e199c7451f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:41.644203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d2d00-307f-4ec8-8b6b-62e199c7451f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:41.644492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d2d00-307f-4ec8-8b6b-62e199c7451f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:41.644765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d2d00-307f-4ec8-8b6b-62e199c7451f None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:41.645511 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d2d00-307f-4ec8-8b6b-62e199c7451f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:41.645816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d2d00-307f-4ec8-8b6b-62e199c7451f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:41.647211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d2d00-307f-4ec8-8b6b-62e199c7451f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:41.656578 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adf63e-da82-4758-a186-6e9a47080b7d None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:41.665378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 364/728] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:41.670785 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d2d00-307f-4ec8-8b6b-62e199c7451f None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:41.713559 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b4486-36e9-4db2-bb8a-5e33c1313b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:41.714224 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b4486-36e9-4db2-bb8a-5e33c1313b05 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:41.714771 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b4486-36e9-4db2-bb8a-5e33c1313b05 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:41.714771 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b4486-36e9-4db2-bb8a-5e33c1313b05 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:41.715470 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b4486-36e9-4db2-bb8a-5e33c1313b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:41.715778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b4486-36e9-4db2-bb8a-5e33c1313b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:41.717241 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b4486-36e9-4db2-bb8a-5e33c1313b05 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:41.743671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 365/729] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:41.746767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b4486-36e9-4db2-bb8a-5e33c1313b05 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:41.858187 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d2d00-307f-4ec8-8b6b-62e199c7451f None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:41.873596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b4486-36e9-4db2-bb8a-5e33c1313b05 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:41.905654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69c15f-51ee-4773-b2b2-c1ea95b8507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:41.906465 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69c15f-51ee-4773-b2b2-c1ea95b8507a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:41.906745 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69c15f-51ee-4773-b2b2-c1ea95b8507a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:41.907018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69c15f-51ee-4773-b2b2-c1ea95b8507a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:41.917655 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69c15f-51ee-4773-b2b2-c1ea95b8507a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:41.919116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69c15f-51ee-4773-b2b2-c1ea95b8507a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:41.937365 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950995ab-c74d-40b2-86a6-00058be918ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:41.938404 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-dd69c15f-51ee-4773-b2b2-c1ea95b8507a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 15:20:41.939160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950995ab-c74d-40b2-86a6-00058be918ae None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:41.939660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950995ab-c74d-40b2-86a6-00058be918ae None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:41.940716 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950995ab-c74d-40b2-86a6-00058be918ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:41.944263 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 366/730] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Mar 8 15:20:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:41.945991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69c15f-51ee-4773-b2b2-c1ea95b8507a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:41.960979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950995ab-c74d-40b2-86a6-00058be918ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:41.962868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950995ab-c74d-40b2-86a6-00058be918ae None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:41.987711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-950995ab-c74d-40b2-86a6-00058be918ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:41.989652 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 365/731] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:42.001118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950995ab-c74d-40b2-86a6-00058be918ae None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:42.049383 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69c15f-51ee-4773-b2b2-c1ea95b8507a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:42.085187 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f0e5-04a5-4d45-a4aa-a18bb555a18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:42.085861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f0e5-04a5-4d45-a4aa-a18bb555a18c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:42.086146 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f0e5-04a5-4d45-a4aa-a18bb555a18c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:42.086427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9f0e5-04a5-4d45-a4aa-a18bb555a18c None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:42.087408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9f0e5-04a5-4d45-a4aa-a18bb555a18c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:42.087605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9f0e5-04a5-4d45-a4aa-a18bb555a18c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:42.090836 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9f0e5-04a5-4d45-a4aa-a18bb555a18c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:42.111037 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 367/732] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Mar 8 15:20:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:42.112790 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f0e5-04a5-4d45-a4aa-a18bb555a18c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:42.210782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9f0e5-04a5-4d45-a4aa-a18bb555a18c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:42.230286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950995ab-c74d-40b2-86a6-00058be918ae None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:42.244998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20699a8e-3f90-4a16-8c49-72ba723a7a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:42.245649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699a8e-3f90-4a16-8c49-72ba723a7a75 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:42.245933 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699a8e-3f90-4a16-8c49-72ba723a7a75 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:42.246206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699a8e-3f90-4a16-8c49-72ba723a7a75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:42.304648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c62f03-0969-4f66-b3b7-7b493fb9f438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:42.305698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c62f03-0969-4f66-b3b7-7b493fb9f438 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:42.306185 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c62f03-0969-4f66-b3b7-7b493fb9f438 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:42.306657 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c62f03-0969-4f66-b3b7-7b493fb9f438 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:42.307575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c62f03-0969-4f66-b3b7-7b493fb9f438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:42.308081 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c62f03-0969-4f66-b3b7-7b493fb9f438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:42.309706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c62f03-0969-4f66-b3b7-7b493fb9f438 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:42.334544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 366/733] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:42.339992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c62f03-0969-4f66-b3b7-7b493fb9f438 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:42.357911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20699a8e-3f90-4a16-8c49-72ba723a7a75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:42.359721 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20699a8e-3f90-4a16-8c49-72ba723a7a75 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:42.461857 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 368/734] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 15:20:42.463539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212f8b-a5ff-42f1-9323-6263ee101d34 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:42.464054 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212f8b-a5ff-42f1-9323-6263ee101d34 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:42.464554 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212f8b-a5ff-42f1-9323-6263ee101d34 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:42.466629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 369/735] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:42.470009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49212f8b-a5ff-42f1-9323-6263ee101d34 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:42.485976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c62f03-0969-4f66-b3b7-7b493fb9f438 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:42.521041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97465b13-1537-4443-884e-d0077c0454f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:42.522168 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97465b13-1537-4443-884e-d0077c0454f4 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:42.522724 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97465b13-1537-4443-884e-d0077c0454f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:42.523232 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97465b13-1537-4443-884e-d0077c0454f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:42.530728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97465b13-1537-4443-884e-d0077c0454f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:42.532472 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97465b13-1537-4443-884e-d0077c0454f4 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:42.548246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-97465b13-1537-4443-884e-d0077c0454f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 15:20:42.550100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 367/736] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:42.551562 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7983e-1588-4480-b73d-4c397666f08d None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:42.552049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7983e-1588-4480-b73d-4c397666f08d None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:42.552550 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7983e-1588-4480-b73d-4c397666f08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:42.569301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-fed7983e-1588-4480-b73d-4c397666f08d None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:42.570740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-fed7983e-1588-4480-b73d-4c397666f08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:42.573131 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49212f8b-a5ff-42f1-9323-6263ee101d34 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:42.607931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd63e5-f8eb-43c0-9553-a36de42cd8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:42.608775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd63e5-f8eb-43c0-9553-a36de42cd8c2 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:42.609704 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd63e5-f8eb-43c0-9553-a36de42cd8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:42.609704 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd63e5-f8eb-43c0-9553-a36de42cd8c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:42.620171 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd63e5-f8eb-43c0-9553-a36de42cd8c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:42.621645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd63e5-f8eb-43c0-9553-a36de42cd8c2 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:42.639030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-88cd63e5-f8eb-43c0-9553-a36de42cd8c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:42.642345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 368/738] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:42.643916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7983e-1588-4480-b73d-4c397666f08d None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:42.645369 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 370/738] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:42.647698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd63e5-f8eb-43c0-9553-a36de42cd8c2 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:42.747335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd63e5-f8eb-43c0-9553-a36de42cd8c2 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:42.766363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7983e-1588-4480-b73d-4c397666f08d None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:42.781821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950a2ab-5b5c-47b8-a183-3f3568225056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:42.782752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950a2ab-5b5c-47b8-a183-3f3568225056 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:42.783043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950a2ab-5b5c-47b8-a183-3f3568225056 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:42.783326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950a2ab-5b5c-47b8-a183-3f3568225056 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:42.784636 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950a2ab-5b5c-47b8-a183-3f3568225056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:42.784994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950a2ab-5b5c-47b8-a183-3f3568225056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:42.786872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950a2ab-5b5c-47b8-a183-3f3568225056 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:42.803230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b4596-a1e5-4d4b-9c1f-02778552bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:42.804243 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b4596-a1e5-4d4b-9c1f-02778552bc68 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:42.804734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b4596-a1e5-4d4b-9c1f-02778552bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:42.805211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b4596-a1e5-4d4b-9c1f-02778552bc68 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:42.805403 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 371/739] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:42.806270 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950a2ab-5b5c-47b8-a183-3f3568225056 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:42.806636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b4596-a1e5-4d4b-9c1f-02778552bc68 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:42.807145 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b4596-a1e5-4d4b-9c1f-02778552bc68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:42.808815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b4596-a1e5-4d4b-9c1f-02778552bc68 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:42.826496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 369/740] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Mar 8 15:20:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:42.827650 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b4596-a1e5-4d4b-9c1f-02778552bc68 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:42.931611 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950a2ab-5b5c-47b8-a183-3f3568225056 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:42.939030 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b4596-a1e5-4d4b-9c1f-02778552bc68 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:42.968404 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39817e-6ec4-45dc-b95e-1722e99f4799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:42.969494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39817e-6ec4-45dc-b95e-1722e99f4799 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:42.970000 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39817e-6ec4-45dc-b95e-1722e99f4799 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:42.970476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39817e-6ec4-45dc-b95e-1722e99f4799 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:42.971433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39817e-6ec4-45dc-b95e-1722e99f4799 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:42.973064 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39817e-6ec4-45dc-b95e-1722e99f4799 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:42.981104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e71d0-d540-458f-8cfb-a0a97d493794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:42.981958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e71d0-d540-458f-8cfb-a0a97d493794 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:42.982244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e71d0-d540-458f-8cfb-a0a97d493794 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:42.982520 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e71d0-d540-458f-8cfb-a0a97d493794 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:42.990019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e71d0-d540-458f-8cfb-a0a97d493794 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:42.991565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e71d0-d540-458f-8cfb-a0a97d493794 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:43.005297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-354e71d0-d540-458f-8cfb-a0a97d493794 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:43.011210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 370/741] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:43.011210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e71d0-d540-458f-8cfb-a0a97d493794 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:43.068580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 372/742] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:20:42 2022] POST /identity/v3/services => generated 240 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:20:43.072238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39817e-6ec4-45dc-b95e-1722e99f4799 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:43.184316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e71d0-d540-458f-8cfb-a0a97d493794 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:43.249041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39817e-6ec4-45dc-b95e-1722e99f4799 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:43.276758 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bcccf-81da-42d7-9ffb-cd2d4de16ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:43.277786 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bcccf-81da-42d7-9ffb-cd2d4de16ab8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:43.278293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bcccf-81da-42d7-9ffb-cd2d4de16ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:43.278772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bcccf-81da-42d7-9ffb-cd2d4de16ab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:43.303271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5a109-5f08-4cc9-8d64-ae72891cbb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:43.303965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a109-5f08-4cc9-8d64-ae72891cbb51 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:43.304277 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a109-5f08-4cc9-8d64-ae72891cbb51 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:43.304558 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a109-5f08-4cc9-8d64-ae72891cbb51 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:43.305385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5a109-5f08-4cc9-8d64-ae72891cbb51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:43.305699 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5a109-5f08-4cc9-8d64-ae72891cbb51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:43.307247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5a109-5f08-4cc9-8d64-ae72891cbb51 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:43.321139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 373/743] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:43.329201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5a109-5f08-4cc9-8d64-ae72891cbb51 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:43.362500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bcccf-81da-42d7-9ffb-cd2d4de16ab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:43.363822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bcccf-81da-42d7-9ffb-cd2d4de16ab8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:43.455734 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5a109-5f08-4cc9-8d64-ae72891cbb51 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:43.475255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 371/744] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:43 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 15:20:43.480245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f174970-52e8-4764-818f-935b21e9e4f3 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:43.480245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f174970-52e8-4764-818f-935b21e9e4f3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:43.480245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f174970-52e8-4764-818f-935b21e9e4f3 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:43.480747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 372/745] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:43.481700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f174970-52e8-4764-818f-935b21e9e4f3 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:43.497206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362eaa4-23a3-4ced-8bd5-03f9cbb5581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:43.497933 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362eaa4-23a3-4ced-8bd5-03f9cbb5581e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:43.498139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362eaa4-23a3-4ced-8bd5-03f9cbb5581e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:43.498415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362eaa4-23a3-4ced-8bd5-03f9cbb5581e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:43.499245 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362eaa4-23a3-4ced-8bd5-03f9cbb5581e None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=21f49c3c297e4a2b89260910c90bc21d) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:43.499553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362eaa4-23a3-4ced-8bd5-03f9cbb5581e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:43.501397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362eaa4-23a3-4ced-8bd5-03f9cbb5581e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:43.507547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 374/746] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:43 2022] GET /identity/v3/role_assignments?user.id=21f49c3c297e4a2b89260910c90bc21d&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:43.508882 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564629b8-7243-463a-bf94-8d2a05e14e4c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:43.509170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564629b8-7243-463a-bf94-8d2a05e14e4c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:43.509448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564629b8-7243-463a-bf94-8d2a05e14e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:43.528360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-564629b8-7243-463a-bf94-8d2a05e14e4c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:43.528360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-564629b8-7243-463a-bf94-8d2a05e14e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:43.640933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f174970-52e8-4764-818f-935b21e9e4f3 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:43.651736 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 375/747] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:43 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:43.675891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564629b8-7243-463a-bf94-8d2a05e14e4c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:43.705251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20da2a-89aa-47ef-b4d2-833c6ebe9f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:43.706095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20da2a-89aa-47ef-b4d2-833c6ebe9f76 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:43.706377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20da2a-89aa-47ef-b4d2-833c6ebe9f76 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:43.706652 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20da2a-89aa-47ef-b4d2-833c6ebe9f76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:43.717491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20da2a-89aa-47ef-b4d2-833c6ebe9f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:43.718992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20da2a-89aa-47ef-b4d2-833c6ebe9f76 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:43.738769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-5e20da2a-89aa-47ef-b4d2-833c6ebe9f76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:43.740445 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 373/748] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:43.741833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5994f8-439d-4078-a2b2-f172a209aa5d None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:43.742121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5994f8-439d-4078-a2b2-f172a209aa5d None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:43.742395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5994f8-439d-4078-a2b2-f172a209aa5d None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:43.748264 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 374/749] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:43.749097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5994f8-439d-4078-a2b2-f172a209aa5d None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:43.789920 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564629b8-7243-463a-bf94-8d2a05e14e4c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:43.830099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3005d-6e13-4a4e-bedf-4f4952ccb187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:43.830927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3005d-6e13-4a4e-bedf-4f4952ccb187 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:43.831212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3005d-6e13-4a4e-bedf-4f4952ccb187 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:43.831640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3005d-6e13-4a4e-bedf-4f4952ccb187 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:43.845117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3005d-6e13-4a4e-bedf-4f4952ccb187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:43.854156 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-1fb3005d-6e13-4a4e-bedf-4f4952ccb187 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:20:43.855848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 376/750] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:43.857357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5208a-cdd9-4818-8551-3afe24eae697 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:43.857842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5208a-cdd9-4818-8551-3afe24eae697 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:43.858364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5208a-cdd9-4818-8551-3afe24eae697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:43.873140 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5994f8-439d-4078-a2b2-f172a209aa5d None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:43.877135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-41c5208a-cdd9-4818-8551-3afe24eae697 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:43.878627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-41c5208a-cdd9-4818-8551-3afe24eae697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:43.907189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b963fb-a63a-48fc-9025-4107e05cc6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:43.907834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b963fb-a63a-48fc-9025-4107e05cc6a0 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:43.908120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b963fb-a63a-48fc-9025-4107e05cc6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:43.908425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b963fb-a63a-48fc-9025-4107e05cc6a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:43.909734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b963fb-a63a-48fc-9025-4107e05cc6a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:43.910043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b963fb-a63a-48fc-9025-4107e05cc6a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:43.911424 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b963fb-a63a-48fc-9025-4107e05cc6a0 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:43.928067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 375/751] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:43.928067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b963fb-a63a-48fc-9025-4107e05cc6a0 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:43.954256 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 377/752] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:43 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 15:20:43.955482 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5208a-cdd9-4818-8551-3afe24eae697 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:44.048866 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b963fb-a63a-48fc-9025-4107e05cc6a0 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:44.057988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5208a-cdd9-4818-8551-3afe24eae697 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:44.085455 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708457b-7064-4221-816b-9a02e9f0526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:44.086387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708457b-7064-4221-816b-9a02e9f0526f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:44.086673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708457b-7064-4221-816b-9a02e9f0526f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:44.087083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708457b-7064-4221-816b-9a02e9f0526f None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:44.088182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708457b-7064-4221-816b-9a02e9f0526f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:44.088500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708457b-7064-4221-816b-9a02e9f0526f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:44.090357 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708457b-7064-4221-816b-9a02e9f0526f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:44.104233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7333b-d1b5-41f1-8251-92dbd264382e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:44.104233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7333b-d1b5-41f1-8251-92dbd264382e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:44.104233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7333b-d1b5-41f1-8251-92dbd264382e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:44.104233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7333b-d1b5-41f1-8251-92dbd264382e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:44.104625 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 376/753] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:44.105374 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708457b-7064-4221-816b-9a02e9f0526f None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:44.110862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7333b-d1b5-41f1-8251-92dbd264382e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:44.112791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7333b-d1b5-41f1-8251-92dbd264382e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:44.126398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-42d7333b-d1b5-41f1-8251-92dbd264382e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:44.127910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 378/754] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:44.128782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7333b-d1b5-41f1-8251-92dbd264382e None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:44.225588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708457b-7064-4221-816b-9a02e9f0526f None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:44.228687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7333b-d1b5-41f1-8251-92dbd264382e None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:44.262535 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d96ac3-4633-4a62-8259-9c052a91f783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:44.263573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d96ac3-4633-4a62-8259-9c052a91f783 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:44.263950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d96ac3-4633-4a62-8259-9c052a91f783 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:44.264276 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d96ac3-4633-4a62-8259-9c052a91f783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:44.266005 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e643455-dd73-471e-8770-e162d88596cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:44.267109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e643455-dd73-471e-8770-e162d88596cb None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:44.267418 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e643455-dd73-471e-8770-e162d88596cb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:44.267697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e643455-dd73-471e-8770-e162d88596cb None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:44.268994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e643455-dd73-471e-8770-e162d88596cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:44.270514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e643455-dd73-471e-8770-e162d88596cb None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:44.275583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d96ac3-4633-4a62-8259-9c052a91f783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:44.277178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d96ac3-4633-4a62-8259-9c052a91f783 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:44.294576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-05d96ac3-4633-4a62-8259-9c052a91f783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:44.295854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 379/755] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:44.296946 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d96ac3-4633-4a62-8259-9c052a91f783 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:44.352317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 377/756] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:20:44 2022] POST /identity/v3/services => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:20:44.353154 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e643455-dd73-471e-8770-e162d88596cb None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:44.456710 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d96ac3-4633-4a62-8259-9c052a91f783 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:44.541932 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a99cb-6442-4a01-87f1-f8f2560daa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:44.542649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a99cb-6442-4a01-87f1-f8f2560daa05 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:44.542936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a99cb-6442-4a01-87f1-f8f2560daa05 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:44.543213 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a99cb-6442-4a01-87f1-f8f2560daa05 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:44.544947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a99cb-6442-4a01-87f1-f8f2560daa05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:44.545278 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a99cb-6442-4a01-87f1-f8f2560daa05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:44.546729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a99cb-6442-4a01-87f1-f8f2560daa05 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:44.559858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e643455-dd73-471e-8770-e162d88596cb None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:44.568402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 380/757] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:44.574349 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a99cb-6442-4a01-87f1-f8f2560daa05 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:44.600547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed0664-f3e3-4064-a928-324ec22dec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:44.601353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed0664-f3e3-4064-a928-324ec22dec68 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:44.601637 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed0664-f3e3-4064-a928-324ec22dec68 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:44.602068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed0664-f3e3-4064-a928-324ec22dec68 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:44.603147 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed0664-f3e3-4064-a928-324ec22dec68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:44.603402 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed0664-f3e3-4064-a928-324ec22dec68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:44.604815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed0664-f3e3-4064-a928-324ec22dec68 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:44.624336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 378/758] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:44.628480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed0664-f3e3-4064-a928-324ec22dec68 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:44.701157 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a99cb-6442-4a01-87f1-f8f2560daa05 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:44.749277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed0664-f3e3-4064-a928-324ec22dec68 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:44.776652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e624124-b06e-415b-bab7-2ebb4a4607cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:44.777338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e624124-b06e-415b-bab7-2ebb4a4607cc None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:44.777619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e624124-b06e-415b-bab7-2ebb4a4607cc None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:44.777894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e624124-b06e-415b-bab7-2ebb4a4607cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:44.778753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e624124-b06e-415b-bab7-2ebb4a4607cc None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=10fc82e0c3f0414492c1df4381918877) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:44.779065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e624124-b06e-415b-bab7-2ebb4a4607cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:44.780584 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e624124-b06e-415b-bab7-2ebb4a4607cc None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:44.787070 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 381/759] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:44 2022] GET /identity/v3/role_assignments?user.id=10fc82e0c3f0414492c1df4381918877&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=24a7898c863141f1911792647b5274e3 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:44.796980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6bfff-23d0-466c-b5e7-f1288d0a8a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:44.797809 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6bfff-23d0-466c-b5e7-f1288d0a8a54 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:44.798088 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6bfff-23d0-466c-b5e7-f1288d0a8a54 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:44.798359 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6bfff-23d0-466c-b5e7-f1288d0a8a54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:44.807858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6bfff-23d0-466c-b5e7-f1288d0a8a54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:44.809372 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6bfff-23d0-466c-b5e7-f1288d0a8a54 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:44.835127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-b1b6bfff-23d0-466c-b5e7-f1288d0a8a54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 15:20:44.840269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 379/760] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Mar 8 15:20:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:44.845309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e624124-b06e-415b-bab7-2ebb4a4607cc None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:44.989278 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e624124-b06e-415b-bab7-2ebb4a4607cc None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:45.025274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180721-2150-4524-b953-1d8a010e4ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:45.025945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180721-2150-4524-b953-1d8a010e4ac1 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:45.026225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180721-2150-4524-b953-1d8a010e4ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:45.026501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180721-2150-4524-b953-1d8a010e4ac1 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:45.027335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180721-2150-4524-b953-1d8a010e4ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:45.027646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180721-2150-4524-b953-1d8a010e4ac1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:45.029098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180721-2150-4524-b953-1d8a010e4ac1 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:45.047856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 382/761] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Mar 8 15:20:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:45.053902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6bfff-23d0-466c-b5e7-f1288d0a8a54 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:45.187481 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6bfff-23d0-466c-b5e7-f1288d0a8a54 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:45.221701 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575ff89-0b61-4360-9096-c1948ed13abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:45.222487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575ff89-0b61-4360-9096-c1948ed13abc None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:45.222771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575ff89-0b61-4360-9096-c1948ed13abc None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:45.223038 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575ff89-0b61-4360-9096-c1948ed13abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:45.234170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575ff89-0b61-4360-9096-c1948ed13abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:45.235632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575ff89-0b61-4360-9096-c1948ed13abc None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:45.275968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-6575ff89-0b61-4360-9096-c1948ed13abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:45.277562 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 380/762] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:45.283261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180721-2150-4524-b953-1d8a010e4ac1 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:45.435418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180721-2150-4524-b953-1d8a010e4ac1 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:45.475649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca300-2694-4f22-9053-9ce6e4cb2e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:45.476697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca300-2694-4f22-9053-9ce6e4cb2e3c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:45.477182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca300-2694-4f22-9053-9ce6e4cb2e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:45.477655 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca300-2694-4f22-9053-9ce6e4cb2e3c None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:45.478610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eca300-2694-4f22-9053-9ce6e4cb2e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:45.479112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eca300-2694-4f22-9053-9ce6e4cb2e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:45.480712 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eca300-2694-4f22-9053-9ce6e4cb2e3c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:45.493311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 383/763] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:45.498567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575ff89-0b61-4360-9096-c1948ed13abc None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:45.625265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575ff89-0b61-4360-9096-c1948ed13abc None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:45.670234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c079b-22a7-4909-9d91-48b629054f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:45.671036 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c079b-22a7-4909-9d91-48b629054f0e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:45.671316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c079b-22a7-4909-9d91-48b629054f0e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:45.671590 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c079b-22a7-4909-9d91-48b629054f0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:45.681303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c079b-22a7-4909-9d91-48b629054f0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:45.682766 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c079b-22a7-4909-9d91-48b629054f0e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:45.698484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-352c079b-22a7-4909-9d91-48b629054f0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:45.700002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 381/764] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:45.705964 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca300-2694-4f22-9053-9ce6e4cb2e3c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:45.783385 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867be68b-58fc-408b-a930-3aabdbb7df8e None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:45.784315 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867be68b-58fc-408b-a930-3aabdbb7df8e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:45.784602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867be68b-58fc-408b-a930-3aabdbb7df8e None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:45.790646 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 382/765] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:45.792505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812028-c7ea-4814-896d-5d566b711d94 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:45.792882 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812028-c7ea-4814-896d-5d566b711d94 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:45.793233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812028-c7ea-4814-896d-5d566b711d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:45.825859 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca300-2694-4f22-9053-9ce6e4cb2e3c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:45.833222 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7c812028-c7ea-4814-896d-5d566b711d94 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:45.834435 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7c812028-c7ea-4814-896d-5d566b711d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:45.867077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e09f5c-6c6f-437c-9eff-3160e51133fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:45.868486 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e09f5c-6c6f-437c-9eff-3160e51133fd None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:45.869014 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e09f5c-6c6f-437c-9eff-3160e51133fd None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:45.869505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e09f5c-6c6f-437c-9eff-3160e51133fd None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:45.871661 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e09f5c-6c6f-437c-9eff-3160e51133fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:45.872236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e09f5c-6c6f-437c-9eff-3160e51133fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:45.873887 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e09f5c-6c6f-437c-9eff-3160e51133fd None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:45.898362 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 384/766] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:45.907743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e09f5c-6c6f-437c-9eff-3160e51133fd None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:46.002033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 383/767] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:20:46.014478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e09f5c-6c6f-437c-9eff-3160e51133fd None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:46.041711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c812028-c7ea-4814-896d-5d566b711d94 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:46.055077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e5db9-19d1-48e4-8d6a-95a7a3930142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:46.056307 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e5db9-19d1-48e4-8d6a-95a7a3930142 None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:46.056751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e5db9-19d1-48e4-8d6a-95a7a3930142 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:46.057181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e5db9-19d1-48e4-8d6a-95a7a3930142 None admin] PATH_INFO: `/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/c4fb404cc61d49d3aaec429f4f9f4f94/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:46.061681 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e5db9-19d1-48e4-8d6a-95a7a3930142 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdaa0405e224334ac42dc4cde1c01c5, user_id=c4fb404cc61d49d3aaec429f4f9f4f94, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:46.063271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e5db9-19d1-48e4-8d6a-95a7a3930142 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:46.167611 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 385/768] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:20:45 2022] PUT /identity/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/c4fb404cc61d49d3aaec429f4f9f4f94/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:20:46.169183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c812028-c7ea-4814-896d-5d566b711d94 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:46.193679 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cc605-6828-4e70-8fec-19e12b094743 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:46.193986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cc605-6828-4e70-8fec-19e12b094743 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:46.194247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cc605-6828-4e70-8fec-19e12b094743 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:46.196056 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 386/769] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:20:46.201611 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ff12f-1e9e-4b1d-bd11-3473fa7a7603 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:46.201894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ff12f-1e9e-4b1d-bd11-3473fa7a7603 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:46.202172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ff12f-1e9e-4b1d-bd11-3473fa7a7603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:46.226913 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-aa9ff12f-1e9e-4b1d-bd11-3473fa7a7603 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:46.228136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-aa9ff12f-1e9e-4b1d-bd11-3473fa7a7603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:46.250239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109a476-d624-421d-aa2c-049ab6d096fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:46.251049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109a476-d624-421d-aa2c-049ab6d096fc None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:46.251328 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109a476-d624-421d-aa2c-049ab6d096fc None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:46.251600 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109a476-d624-421d-aa2c-049ab6d096fc None admin] PATH_INFO: `/v3/services/network` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:46.252834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109a476-d624-421d-aa2c-049ab6d096fc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:46.254264 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109a476-d624-421d-aa2c-049ab6d096fc None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:46.273404 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-9109a476-d624-421d-aa2c-049ab6d096fc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 15:20:46.274661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 384/770] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:46 2022] GET /identity/v3/services/network => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:46.284855 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109a476-d624-421d-aa2c-049ab6d096fc None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:46.363698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 387/771] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:20:46.387406 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ff12f-1e9e-4b1d-bd11-3473fa7a7603 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:46.436084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109a476-d624-421d-aa2c-049ab6d096fc None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:46.472007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7d8e1-f32d-4e0e-94f7-5743ab2fd3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:46.473051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d8e1-f32d-4e0e-94f7-5743ab2fd3db None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:46.473554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d8e1-f32d-4e0e-94f7-5743ab2fd3db None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:46.474044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d8e1-f32d-4e0e-94f7-5743ab2fd3db None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:46.474947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d8e1-f32d-4e0e-94f7-5743ab2fd3db None admin] RBAC: Adding query filter params (name=network) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:46.475460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d8e1-f32d-4e0e-94f7-5743ab2fd3db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:46.477077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d8e1-f32d-4e0e-94f7-5743ab2fd3db None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:46.482263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 385/772] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:20:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:46.488483 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7d8e1-f32d-4e0e-94f7-5743ab2fd3db None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:46.520770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ff12f-1e9e-4b1d-bd11-3473fa7a7603 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:46.585216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75237578-235c-4aee-9db9-282a2292b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:46.586540 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75237578-235c-4aee-9db9-282a2292b882 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:46.588437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75237578-235c-4aee-9db9-282a2292b882 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:46.588954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75237578-235c-4aee-9db9-282a2292b882 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:46.617440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75237578-235c-4aee-9db9-282a2292b882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:46.629997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-75237578-235c-4aee-9db9-282a2292b882 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:46.636170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 388/773] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:46.642927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7d8e1-f32d-4e0e-94f7-5743ab2fd3db None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:46.645502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75237578-235c-4aee-9db9-282a2292b882 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:46.698210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab1cd0-e6fd-4772-a61d-07ce95fe2c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:46.699203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab1cd0-e6fd-4772-a61d-07ce95fe2c78 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:46.700672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab1cd0-e6fd-4772-a61d-07ce95fe2c78 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:46.700852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab1cd0-e6fd-4772-a61d-07ce95fe2c78 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:46.701573 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab1cd0-e6fd-4772-a61d-07ce95fe2c78 None admin] RBAC: Adding query filter params (type=network) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:46.701894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab1cd0-e6fd-4772-a61d-07ce95fe2c78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:46.703273 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab1cd0-e6fd-4772-a61d-07ce95fe2c78 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:46.715463 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 386/774] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:20:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:46.721568 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab1cd0-e6fd-4772-a61d-07ce95fe2c78 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:46.774842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75237578-235c-4aee-9db9-282a2292b882 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:46.815271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3182b-d18f-45b2-81bc-dd2939e89d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:46.816325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3182b-d18f-45b2-81bc-dd2939e89d6f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:46.816834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3182b-d18f-45b2-81bc-dd2939e89d6f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:46.817324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3182b-d18f-45b2-81bc-dd2939e89d6f None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:46.818284 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3182b-d18f-45b2-81bc-dd2939e89d6f None admin] RBAC: Adding query filter params (name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:46.818796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3182b-d18f-45b2-81bc-dd2939e89d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:46.820397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3182b-d18f-45b2-81bc-dd2939e89d6f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:46.841583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 389/775] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:46.847037 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3182b-d18f-45b2-81bc-dd2939e89d6f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:46.916435 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab1cd0-e6fd-4772-a61d-07ce95fe2c78 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:46.957173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39def05e-32f7-48a2-a8e7-f9c585bd1035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:46.958439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39def05e-32f7-48a2-a8e7-f9c585bd1035 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:46.958944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39def05e-32f7-48a2-a8e7-f9c585bd1035 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:46.959430 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39def05e-32f7-48a2-a8e7-f9c585bd1035 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:46.960518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39def05e-32f7-48a2-a8e7-f9c585bd1035 None admin] RBAC: Adding query filter params (interface=public, service_id=209fe1aa67d743d3905c2de0508a5512, region_id=RegionOne) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:46.961452 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39def05e-32f7-48a2-a8e7-f9c585bd1035 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:46.963086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39def05e-32f7-48a2-a8e7-f9c585bd1035 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:46.973422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 387/776] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Mar 8 15:20:46 2022] GET /identity/v3/endpoints?service_id=209fe1aa67d743d3905c2de0508a5512&interface=public®ion_id=RegionOne => generated 194 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:46.979110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39def05e-32f7-48a2-a8e7-f9c585bd1035 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:47.086115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3182b-d18f-45b2-81bc-dd2939e89d6f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:47.097703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39def05e-32f7-48a2-a8e7-f9c585bd1035 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:47.134892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5815cac-3ff7-4c53-b333-484204f66618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:47.135943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5815cac-3ff7-4c53-b333-484204f66618 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:47.142475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5815cac-3ff7-4c53-b333-484204f66618 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:47.143513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5815cac-3ff7-4c53-b333-484204f66618 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:47.144448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5815cac-3ff7-4c53-b333-484204f66618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:47.146254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5815cac-3ff7-4c53-b333-484204f66618 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:47.153017 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 388/777] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Mar 8 15:20:46 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:47.171737 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ce644-74d8-44da-a2c4-31159c4999b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:47.173039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ce644-74d8-44da-a2c4-31159c4999b0 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:47.173587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ce644-74d8-44da-a2c4-31159c4999b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:47.174105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ce644-74d8-44da-a2c4-31159c4999b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:47.188351 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ce644-74d8-44da-a2c4-31159c4999b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:47.196181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ce644-74d8-44da-a2c4-31159c4999b0 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:47.218858 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-a38ce644-74d8-44da-a2c4-31159c4999b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:47.220539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 390/778] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:47.226647 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5815cac-3ff7-4c53-b333-484204f66618 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:47.366151 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5815cac-3ff7-4c53-b333-484204f66618 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:47.369732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12da7d6-38f3-480e-a0ed-058cb1348cb6 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:47.370028 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12da7d6-38f3-480e-a0ed-058cb1348cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:47.370314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12da7d6-38f3-480e-a0ed-058cb1348cb6 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:47.372755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 391/779] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:47.378310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c39a8-275d-4998-b4a0-ef70b44da5bc None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:47.378789 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c39a8-275d-4998-b4a0-ef70b44da5bc None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:47.379329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c39a8-275d-4998-b4a0-ef70b44da5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:47.405540 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-3e0c39a8-275d-4998-b4a0-ef70b44da5bc None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:47.405832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011a63e-1387-4f94-a41c-71962d3fd675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:47.406526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011a63e-1387-4f94-a41c-71962d3fd675 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:47.406807 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011a63e-1387-4f94-a41c-71962d3fd675 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:47.407080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011a63e-1387-4f94-a41c-71962d3fd675 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:47.407837 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011a63e-1387-4f94-a41c-71962d3fd675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:47.408077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3e0c39a8-275d-4998-b4a0-ef70b44da5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:47.408279 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011a63e-1387-4f94-a41c-71962d3fd675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:47.409694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011a63e-1387-4f94-a41c-71962d3fd675 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:47.433401 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 389/780] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:47.440428 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011a63e-1387-4f94-a41c-71962d3fd675 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:47.517389 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 392/781] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:20:47.547677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c39a8-275d-4998-b4a0-ef70b44da5bc None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:47.585976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011a63e-1387-4f94-a41c-71962d3fd675 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:47.660128 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f6e64-5d9f-41fe-ab3d-6687eb31f0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:47.660961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f6e64-5d9f-41fe-ab3d-6687eb31f0b6 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:47.661238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f6e64-5d9f-41fe-ab3d-6687eb31f0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:47.661509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f6e64-5d9f-41fe-ab3d-6687eb31f0b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:47.663725 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c39a8-275d-4998-b4a0-ef70b44da5bc None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:47.677259 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f6e64-5d9f-41fe-ab3d-6687eb31f0b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:47.678732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f6e64-5d9f-41fe-ab3d-6687eb31f0b6 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:47.705152 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-8f9f6e64-5d9f-41fe-ab3d-6687eb31f0b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 15:20:47.706936 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 390/782] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Mar 8 15:20:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:47.711485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f67c5-376d-4e73-9b0d-89fbbfc7627e None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:47.711768 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f67c5-376d-4e73-9b0d-89fbbfc7627e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:47.712042 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f67c5-376d-4e73-9b0d-89fbbfc7627e None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:47.713992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 391/783] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:20:47.714367 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c433c-8a61-44ad-a813-e7ff34bfae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:47.714695 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f67c5-376d-4e73-9b0d-89fbbfc7627e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:47.715189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c433c-8a61-44ad-a813-e7ff34bfae77 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:47.715524 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c433c-8a61-44ad-a813-e7ff34bfae77 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:47.715847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c433c-8a61-44ad-a813-e7ff34bfae77 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:47.716640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c433c-8a61-44ad-a813-e7ff34bfae77 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:47.718075 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c433c-8a61-44ad-a813-e7ff34bfae77 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:47.730241 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-e78c433c-8a61-44ad-a813-e7ff34bfae77 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 15:20:47.731745 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 393/784] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Mar 8 15:20:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:47.732955 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb2093-fcd6-49c7-af70-484cc9752032 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:47.733415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb2093-fcd6-49c7-af70-484cc9752032 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:47.733694 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb2093-fcd6-49c7-af70-484cc9752032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:47.750896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-fccb2093-fcd6-49c7-af70-484cc9752032 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:47.752059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-fccb2093-fcd6-49c7-af70-484cc9752032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:47.819942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 394/785] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:20:47.820802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb2093-fcd6-49c7-af70-484cc9752032 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:47.840215 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f67c5-376d-4e73-9b0d-89fbbfc7627e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:47.882460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd3acf-0dfd-4527-bf4e-6b6222a3bef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:47.883365 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd3acf-0dfd-4527-bf4e-6b6222a3bef3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:47.883649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd3acf-0dfd-4527-bf4e-6b6222a3bef3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:47.883926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd3acf-0dfd-4527-bf4e-6b6222a3bef3 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:47.884783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd3acf-0dfd-4527-bf4e-6b6222a3bef3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:47.885091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd3acf-0dfd-4527-bf4e-6b6222a3bef3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:47.887152 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd3acf-0dfd-4527-bf4e-6b6222a3bef3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:47.911333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 392/786] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Mar 8 15:20:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:47.912213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd3acf-0dfd-4527-bf4e-6b6222a3bef3 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:47.925648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb2093-fcd6-49c7-af70-484cc9752032 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:47.959975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaab252-c159-4b5c-89f6-66491348e643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:47.960691 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaab252-c159-4b5c-89f6-66491348e643 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:47.961025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaab252-c159-4b5c-89f6-66491348e643 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:47.961366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaab252-c159-4b5c-89f6-66491348e643 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:47.962081 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaab252-c159-4b5c-89f6-66491348e643 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:47.962390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaab252-c159-4b5c-89f6-66491348e643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:47.963764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaab252-c159-4b5c-89f6-66491348e643 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:47.968634 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 395/787] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Mar 8 15:20:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:47.969443 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaab252-c159-4b5c-89f6-66491348e643 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:48.029681 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd3acf-0dfd-4527-bf4e-6b6222a3bef3 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:48.074083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6b93b-b987-4bd5-aa0f-df294c762d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:48.074794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6b93b-b987-4bd5-aa0f-df294c762d29 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:48.075071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6b93b-b987-4bd5-aa0f-df294c762d29 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:48.075343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6b93b-b987-4bd5-aa0f-df294c762d29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:48.080842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaab252-c159-4b5c-89f6-66491348e643 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:48.089669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6b93b-b987-4bd5-aa0f-df294c762d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:48.099135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-2af6b93b-b987-4bd5-aa0f-df294c762d29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:20:48.105655 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 393/788] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:48.105655 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6b93b-b987-4bd5-aa0f-df294c762d29 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:48.120503 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c36b21-df97-4c6d-a4de-0459273d5236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:48.121384 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c36b21-df97-4c6d-a4de-0459273d5236 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:48.121669 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c36b21-df97-4c6d-a4de-0459273d5236 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:48.122157 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c36b21-df97-4c6d-a4de-0459273d5236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:48.133232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c36b21-df97-4c6d-a4de-0459273d5236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:48.134741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c36b21-df97-4c6d-a4de-0459273d5236 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:48.152161 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-d6c36b21-df97-4c6d-a4de-0459273d5236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:48.157879 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 396/789] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:48.159268 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c36b21-df97-4c6d-a4de-0459273d5236 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:48.218976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6b93b-b987-4bd5-aa0f-df294c762d29 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:48.252947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca7ac2-b45b-4c2d-a81c-b7497bacaae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:48.253585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca7ac2-b45b-4c2d-a81c-b7497bacaae3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:48.253997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca7ac2-b45b-4c2d-a81c-b7497bacaae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:48.254341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca7ac2-b45b-4c2d-a81c-b7497bacaae3 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:48.255106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca7ac2-b45b-4c2d-a81c-b7497bacaae3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:48.255475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca7ac2-b45b-4c2d-a81c-b7497bacaae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:48.256944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca7ac2-b45b-4c2d-a81c-b7497bacaae3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:48.258260 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c36b21-df97-4c6d-a4de-0459273d5236 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:48.266530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 394/790] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Mar 8 15:20:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:48.267346 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca7ac2-b45b-4c2d-a81c-b7497bacaae3 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:48.294430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f2b5e-4649-46ce-ae87-583a7ee9ba5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:48.295156 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2b5e-4649-46ce-ae87-583a7ee9ba5c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:48.295488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2b5e-4649-46ce-ae87-583a7ee9ba5c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:48.295981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f2b5e-4649-46ce-ae87-583a7ee9ba5c None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:48.296947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f2b5e-4649-46ce-ae87-583a7ee9ba5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:48.297256 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f2b5e-4649-46ce-ae87-583a7ee9ba5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:48.298640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f2b5e-4649-46ce-ae87-583a7ee9ba5c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:48.308351 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 397/791] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:48.309314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f2b5e-4649-46ce-ae87-583a7ee9ba5c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:48.377731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca7ac2-b45b-4c2d-a81c-b7497bacaae3 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:48.413141 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4d046-f1b4-48a3-a237-b07e5707033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:48.413803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4d046-f1b4-48a3-a237-b07e5707033f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:48.414085 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4d046-f1b4-48a3-a237-b07e5707033f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:48.416174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4d046-f1b4-48a3-a237-b07e5707033f None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:48.416174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4d046-f1b4-48a3-a237-b07e5707033f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:48.416174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4d046-f1b4-48a3-a237-b07e5707033f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:48.416832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4d046-f1b4-48a3-a237-b07e5707033f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:48.418896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f2b5e-4649-46ce-ae87-583a7ee9ba5c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:48.435260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 395/792] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:48.436174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4d046-f1b4-48a3-a237-b07e5707033f None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:48.480176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9517414-42f8-4dec-aaf7-3167acb2dfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:48.480176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9517414-42f8-4dec-aaf7-3167acb2dfcf None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:48.480176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9517414-42f8-4dec-aaf7-3167acb2dfcf None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:48.480176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9517414-42f8-4dec-aaf7-3167acb2dfcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:48.480956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9517414-42f8-4dec-aaf7-3167acb2dfcf None admin] RBAC: Adding query filter params (interface=public, service_id=dfb732a6b3dd4ccfaf5df3ac31e14c7e, region_id=RegionOne) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:48.480956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9517414-42f8-4dec-aaf7-3167acb2dfcf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:48.484166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9517414-42f8-4dec-aaf7-3167acb2dfcf None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:48.508180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 398/793] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Mar 8 15:20:48 2022] GET /identity/v3/endpoints?service_id=dfb732a6b3dd4ccfaf5df3ac31e14c7e&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:48.508180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9517414-42f8-4dec-aaf7-3167acb2dfcf None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:48.626874 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4d046-f1b4-48a3-a237-b07e5707033f None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:48.669804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b43710-6107-4e9d-8272-f4f55e5938cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:48.670656 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b43710-6107-4e9d-8272-f4f55e5938cb None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:48.671059 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b43710-6107-4e9d-8272-f4f55e5938cb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:48.671347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b43710-6107-4e9d-8272-f4f55e5938cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:48.682237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9517414-42f8-4dec-aaf7-3167acb2dfcf None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:48.683023 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b43710-6107-4e9d-8272-f4f55e5938cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:48.684669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b43710-6107-4e9d-8272-f4f55e5938cb None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:48.704174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-06b43710-6107-4e9d-8272-f4f55e5938cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:48.711125 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 396/794] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:48.712502 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b43710-6107-4e9d-8272-f4f55e5938cb None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:48.752168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44979045-43cf-4619-baf4-4b370a68554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:48.752514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44979045-43cf-4619-baf4-4b370a68554a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:48.752514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44979045-43cf-4619-baf4-4b370a68554a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:48.752819 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44979045-43cf-4619-baf4-4b370a68554a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:48.760737 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44979045-43cf-4619-baf4-4b370a68554a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:48.762733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44979045-43cf-4619-baf4-4b370a68554a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:48.780202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-44979045-43cf-4619-baf4-4b370a68554a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:48.787369 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 399/795] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:48.788480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44979045-43cf-4619-baf4-4b370a68554a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:48.885889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b43710-6107-4e9d-8272-f4f55e5938cb None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:48.908602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44979045-43cf-4619-baf4-4b370a68554a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:48.936972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4730027-d2c9-4394-b25b-57ffe5d021b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:48.937579 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4730027-d2c9-4394-b25b-57ffe5d021b7 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:48.937863 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4730027-d2c9-4394-b25b-57ffe5d021b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:48.938141 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4730027-d2c9-4394-b25b-57ffe5d021b7 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:48.938830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4730027-d2c9-4394-b25b-57ffe5d021b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:48.940784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4730027-d2c9-4394-b25b-57ffe5d021b7 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:48.945874 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 397/796] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Mar 8 15:20:48 2022] GET /identity/v3/services => generated 772 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:48.946646 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4730027-d2c9-4394-b25b-57ffe5d021b7 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:48.968970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7bf91-4241-4861-b0cb-8f92263f133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:48.969994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7bf91-4241-4861-b0cb-8f92263f133a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:48.971074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7bf91-4241-4861-b0cb-8f92263f133a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:48.971551 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7bf91-4241-4861-b0cb-8f92263f133a None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:48.972833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7bf91-4241-4861-b0cb-8f92263f133a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:48.973389 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7bf91-4241-4861-b0cb-8f92263f133a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:48.975951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7bf91-4241-4861-b0cb-8f92263f133a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:48.997125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 400/797] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:48.997867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6f024-2d4a-4e72-a7a8-15d903a4b82f None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:48.998100 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6f024-2d4a-4e72-a7a8-15d903a4b82f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:48.998385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6f024-2d4a-4e72-a7a8-15d903a4b82f None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:49.000333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 401/798] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:49.004065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6f024-2d4a-4e72-a7a8-15d903a4b82f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:49.069236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4730027-d2c9-4394-b25b-57ffe5d021b7 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:49.116012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53e854-b78d-4b7c-821c-0b530feded93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:49.117627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53e854-b78d-4b7c-821c-0b530feded93 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:49.118406 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53e854-b78d-4b7c-821c-0b530feded93 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:49.118889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53e854-b78d-4b7c-821c-0b530feded93 None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:49.120073 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53e854-b78d-4b7c-821c-0b530feded93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:49.120676 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53e854-b78d-4b7c-821c-0b530feded93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:49.122344 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53e854-b78d-4b7c-821c-0b530feded93 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:49.131154 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6f024-2d4a-4e72-a7a8-15d903a4b82f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:49.137263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 398/799] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:49.138800 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6030a8-82e9-4c93-8e30-3912d3f103d5 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:49.139097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6030a8-82e9-4c93-8e30-3912d3f103d5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:49.139379 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6030a8-82e9-4c93-8e30-3912d3f103d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:49.163748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-4e6030a8-82e9-4c93-8e30-3912d3f103d5 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:49.165015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4e6030a8-82e9-4c93-8e30-3912d3f103d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:49.170633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ba0d8-24bb-43f4-b155-d7c8be687cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:49.171433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ba0d8-24bb-43f4-b155-d7c8be687cc7 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:49.171721 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ba0d8-24bb-43f4-b155-d7c8be687cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:49.172000 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ba0d8-24bb-43f4-b155-d7c8be687cc7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:49.183655 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ba0d8-24bb-43f4-b155-d7c8be687cc7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:49.185167 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ba0d8-24bb-43f4-b155-d7c8be687cc7 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:49.199605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-7f1ba0d8-24bb-43f4-b155-d7c8be687cc7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 15:20:49.201099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 402/800] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:49.201958 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ba0d8-24bb-43f4-b155-d7c8be687cc7 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:49.242917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 399/801] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:20:49.244506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6030a8-82e9-4c93-8e30-3912d3f103d5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:49.321280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ba0d8-24bb-43f4-b155-d7c8be687cc7 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:49.360932 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4c48f-db65-4332-9372-35e536a57439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:49.362372 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4c48f-db65-4332-9372-35e536a57439 None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:49.362653 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4c48f-db65-4332-9372-35e536a57439 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:49.362926 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4c48f-db65-4332-9372-35e536a57439 None admin] PATH_INFO: `/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/21f49c3c297e4a2b89260910c90bc21d/roles/40ab2eed29104ad783efc00ea49ea5d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:49.367751 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6030a8-82e9-4c93-8e30-3912d3f103d5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:49.378385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4c48f-db65-4332-9372-35e536a57439 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdaa0405e224334ac42dc4cde1c01c5, user_id=21f49c3c297e4a2b89260910c90bc21d, role_id=40ab2eed29104ad783efc00ea49ea5d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:49.379867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4c48f-db65-4332-9372-35e536a57439 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:49.402556 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1608d63-532f-44e9-abf8-09fac6ea59c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:49.403364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1608d63-532f-44e9-abf8-09fac6ea59c9 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:49.403658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1608d63-532f-44e9-abf8-09fac6ea59c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:49.403990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1608d63-532f-44e9-abf8-09fac6ea59c9 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:49.404912 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1608d63-532f-44e9-abf8-09fac6ea59c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:49.405229 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1608d63-532f-44e9-abf8-09fac6ea59c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:49.406682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1608d63-532f-44e9-abf8-09fac6ea59c9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:49.430539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 400/802] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Mar 8 15:20:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:49.430539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1608d63-532f-44e9-abf8-09fac6ea59c9 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:49.472425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 403/803] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:20:49 2022] PUT /identity/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/21f49c3c297e4a2b89260910c90bc21d/roles/40ab2eed29104ad783efc00ea49ea5d0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:20:49.473530 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4c48f-db65-4332-9372-35e536a57439 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:49.544111 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1608d63-532f-44e9-abf8-09fac6ea59c9 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:49.583959 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd082c-9d18-4f87-a4e3-794f39b400a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:49.585336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd082c-9d18-4f87-a4e3-794f39b400a1 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:49.585948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd082c-9d18-4f87-a4e3-794f39b400a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:49.586399 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd082c-9d18-4f87-a4e3-794f39b400a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:49.599425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd082c-9d18-4f87-a4e3-794f39b400a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:49.608021 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-7bfd082c-9d18-4f87-a4e3-794f39b400a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:20:49.610836 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 401/804] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:49.617991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd082c-9d18-4f87-a4e3-794f39b400a1 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:49.668727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4c48f-db65-4332-9372-35e536a57439 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:49.705059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ae69d-a120-43b4-9007-cf386e060755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:49.705905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ae69d-a120-43b4-9007-cf386e060755 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:49.706191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ae69d-a120-43b4-9007-cf386e060755 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:49.706496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ae69d-a120-43b4-9007-cf386e060755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:49.717735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ae69d-a120-43b4-9007-cf386e060755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:49.719255 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ae69d-a120-43b4-9007-cf386e060755 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:49.738434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-199ae69d-a120-43b4-9007-cf386e060755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:49.739900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 404/805] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:49.745632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5d187-3ca2-4fb2-a78a-d160ebeeadb2 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:49.745632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5d187-3ca2-4fb2-a78a-d160ebeeadb2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:49.745632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5d187-3ca2-4fb2-a78a-d160ebeeadb2 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:49.747842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 405/806] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:49.748961 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5d187-3ca2-4fb2-a78a-d160ebeeadb2 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:49.756734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd082c-9d18-4f87-a4e3-794f39b400a1 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:49.801709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407886ac-488f-4633-b37a-60bbf2ccfa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:49.802381 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407886ac-488f-4633-b37a-60bbf2ccfa6d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:49.802670 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407886ac-488f-4633-b37a-60bbf2ccfa6d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:49.802941 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407886ac-488f-4633-b37a-60bbf2ccfa6d None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:49.803699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407886ac-488f-4633-b37a-60bbf2ccfa6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:49.804013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407886ac-488f-4633-b37a-60bbf2ccfa6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:49.805422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407886ac-488f-4633-b37a-60bbf2ccfa6d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:49.814639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 402/807] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:49.819014 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c38e3-c7be-4dd8-8203-fbd18e359a3e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:49.819014 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c38e3-c7be-4dd8-8203-fbd18e359a3e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:49.819014 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c38e3-c7be-4dd8-8203-fbd18e359a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:49.834279 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-e95c38e3-c7be-4dd8-8203-fbd18e359a3e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:49.836281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-e95c38e3-c7be-4dd8-8203-fbd18e359a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:49.864589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5d187-3ca2-4fb2-a78a-d160ebeeadb2 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:49.907542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d91b27-a14c-4f46-93a6-e2f5cbc6f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:49.908967 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d91b27-a14c-4f46-93a6-e2f5cbc6f571 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:49.909311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d91b27-a14c-4f46-93a6-e2f5cbc6f571 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:49.909944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d91b27-a14c-4f46-93a6-e2f5cbc6f571 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:49.910983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d91b27-a14c-4f46-93a6-e2f5cbc6f571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:49.911294 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d91b27-a14c-4f46-93a6-e2f5cbc6f571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:49.913458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d91b27-a14c-4f46-93a6-e2f5cbc6f571 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:49.917396 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 403/808] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:20:49.918252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c38e3-c7be-4dd8-8203-fbd18e359a3e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:49.934798 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 406/809] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:49.940102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d91b27-a14c-4f46-93a6-e2f5cbc6f571 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:50.052239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c38e3-c7be-4dd8-8203-fbd18e359a3e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:50.056640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d91b27-a14c-4f46-93a6-e2f5cbc6f571 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:50.096917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb290f0-8cb2-4978-93ef-d67a1f1ca0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:50.097714 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb290f0-8cb2-4978-93ef-d67a1f1ca0cb None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:50.097992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb290f0-8cb2-4978-93ef-d67a1f1ca0cb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:50.098261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb290f0-8cb2-4978-93ef-d67a1f1ca0cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:50.101478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c123c-4c97-4761-980b-e1d6efa3bf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:50.102293 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c123c-4c97-4761-980b-e1d6efa3bf05 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:50.102571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c123c-4c97-4761-980b-e1d6efa3bf05 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:50.102843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c123c-4c97-4761-980b-e1d6efa3bf05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:50.112846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb290f0-8cb2-4978-93ef-d67a1f1ca0cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:50.114437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c123c-4c97-4761-980b-e1d6efa3bf05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:50.114551 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb290f0-8cb2-4978-93ef-d67a1f1ca0cb None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:50.115869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c123c-4c97-4761-980b-e1d6efa3bf05 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:50.129514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-aa3c123c-4c97-4761-980b-e1d6efa3bf05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:50.131033 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 407/810] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:50.131915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c123c-4c97-4761-980b-e1d6efa3bf05 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:50.132811 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-4fb290f0-8cb2-4978-93ef-d67a1f1ca0cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:50.134312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 404/811] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:50.139700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb290f0-8cb2-4978-93ef-d67a1f1ca0cb None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:50.239408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c123c-4c97-4761-980b-e1d6efa3bf05 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:50.259205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb290f0-8cb2-4978-93ef-d67a1f1ca0cb None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:50.273700 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421d11e-b1f7-4e6a-960f-6b77911fcc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:50.274496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421d11e-b1f7-4e6a-960f-6b77911fcc36 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:50.274781 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421d11e-b1f7-4e6a-960f-6b77911fcc36 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:50.275060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421d11e-b1f7-4e6a-960f-6b77911fcc36 None admin] PATH_INFO: `/v3/services/network` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:50.275710 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421d11e-b1f7-4e6a-960f-6b77911fcc36 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:50.277128 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421d11e-b1f7-4e6a-960f-6b77911fcc36 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:50.289487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-0421d11e-b1f7-4e6a-960f-6b77911fcc36 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 15:20:50.295255 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 408/812] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:50 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:50.296252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421d11e-b1f7-4e6a-960f-6b77911fcc36 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:50.307754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56b2e1-1c2b-49ff-9219-bc4471eae681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:50.308857 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56b2e1-1c2b-49ff-9219-bc4471eae681 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:50.309342 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56b2e1-1c2b-49ff-9219-bc4471eae681 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:50.309802 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56b2e1-1c2b-49ff-9219-bc4471eae681 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:50.310771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56b2e1-1c2b-49ff-9219-bc4471eae681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:50.311260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56b2e1-1c2b-49ff-9219-bc4471eae681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:50.312897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56b2e1-1c2b-49ff-9219-bc4471eae681 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:50.331740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 405/813] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:50.332936 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56b2e1-1c2b-49ff-9219-bc4471eae681 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:50.401266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421d11e-b1f7-4e6a-960f-6b77911fcc36 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:50.436084 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada416bd-2bf1-4051-80b8-c8ef62951ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:50.436772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada416bd-2bf1-4051-80b8-c8ef62951ff4 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:50.437056 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada416bd-2bf1-4051-80b8-c8ef62951ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:50.437338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada416bd-2bf1-4051-80b8-c8ef62951ff4 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:50.438120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada416bd-2bf1-4051-80b8-c8ef62951ff4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:50.438429 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada416bd-2bf1-4051-80b8-c8ef62951ff4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:50.441886 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada416bd-2bf1-4051-80b8-c8ef62951ff4 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:50.446531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56b2e1-1c2b-49ff-9219-bc4471eae681 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:50.453238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 409/814] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:50.454092 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada416bd-2bf1-4051-80b8-c8ef62951ff4 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:50.498711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240f527-ddcc-4f51-926e-7523c51b30b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:50.499539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240f527-ddcc-4f51-926e-7523c51b30b8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:50.499825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240f527-ddcc-4f51-926e-7523c51b30b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:50.500103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240f527-ddcc-4f51-926e-7523c51b30b8 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:50.500847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240f527-ddcc-4f51-926e-7523c51b30b8 None admin] RBAC: Adding query filter params (name=network) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:50.501649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240f527-ddcc-4f51-926e-7523c51b30b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:50.503728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240f527-ddcc-4f51-926e-7523c51b30b8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:50.511501 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 406/815] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:20:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:50.512478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240f527-ddcc-4f51-926e-7523c51b30b8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:50.589191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada416bd-2bf1-4051-80b8-c8ef62951ff4 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:50.632238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceed543-4560-4def-90d3-5ab86f0367df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:50.636900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceed543-4560-4def-90d3-5ab86f0367df None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:50.637313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceed543-4560-4def-90d3-5ab86f0367df None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:50.637602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceed543-4560-4def-90d3-5ab86f0367df None admin] PATH_INFO: `/v3/users/nova` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:50.643804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240f527-ddcc-4f51-926e-7523c51b30b8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:50.645687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceed543-4560-4def-90d3-5ab86f0367df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:50.647258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceed543-4560-4def-90d3-5ab86f0367df None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:50.667697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-1ceed543-4560-4def-90d3-5ab86f0367df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 15:20:50.673574 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 410/816] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Mar 8 15:20:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:50.675107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceed543-4560-4def-90d3-5ab86f0367df None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:50.687852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4535047-9e17-4636-a681-ece18763a130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:50.688876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4535047-9e17-4636-a681-ece18763a130 None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:50.689216 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4535047-9e17-4636-a681-ece18763a130 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:50.689524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4535047-9e17-4636-a681-ece18763a130 None admin] PATH_INFO: `/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/10fc82e0c3f0414492c1df4381918877/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:50.693786 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4535047-9e17-4636-a681-ece18763a130 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdaa0405e224334ac42dc4cde1c01c5, user_id=10fc82e0c3f0414492c1df4381918877, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:50.696546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4535047-9e17-4636-a681-ece18763a130 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:50.777561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 407/817] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:20:50 2022] PUT /identity/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/10fc82e0c3f0414492c1df4381918877/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:20:50.778699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4535047-9e17-4636-a681-ece18763a130 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:50.858375 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceed543-4560-4def-90d3-5ab86f0367df None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:50.966128 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8ef6f-04b3-47d9-9bf3-e28a78ca7827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:50.966869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8ef6f-04b3-47d9-9bf3-e28a78ca7827 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:50.967161 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8ef6f-04b3-47d9-9bf3-e28a78ca7827 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:50.967438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8ef6f-04b3-47d9-9bf3-e28a78ca7827 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:50.968181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8ef6f-04b3-47d9-9bf3-e28a78ca7827 None admin] RBAC: Adding query filter params (type=network) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:50.968498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8ef6f-04b3-47d9-9bf3-e28a78ca7827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:50.969888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8ef6f-04b3-47d9-9bf3-e28a78ca7827 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:50.987560 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 411/818] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:20:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:51.008860 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8ef6f-04b3-47d9-9bf3-e28a78ca7827 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:51.025865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4535047-9e17-4636-a681-ece18763a130 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:51.072295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6278665-5896-4a9b-99b2-1ade68b0690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:51.072978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6278665-5896-4a9b-99b2-1ade68b0690d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:51.073260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6278665-5896-4a9b-99b2-1ade68b0690d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:51.073540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6278665-5896-4a9b-99b2-1ade68b0690d None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:51.078279 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6278665-5896-4a9b-99b2-1ade68b0690d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:51.078605 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6278665-5896-4a9b-99b2-1ade68b0690d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:51.080097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6278665-5896-4a9b-99b2-1ade68b0690d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:51.103392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 408/819] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Mar 8 15:20:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:51.108916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6278665-5896-4a9b-99b2-1ade68b0690d None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:51.133705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8ef6f-04b3-47d9-9bf3-e28a78ca7827 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:51.178655 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f946ba4-3cb9-441a-9bdb-c5c06c4feb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:51.179323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946ba4-3cb9-441a-9bdb-c5c06c4feb81 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:51.179605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946ba4-3cb9-441a-9bdb-c5c06c4feb81 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:51.179880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946ba4-3cb9-441a-9bdb-c5c06c4feb81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:51.180817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f946ba4-3cb9-441a-9bdb-c5c06c4feb81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:51.182953 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f946ba4-3cb9-441a-9bdb-c5c06c4feb81 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:51.222974 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6278665-5896-4a9b-99b2-1ade68b0690d None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:51.257083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86076580-1b25-42da-ba1e-e2b5404780f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:51.257739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86076580-1b25-42da-ba1e-e2b5404780f5 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:51.258016 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86076580-1b25-42da-ba1e-e2b5404780f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:51.258297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86076580-1b25-42da-ba1e-e2b5404780f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:51.271107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 412/820] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Mar 8 15:20:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:20:51.350203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86076580-1b25-42da-ba1e-e2b5404780f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:51.352110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86076580-1b25-42da-ba1e-e2b5404780f5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:51.485852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 409/821] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 15:20:51.493268 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f946ba4-3cb9-441a-9bdb-c5c06c4feb81 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:51.499786 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e02f6c-d1de-420d-8e87-f7d6f14c1c70 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:51.500390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e02f6c-d1de-420d-8e87-f7d6f14c1c70 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:51.500874 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e02f6c-d1de-420d-8e87-f7d6f14c1c70 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:51.504615 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 410/822] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:20:51.509817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185eebf-068d-4910-b803-69f518f9224e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:51.510354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185eebf-068d-4910-b803-69f518f9224e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:51.510832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185eebf-068d-4910-b803-69f518f9224e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:51.535480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-2185eebf-068d-4910-b803-69f518f9224e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:51.537592 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2185eebf-068d-4910-b803-69f518f9224e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:51.621913 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f946ba4-3cb9-441a-9bdb-c5c06c4feb81 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:51.626265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 411/823] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:20:51.658138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85205b-b498-4ad0-8369-e5055285cc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:51.658937 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85205b-b498-4ad0-8369-e5055285cc3c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:51.659221 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85205b-b498-4ad0-8369-e5055285cc3c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:51.659496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85205b-b498-4ad0-8369-e5055285cc3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:51.661557 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185eebf-068d-4910-b803-69f518f9224e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:51.671847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85205b-b498-4ad0-8369-e5055285cc3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:51.673082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85205b-b498-4ad0-8369-e5055285cc3c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:51.691099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-af85205b-b498-4ad0-8369-e5055285cc3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:51.692640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 413/824] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:51.697996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85205b-b498-4ad0-8369-e5055285cc3c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:51.796720 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185eebf-068d-4910-b803-69f518f9224e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:51.828261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85205b-b498-4ad0-8369-e5055285cc3c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:51.835033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caa25c-a54b-478b-8a73-c0dc9ebd213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:51.836093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caa25c-a54b-478b-8a73-c0dc9ebd213e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:51.836618 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caa25c-a54b-478b-8a73-c0dc9ebd213e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:51.837119 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caa25c-a54b-478b-8a73-c0dc9ebd213e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:51.838007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caa25c-a54b-478b-8a73-c0dc9ebd213e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:51.839660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caa25c-a54b-478b-8a73-c0dc9ebd213e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:51.852735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-88caa25c-a54b-478b-8a73-c0dc9ebd213e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 15:20:51.854654 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 412/825] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Mar 8 15:20:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:51.860911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caa25c-a54b-478b-8a73-c0dc9ebd213e None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:51.873066 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7b05-d766-42af-9dc3-e01041c86e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:51.874028 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7b05-d766-42af-9dc3-e01041c86e76 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:51.874633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7b05-d766-42af-9dc3-e01041c86e76 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:51.875060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e7b05-d766-42af-9dc3-e01041c86e76 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:51.875996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e7b05-d766-42af-9dc3-e01041c86e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:51.876481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e7b05-d766-42af-9dc3-e01041c86e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:51.878625 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e7b05-d766-42af-9dc3-e01041c86e76 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:51.891689 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 414/826] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:51.897829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7b05-d766-42af-9dc3-e01041c86e76 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:51.967858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caa25c-a54b-478b-8a73-c0dc9ebd213e None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:52.005133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff977770-540f-4ebe-82ae-c6e6c0842c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:52.006051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e7b05-d766-42af-9dc3-e01041c86e76 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:52.006209 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff977770-540f-4ebe-82ae-c6e6c0842c1a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:52.006332 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff977770-540f-4ebe-82ae-c6e6c0842c1a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:52.006613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff977770-540f-4ebe-82ae-c6e6c0842c1a None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:52.007320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff977770-540f-4ebe-82ae-c6e6c0842c1a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:52.007623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff977770-540f-4ebe-82ae-c6e6c0842c1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:52.009983 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff977770-540f-4ebe-82ae-c6e6c0842c1a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:52.015192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 413/827] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Mar 8 15:20:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:52.021065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff977770-540f-4ebe-82ae-c6e6c0842c1a None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:52.042473 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fa9fa-89f8-4465-a921-f1608eaf727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:52.043569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fa9fa-89f8-4465-a921-f1608eaf727f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:52.044116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fa9fa-89f8-4465-a921-f1608eaf727f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:52.044629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fa9fa-89f8-4465-a921-f1608eaf727f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:52.051988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fa9fa-89f8-4465-a921-f1608eaf727f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:52.053745 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fa9fa-89f8-4465-a921-f1608eaf727f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:52.067658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-292fa9fa-89f8-4465-a921-f1608eaf727f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:52.073893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 415/828] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:52.074991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fa9fa-89f8-4465-a921-f1608eaf727f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:52.146838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff977770-540f-4ebe-82ae-c6e6c0842c1a None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:52.186589 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb810340-62ea-4e1e-b1aa-de3c23e434db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:52.187249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb810340-62ea-4e1e-b1aa-de3c23e434db None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:52.187531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb810340-62ea-4e1e-b1aa-de3c23e434db None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:52.187804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb810340-62ea-4e1e-b1aa-de3c23e434db None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:52.188596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb810340-62ea-4e1e-b1aa-de3c23e434db None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:52.188958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb810340-62ea-4e1e-b1aa-de3c23e434db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:52.190417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb810340-62ea-4e1e-b1aa-de3c23e434db None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:52.195418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fa9fa-89f8-4465-a921-f1608eaf727f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:52.195903 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 414/829] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Mar 8 15:20:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:52.200600 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb810340-62ea-4e1e-b1aa-de3c23e434db None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:52.231127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84205c-e7f4-4514-a592-0d75e01d08f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:52.232114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84205c-e7f4-4514-a592-0d75e01d08f5 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:52.232434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84205c-e7f4-4514-a592-0d75e01d08f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:52.232715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84205c-e7f4-4514-a592-0d75e01d08f5 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:52.233496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84205c-e7f4-4514-a592-0d75e01d08f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:52.233813 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84205c-e7f4-4514-a592-0d75e01d08f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:52.235242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84205c-e7f4-4514-a592-0d75e01d08f5 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:52.247947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 416/830] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:52.249227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cf7d3-1548-4b57-9d90-e9e67f08eabe None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:52.249517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cf7d3-1548-4b57-9d90-e9e67f08eabe None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:52.249797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cf7d3-1548-4b57-9d90-e9e67f08eabe None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:52.251549 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 417/831] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:52.254609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cf7d3-1548-4b57-9d90-e9e67f08eabe None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:52.310472 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb810340-62ea-4e1e-b1aa-de3c23e434db None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:52.343091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa372c-a3cd-4df7-ae5b-bd2b5813bdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:52.343746 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa372c-a3cd-4df7-ae5b-bd2b5813bdfc None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:52.344032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa372c-a3cd-4df7-ae5b-bd2b5813bdfc None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:52.344341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa372c-a3cd-4df7-ae5b-bd2b5813bdfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:52.345077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa372c-a3cd-4df7-ae5b-bd2b5813bdfc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:52.347013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa372c-a3cd-4df7-ae5b-bd2b5813bdfc None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:52.353777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cf7d3-1548-4b57-9d90-e9e67f08eabe None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:52.385729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b4c1d-dcfd-4612-893b-9ace11bb8fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:52.386557 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b4c1d-dcfd-4612-893b-9ace11bb8fdb None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:52.386841 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b4c1d-dcfd-4612-893b-9ace11bb8fdb None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:52.387122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b4c1d-dcfd-4612-893b-9ace11bb8fdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:52.387942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b4c1d-dcfd-4612-893b-9ace11bb8fdb None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=c4fb404cc61d49d3aaec429f4f9f4f94) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:52.388291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b4c1d-dcfd-4612-893b-9ace11bb8fdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:52.389864 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b4c1d-dcfd-4612-893b-9ace11bb8fdb None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:52.404222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 418/832] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:52 2022] GET /identity/v3/role_assignments?user.id=c4fb404cc61d49d3aaec429f4f9f4f94&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=24a7898c863141f1911792647b5274e3 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:52.404222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a984957-93c2-4639-9b6a-345ddfa129d6 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:52.404222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a984957-93c2-4639-9b6a-345ddfa129d6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:52.404222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a984957-93c2-4639-9b6a-345ddfa129d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:52.422782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-6a984957-93c2-4639-9b6a-345ddfa129d6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:52.424071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-6a984957-93c2-4639-9b6a-345ddfa129d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:52.441723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 415/833] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Mar 8 15:20:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:20:52.514638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 419/834] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:20:52.540422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa372c-a3cd-4df7-ae5b-bd2b5813bdfc None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:52.670085 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa372c-a3cd-4df7-ae5b-bd2b5813bdfc None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:52.709120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b433b18-ee21-4a19-95b4-db45d7aad8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:52.709918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b433b18-ee21-4a19-95b4-db45d7aad8fa None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:52.710229 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b433b18-ee21-4a19-95b4-db45d7aad8fa None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:52.710475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b433b18-ee21-4a19-95b4-db45d7aad8fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:52.721758 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b433b18-ee21-4a19-95b4-db45d7aad8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:52.728688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-0b433b18-ee21-4a19-95b4-db45d7aad8fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:20:52.730283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 416/835] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:20:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:52.736235 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a984957-93c2-4639-9b6a-345ddfa129d6 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:52.835730 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a984957-93c2-4639-9b6a-345ddfa129d6 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:52.869621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdbd82-0654-488d-b61c-eec935f553cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:52.870606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdbd82-0654-488d-b61c-eec935f553cc None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:52.871080 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdbd82-0654-488d-b61c-eec935f553cc None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:52.871537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdbd82-0654-488d-b61c-eec935f553cc None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:52.872483 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdbd82-0654-488d-b61c-eec935f553cc None admin] RBAC: Adding query filter params (name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:52.872960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdbd82-0654-488d-b61c-eec935f553cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:52.874502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdbd82-0654-488d-b61c-eec935f553cc None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:52.883775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 420/836] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:20:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:52.889388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b433b18-ee21-4a19-95b4-db45d7aad8fa None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:52.994859 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b433b18-ee21-4a19-95b4-db45d7aad8fa None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:53.028791 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f1981-2459-432d-8463-2d6268526b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:53.029828 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1981-2459-432d-8463-2d6268526b9c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:53.030311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1981-2459-432d-8463-2d6268526b9c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:53.030776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1981-2459-432d-8463-2d6268526b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:53.041260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1981-2459-432d-8463-2d6268526b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:53.042929 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1981-2459-432d-8463-2d6268526b9c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:53.059656 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-c45f1981-2459-432d-8463-2d6268526b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:53.061399 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 417/837] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:53.067654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdbd82-0654-488d-b61c-eec935f553cc None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:53.167640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdbd82-0654-488d-b61c-eec935f553cc None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:53.201583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75348ca9-21e0-4038-a83d-cc7f882a4a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:53.202385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75348ca9-21e0-4038-a83d-cc7f882a4a6a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:53.202595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75348ca9-21e0-4038-a83d-cc7f882a4a6a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:53.202868 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75348ca9-21e0-4038-a83d-cc7f882a4a6a None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:53.203587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75348ca9-21e0-4038-a83d-cc7f882a4a6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:53.203886 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75348ca9-21e0-4038-a83d-cc7f882a4a6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:53.205330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75348ca9-21e0-4038-a83d-cc7f882a4a6a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:53.217915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 421/838] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:53.223289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f1981-2459-432d-8463-2d6268526b9c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:53.311688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb4bfb-96db-47bf-96d0-76d952c87362 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:53.311976 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb4bfb-96db-47bf-96d0-76d952c87362 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:53.312186 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb4bfb-96db-47bf-96d0-76d952c87362 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:53.315760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 422/839] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:20:53.319883 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748e453-66a9-4875-98e2-ea0a433c10a0 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:53.320212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748e453-66a9-4875-98e2-ea0a433c10a0 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:53.320478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748e453-66a9-4875-98e2-ea0a433c10a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:53.324822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f1981-2459-432d-8463-2d6268526b9c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:53.336955 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b748e453-66a9-4875-98e2-ea0a433c10a0 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:53.338127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b748e453-66a9-4875-98e2-ea0a433c10a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:53.365593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d7fbf-f24a-4319-9832-d44ca46551ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:53.366565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d7fbf-f24a-4319-9832-d44ca46551ec None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:53.367137 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d7fbf-f24a-4319-9832-d44ca46551ec None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:53.367428 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d7fbf-f24a-4319-9832-d44ca46551ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:53.376879 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d7fbf-f24a-4319-9832-d44ca46551ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:53.379316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d7fbf-f24a-4319-9832-d44ca46551ec None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:53.397132 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-f84d7fbf-f24a-4319-9832-d44ca46551ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 15:20:53.398501 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 418/840] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Mar 8 15:20:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:53.404964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d7fbf-f24a-4319-9832-d44ca46551ec None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:53.416271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 423/841] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:20:53.436534 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748e453-66a9-4875-98e2-ea0a433c10a0 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:53.519854 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d7fbf-f24a-4319-9832-d44ca46551ec None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:53.531528 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748e453-66a9-4875-98e2-ea0a433c10a0 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:53.554567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc22519-0069-4fcb-91d5-238e967ee558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:53.555926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc22519-0069-4fcb-91d5-238e967ee558 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:53.556428 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc22519-0069-4fcb-91d5-238e967ee558 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:53.556900 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc22519-0069-4fcb-91d5-238e967ee558 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:53.557923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc22519-0069-4fcb-91d5-238e967ee558 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:53.558449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc22519-0069-4fcb-91d5-238e967ee558 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:53.560090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc22519-0069-4fcb-91d5-238e967ee558 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:53.567717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c75b8c-c7dd-46c5-a860-45c494543b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:53.568493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c75b8c-c7dd-46c5-a860-45c494543b9e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:53.568754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c75b8c-c7dd-46c5-a860-45c494543b9e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:53.569027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c75b8c-c7dd-46c5-a860-45c494543b9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:53.579645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c75b8c-c7dd-46c5-a860-45c494543b9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:53.590901 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 419/842] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Mar 8 15:20:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:53.590901 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc22519-0069-4fcb-91d5-238e967ee558 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:53.591091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-d4c75b8c-c7dd-46c5-a860-45c494543b9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:20:53.591091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 424/843] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:53.594425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c75b8c-c7dd-46c5-a860-45c494543b9e None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:53.688625 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc22519-0069-4fcb-91d5-238e967ee558 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:53.699314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c75b8c-c7dd-46c5-a860-45c494543b9e None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:53.724937 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c867-150b-489a-a125-86a64933318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:53.725962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c867-150b-489a-a125-86a64933318c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:53.726435 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c867-150b-489a-a125-86a64933318c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:53.726899 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c867-150b-489a-a125-86a64933318c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:53.735037 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82714787-46a2-4dde-ab3e-2ebbb342ae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:53.735701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82714787-46a2-4dde-ab3e-2ebbb342ae9d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:53.735983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82714787-46a2-4dde-ab3e-2ebbb342ae9d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:53.736979 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82714787-46a2-4dde-ab3e-2ebbb342ae9d None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:53.737800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82714787-46a2-4dde-ab3e-2ebbb342ae9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:53.738034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82714787-46a2-4dde-ab3e-2ebbb342ae9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:53.739402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82714787-46a2-4dde-ab3e-2ebbb342ae9d None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:53.752207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 425/844] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:20:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:53.753380 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82714787-46a2-4dde-ab3e-2ebbb342ae9d None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:53.797018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04c867-150b-489a-a125-86a64933318c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:53.798810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04c867-150b-489a-a125-86a64933318c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:53.854985 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82714787-46a2-4dde-ab3e-2ebbb342ae9d None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:53.889769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50681b-cef5-4b0b-af5b-da0e1f95ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:53.890770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50681b-cef5-4b0b-af5b-da0e1f95ad24 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:53.891199 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50681b-cef5-4b0b-af5b-da0e1f95ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:53.891611 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50681b-cef5-4b0b-af5b-da0e1f95ad24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:53.901396 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 420/845] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:20:53.902499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c867-150b-489a-a125-86a64933318c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:53.903113 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50681b-cef5-4b0b-af5b-da0e1f95ad24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:53.904763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50681b-cef5-4b0b-af5b-da0e1f95ad24 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:53.922628 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-ff50681b-cef5-4b0b-af5b-da0e1f95ad24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:53.928491 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 426/846] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:53.929864 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50681b-cef5-4b0b-af5b-da0e1f95ad24 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:53.999635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c867-150b-489a-a125-86a64933318c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:54.030973 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50681b-cef5-4b0b-af5b-da0e1f95ad24 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:54.033927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9f2c4-7152-4a0e-9f33-dd47188f60a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:54.034991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9f2c4-7152-4a0e-9f33-dd47188f60a2 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.035463 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9f2c4-7152-4a0e-9f33-dd47188f60a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.035933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9f2c4-7152-4a0e-9f33-dd47188f60a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.046261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9f2c4-7152-4a0e-9f33-dd47188f60a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:54.048048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9f2c4-7152-4a0e-9f33-dd47188f60a2 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:54.065319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cde582-5d43-4eaa-b6ef-fb68b56e0cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:54.066200 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cde582-5d43-4eaa-b6ef-fb68b56e0cbc None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.066635 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cde582-5d43-4eaa-b6ef-fb68b56e0cbc None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.067052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cde582-5d43-4eaa-b6ef-fb68b56e0cbc None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.067549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-71d9f2c4-7152-4a0e-9f33-dd47188f60a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:54.068136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cde582-5d43-4eaa-b6ef-fb68b56e0cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:54.068606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cde582-5d43-4eaa-b6ef-fb68b56e0cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:54.069049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 421/847] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:54.070453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cde582-5d43-4eaa-b6ef-fb68b56e0cbc None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:54.074449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9f2c4-7152-4a0e-9f33-dd47188f60a2 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:54.092221 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 427/848] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:54.100703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cde582-5d43-4eaa-b6ef-fb68b56e0cbc None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:54.191749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9f2c4-7152-4a0e-9f33-dd47188f60a2 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:54.227806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cde582-5d43-4eaa-b6ef-fb68b56e0cbc None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:54.232115 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b590ef-7e71-4e75-b2c6-eebd8b5f0048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:54.233129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b590ef-7e71-4e75-b2c6-eebd8b5f0048 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.233609 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b590ef-7e71-4e75-b2c6-eebd8b5f0048 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.234094 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b590ef-7e71-4e75-b2c6-eebd8b5f0048 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.235020 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b590ef-7e71-4e75-b2c6-eebd8b5f0048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:54.235525 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b590ef-7e71-4e75-b2c6-eebd8b5f0048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:54.237589 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b590ef-7e71-4e75-b2c6-eebd8b5f0048 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:54.254735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 422/849] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:54.260876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b590ef-7e71-4e75-b2c6-eebd8b5f0048 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:54.271170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70271-9645-4295-af18-df697f3de46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:54.271971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70271-9645-4295-af18-df697f3de46c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.272269 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70271-9645-4295-af18-df697f3de46c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.272544 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70271-9645-4295-af18-df697f3de46c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.281802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b70271-9645-4295-af18-df697f3de46c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:54.283559 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b70271-9645-4295-af18-df697f3de46c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:54.301924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-76b70271-9645-4295-af18-df697f3de46c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 15:20:54.304421 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 428/850] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:20:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:54.316398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70271-9645-4295-af18-df697f3de46c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:54.384703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b590ef-7e71-4e75-b2c6-eebd8b5f0048 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:54.429341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf7685-9b63-4394-b508-c0d2ca7a63c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:54.430643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf7685-9b63-4394-b508-c0d2ca7a63c6 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.430926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf7685-9b63-4394-b508-c0d2ca7a63c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.431200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf7685-9b63-4394-b508-c0d2ca7a63c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.432751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70271-9645-4295-af18-df697f3de46c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:54.439023 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf7685-9b63-4394-b508-c0d2ca7a63c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:54.441530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf7685-9b63-4394-b508-c0d2ca7a63c6 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:54.459253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-8dbf7685-9b63-4394-b508-c0d2ca7a63c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:54.461498 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 423/851] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:54.466650 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf7685-9b63-4394-b508-c0d2ca7a63c6 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:54.474523 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b2b6c-af10-4380-8d69-9386f66f5b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:54.475556 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b2b6c-af10-4380-8d69-9386f66f5b41 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.476013 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b2b6c-af10-4380-8d69-9386f66f5b41 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.476504 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b2b6c-af10-4380-8d69-9386f66f5b41 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.477565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b2b6c-af10-4380-8d69-9386f66f5b41 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:54.478074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b2b6c-af10-4380-8d69-9386f66f5b41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:54.479724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b2b6c-af10-4380-8d69-9386f66f5b41 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:54.502591 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 429/852] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Mar 8 15:20:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:54.503751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b2b6c-af10-4380-8d69-9386f66f5b41 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:54.575810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf7685-9b63-4394-b508-c0d2ca7a63c6 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:54.612456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dd97b-5169-4bc4-9e8a-fd0bf4b4e24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:54.613630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dd97b-5169-4bc4-9e8a-fd0bf4b4e24b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.614109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dd97b-5169-4bc4-9e8a-fd0bf4b4e24b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.614753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dd97b-5169-4bc4-9e8a-fd0bf4b4e24b None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.616049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dd97b-5169-4bc4-9e8a-fd0bf4b4e24b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:54.616767 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dd97b-5169-4bc4-9e8a-fd0bf4b4e24b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:54.618814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dd97b-5169-4bc4-9e8a-fd0bf4b4e24b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:54.639749 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b2b6c-af10-4380-8d69-9386f66f5b41 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:54.640801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 424/853] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:54.645744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dd97b-5169-4bc4-9e8a-fd0bf4b4e24b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:54.680061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644dc5f-db3b-4f2d-8ec2-5a65a4c32e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:54.680751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644dc5f-db3b-4f2d-8ec2-5a65a4c32e27 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.681034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644dc5f-db3b-4f2d-8ec2-5a65a4c32e27 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.681618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644dc5f-db3b-4f2d-8ec2-5a65a4c32e27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.767785 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dd97b-5169-4bc4-9e8a-fd0bf4b4e24b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:54.768500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644dc5f-db3b-4f2d-8ec2-5a65a4c32e27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:54.770125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644dc5f-db3b-4f2d-8ec2-5a65a4c32e27 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:54.807511 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca816568-f2db-48fe-9e29-3a6b3c32827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:54.808557 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca816568-f2db-48fe-9e29-3a6b3c32827a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.809053 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca816568-f2db-48fe-9e29-3a6b3c32827a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.809534 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca816568-f2db-48fe-9e29-3a6b3c32827a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.810576 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca816568-f2db-48fe-9e29-3a6b3c32827a None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=21f49c3c297e4a2b89260910c90bc21d) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:54.811079 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca816568-f2db-48fe-9e29-3a6b3c32827a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:54.812774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca816568-f2db-48fe-9e29-3a6b3c32827a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:54.824579 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 425/854] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:54 2022] GET /identity/v3/role_assignments?user.id=21f49c3c297e4a2b89260910c90bc21d&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:54.828073 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c754ea4-c44d-4a75-b865-51452bce4ed8 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.828657 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c754ea4-c44d-4a75-b865-51452bce4ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.829153 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c754ea4-c44d-4a75-b865-51452bce4ed8 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.831516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 426/855] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:54.837900 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c15c83-14f8-44c6-a4ec-d12a4bec817f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.838511 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c15c83-14f8-44c6-a4ec-d12a4bec817f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.839031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c15c83-14f8-44c6-a4ec-d12a4bec817f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.858113 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-08c15c83-14f8-44c6-a4ec-d12a4bec817f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:54.860905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-08c15c83-14f8-44c6-a4ec-d12a4bec817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:54.899189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 430/856] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:20:54.900541 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644dc5f-db3b-4f2d-8ec2-5a65a4c32e27 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:54.941519 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 427/857] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:20:54.943514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734c685-4a4e-4fbf-ba7c-a8ca97e2bf40 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.943913 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734c685-4a4e-4fbf-ba7c-a8ca97e2bf40 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.944336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734c685-4a4e-4fbf-ba7c-a8ca97e2bf40 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.947462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 428/858] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:54.952604 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d3df6-876b-4071-be7d-335d89fcfb31 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:54.953135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d3df6-876b-4071-be7d-335d89fcfb31 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:54.953543 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d3df6-876b-4071-be7d-335d89fcfb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:54.972075 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-a62d3df6-876b-4071-be7d-335d89fcfb31 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:54.973610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a62d3df6-876b-4071-be7d-335d89fcfb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:55.007992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644dc5f-db3b-4f2d-8ec2-5a65a4c32e27 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:55.043733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 429/859] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:20:55.044595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d3df6-876b-4071-be7d-335d89fcfb31 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:55.050060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d8b75-dcb3-4e46-a040-06f2f1494050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:55.050853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d8b75-dcb3-4e46-a040-06f2f1494050 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:55.051135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d8b75-dcb3-4e46-a040-06f2f1494050 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:55.051408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d8b75-dcb3-4e46-a040-06f2f1494050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:55.062031 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d8b75-dcb3-4e46-a040-06f2f1494050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:55.063085 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d8b75-dcb3-4e46-a040-06f2f1494050 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:55.081837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-9b0d8b75-dcb3-4e46-a040-06f2f1494050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:55.083274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 431/860] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:55.084181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d8b75-dcb3-4e46-a040-06f2f1494050 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:55.155442 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d3df6-876b-4071-be7d-335d89fcfb31 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:55.187398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d8b75-dcb3-4e46-a040-06f2f1494050 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:55.188883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92d241-a2f2-4bea-8a03-a20b12a119c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:55.189719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92d241-a2f2-4bea-8a03-a20b12a119c5 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:55.189997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92d241-a2f2-4bea-8a03-a20b12a119c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:55.190266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92d241-a2f2-4bea-8a03-a20b12a119c5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:55.190912 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92d241-a2f2-4bea-8a03-a20b12a119c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:55.192362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92d241-a2f2-4bea-8a03-a20b12a119c5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:55.203338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-2c92d241-a2f2-4bea-8a03-a20b12a119c5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 15:20:55.204540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 430/861] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Mar 8 15:20:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:55.205331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92d241-a2f2-4bea-8a03-a20b12a119c5 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:55.225907 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd7679-93b3-40c3-8054-d0dac7f351fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:55.226707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7679-93b3-40c3-8054-d0dac7f351fc None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:55.226989 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7679-93b3-40c3-8054-d0dac7f351fc None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:55.227265 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd7679-93b3-40c3-8054-d0dac7f351fc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:55.227919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd7679-93b3-40c3-8054-d0dac7f351fc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:55.229311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd7679-93b3-40c3-8054-d0dac7f351fc None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:55.241278 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-fecd7679-93b3-40c3-8054-d0dac7f351fc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 15:20:55.242604 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 432/862] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:20:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:55.243211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd7679-93b3-40c3-8054-d0dac7f351fc None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:55.306188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92d241-a2f2-4bea-8a03-a20b12a119c5 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:55.338495 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae14e9-434d-45c0-90c6-d653a47903a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:55.339089 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd7679-93b3-40c3-8054-d0dac7f351fc None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:55.339196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae14e9-434d-45c0-90c6-d653a47903a4 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:55.339414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae14e9-434d-45c0-90c6-d653a47903a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:55.339687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae14e9-434d-45c0-90c6-d653a47903a4 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:55.340471 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae14e9-434d-45c0-90c6-d653a47903a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:55.340747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae14e9-434d-45c0-90c6-d653a47903a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:55.342106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae14e9-434d-45c0-90c6-d653a47903a4 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:55.353953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 431/863] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:55.354752 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae14e9-434d-45c0-90c6-d653a47903a4 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:55.375746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54201092-b375-4eec-87ee-f71e9c9176bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:55.376487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54201092-b375-4eec-87ee-f71e9c9176bf None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:55.376800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54201092-b375-4eec-87ee-f71e9c9176bf None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:55.377079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54201092-b375-4eec-87ee-f71e9c9176bf None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:55.377779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54201092-b375-4eec-87ee-f71e9c9176bf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:55.378087 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54201092-b375-4eec-87ee-f71e9c9176bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:55.379527 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54201092-b375-4eec-87ee-f71e9c9176bf None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:55.388464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 433/864] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Mar 8 15:20:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:55.388464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54201092-b375-4eec-87ee-f71e9c9176bf None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:55.454391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae14e9-434d-45c0-90c6-d653a47903a4 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:55.482436 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54201092-b375-4eec-87ee-f71e9c9176bf None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:55.489612 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad981fe-f2f8-4544-be2b-b1db8ee43462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:55.490260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad981fe-f2f8-4544-be2b-b1db8ee43462 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:55.490537 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad981fe-f2f8-4544-be2b-b1db8ee43462 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:55.490808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad981fe-f2f8-4544-be2b-b1db8ee43462 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:55.491499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad981fe-f2f8-4544-be2b-b1db8ee43462 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:55.491799 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad981fe-f2f8-4544-be2b-b1db8ee43462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:55.493195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad981fe-f2f8-4544-be2b-b1db8ee43462 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:55.497394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 432/865] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:20:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:55.498150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad981fe-f2f8-4544-be2b-b1db8ee43462 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:55.519372 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3babc4d-2aa0-46f3-baa4-2a75331e7c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:55.520169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3babc4d-2aa0-46f3-baa4-2a75331e7c7e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:55.520459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3babc4d-2aa0-46f3-baa4-2a75331e7c7e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:55.520729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3babc4d-2aa0-46f3-baa4-2a75331e7c7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:55.527308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3babc4d-2aa0-46f3-baa4-2a75331e7c7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:55.528777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3babc4d-2aa0-46f3-baa4-2a75331e7c7e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:55.542257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-e3babc4d-2aa0-46f3-baa4-2a75331e7c7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:55.547851 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 434/866] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:55.547851 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3babc4d-2aa0-46f3-baa4-2a75331e7c7e None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:55.598344 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad981fe-f2f8-4544-be2b-b1db8ee43462 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:55.631972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7840354-c51e-49c2-89ad-9b23c638833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:55.632668 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7840354-c51e-49c2-89ad-9b23c638833b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:55.632947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7840354-c51e-49c2-89ad-9b23c638833b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:55.633221 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7840354-c51e-49c2-89ad-9b23c638833b None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:55.633918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7840354-c51e-49c2-89ad-9b23c638833b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:55.634220 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7840354-c51e-49c2-89ad-9b23c638833b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:55.635659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7840354-c51e-49c2-89ad-9b23c638833b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:55.640617 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 433/867] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Mar 8 15:20:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:55.643293 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3babc4d-2aa0-46f3-baa4-2a75331e7c7e None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:55.643408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7840354-c51e-49c2-89ad-9b23c638833b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:55.685341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fc644-830d-4717-8c5e-3128ffd3b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:55.685998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc644-830d-4717-8c5e-3128ffd3b4ad None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:55.686219 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc644-830d-4717-8c5e-3128ffd3b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:55.686494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc644-830d-4717-8c5e-3128ffd3b4ad None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:55.687209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fc644-830d-4717-8c5e-3128ffd3b4ad None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:55.687516 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fc644-830d-4717-8c5e-3128ffd3b4ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:55.688986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fc644-830d-4717-8c5e-3128ffd3b4ad None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:55.694649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 435/868] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:20:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:55.779150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7840354-c51e-49c2-89ad-9b23c638833b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:55.819338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a7c3f-7497-4926-9bcf-3c7041a37980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:55.820318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a7c3f-7497-4926-9bcf-3c7041a37980 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:55.820793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a7c3f-7497-4926-9bcf-3c7041a37980 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:55.821219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a7c3f-7497-4926-9bcf-3c7041a37980 None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:55.822197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a7c3f-7497-4926-9bcf-3c7041a37980 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:55.822668 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a7c3f-7497-4926-9bcf-3c7041a37980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:55.824329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a7c3f-7497-4926-9bcf-3c7041a37980 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:55.838844 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 434/869] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:55.845254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fc644-830d-4717-8c5e-3128ffd3b4ad None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:55.948764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fc644-830d-4717-8c5e-3128ffd3b4ad None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:55.982923 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d5860-987e-4267-8985-cfabf8735969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:55.983897 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d5860-987e-4267-8985-cfabf8735969 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:55.984394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d5860-987e-4267-8985-cfabf8735969 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:55.984865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d5860-987e-4267-8985-cfabf8735969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:55.985858 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d5860-987e-4267-8985-cfabf8735969 None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=10fc82e0c3f0414492c1df4381918877) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:55.986653 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d5860-987e-4267-8985-cfabf8735969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:55.988343 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d5860-987e-4267-8985-cfabf8735969 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:55.994699 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 436/870] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:55 2022] GET /identity/v3/role_assignments?user.id=10fc82e0c3f0414492c1df4381918877&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=24a7898c863141f1911792647b5274e3 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:57.257351 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e60ca-90ff-4bdc-b34c-2e6541b0e93d None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:57.258417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e60ca-90ff-4bdc-b34c-2e6541b0e93d None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:57.258974 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e60ca-90ff-4bdc-b34c-2e6541b0e93d None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:57.261247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 435/871] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:57.266258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541422-aa70-4756-9858-c20f347b790e None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:57.266677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541422-aa70-4756-9858-c20f347b790e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:57.266856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541422-aa70-4756-9858-c20f347b790e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:57.284481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-03541422-aa70-4756-9858-c20f347b790e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:57.285677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-03541422-aa70-4756-9858-c20f347b790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:57.354946 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 437/872] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:20:57.378461 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e60ca-90ff-4bdc-b34c-2e6541b0e93d None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:57.480296 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e60ca-90ff-4bdc-b34c-2e6541b0e93d None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:57.514216 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b6386-53fc-45c0-aceb-394bbbe2319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:57.515027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b6386-53fc-45c0-aceb-394bbbe2319f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:57.515310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b6386-53fc-45c0-aceb-394bbbe2319f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:57.515594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b6386-53fc-45c0-aceb-394bbbe2319f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:57.526886 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b6386-53fc-45c0-aceb-394bbbe2319f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:20:57.534301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-fd8b6386-53fc-45c0-aceb-394bbbe2319f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 15:20:57.535810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 436/873] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Mar 8 15:20:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:57.541700 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03541422-aa70-4756-9858-c20f347b790e None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:57.643384 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03541422-aa70-4756-9858-c20f347b790e None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:57.684551 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5ca5-08c9-4098-bfd0-b3789f4c56e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:57.685228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5ca5-08c9-4098-bfd0-b3789f4c56e0 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:57.685513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5ca5-08c9-4098-bfd0-b3789f4c56e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:57.685791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5ca5-08c9-4098-bfd0-b3789f4c56e0 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:57.686550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d5ca5-08c9-4098-bfd0-b3789f4c56e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:57.686859 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d5ca5-08c9-4098-bfd0-b3789f4c56e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:57.688261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d5ca5-08c9-4098-bfd0-b3789f4c56e0 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:57.698097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 438/874] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Mar 8 15:20:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:57.703772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b6386-53fc-45c0-aceb-394bbbe2319f None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:57.805782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b6386-53fc-45c0-aceb-394bbbe2319f None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:57.839880 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152319c-ecdd-4bca-9ac0-2669953de81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:57.840708 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152319c-ecdd-4bca-9ac0-2669953de81f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:57.840994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152319c-ecdd-4bca-9ac0-2669953de81f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:57.841273 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152319c-ecdd-4bca-9ac0-2669953de81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:57.851612 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152319c-ecdd-4bca-9ac0-2669953de81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:57.853103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152319c-ecdd-4bca-9ac0-2669953de81f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:57.870770 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-2152319c-ecdd-4bca-9ac0-2669953de81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:57.877247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 437/875] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:57.878288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5ca5-08c9-4098-bfd0-b3789f4c56e0 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:57.984902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5ca5-08c9-4098-bfd0-b3789f4c56e0 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:58.004484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7941ef-96fb-4807-8017-6cf033d73a0b None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.004805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7941ef-96fb-4807-8017-6cf033d73a0b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.005047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7941ef-96fb-4807-8017-6cf033d73a0b None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.008015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 438/876] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:58.013322 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568d43-dfdb-4983-887b-62b8050a9e0b None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.013720 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568d43-dfdb-4983-887b-62b8050a9e0b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.014102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568d43-dfdb-4983-887b-62b8050a9e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.022339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f023a7-c3e0-4e24-8782-99442ff688fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:58.022993 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f023a7-c3e0-4e24-8782-99442ff688fe None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.023271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f023a7-c3e0-4e24-8782-99442ff688fe None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.023544 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f023a7-c3e0-4e24-8782-99442ff688fe None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.024308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f023a7-c3e0-4e24-8782-99442ff688fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:58.024614 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f023a7-c3e0-4e24-8782-99442ff688fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:58.025987 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f023a7-c3e0-4e24-8782-99442ff688fe None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:58.034794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-59568d43-dfdb-4983-887b-62b8050a9e0b None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:58.036815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-59568d43-dfdb-4983-887b-62b8050a9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:58.038470 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 439/877] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:58.044881 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f023a7-c3e0-4e24-8782-99442ff688fe None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:58.119852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 439/878] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:20:58.121186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c4420-84f2-46dc-87b9-c9907b63c3d4 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.121479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c4420-84f2-46dc-87b9-c9907b63c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.121754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c4420-84f2-46dc-87b9-c9907b63c3d4 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.123525 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 440/879] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:58.128982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08298-41f7-4117-a450-9d34a786d86a None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.129271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08298-41f7-4117-a450-9d34a786d86a None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.129561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08298-41f7-4117-a450-9d34a786d86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.146170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-40d08298-41f7-4117-a450-9d34a786d86a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:58.147375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-40d08298-41f7-4117-a450-9d34a786d86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:58.156960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f023a7-c3e0-4e24-8782-99442ff688fe None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:58.190848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc045-b995-421a-b326-b36b2ae58b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:58.191663 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc045-b995-421a-b326-b36b2ae58b2e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.191952 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc045-b995-421a-b326-b36b2ae58b2e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.192263 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc045-b995-421a-b326-b36b2ae58b2e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.199376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fc045-b995-421a-b326-b36b2ae58b2e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:58.200848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fc045-b995-421a-b326-b36b2ae58b2e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:58.220054 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 441/880] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:20:58.220054 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d08298-41f7-4117-a450-9d34a786d86a None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:58.221092 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-374fc045-b995-421a-b326-b36b2ae58b2e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 15:20:58.221092 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 440/881] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Mar 8 15:20:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:58.223734 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc045-b995-421a-b326-b36b2ae58b2e None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:58.322446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d08298-41f7-4117-a450-9d34a786d86a None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:58.323390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc045-b995-421a-b326-b36b2ae58b2e None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:58.356504 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906969d-af0d-4dff-a563-4a510db0c726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:58.356830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1c654-b0a8-4330-b8b3-d949284a76b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:58.357161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906969d-af0d-4dff-a563-4a510db0c726 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.357417 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1c654-b0a8-4330-b8b3-d949284a76b3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.357530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906969d-af0d-4dff-a563-4a510db0c726 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.357712 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1c654-b0a8-4330-b8b3-d949284a76b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.357806 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906969d-af0d-4dff-a563-4a510db0c726 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.357960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1c654-b0a8-4330-b8b3-d949284a76b3 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.358491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906969d-af0d-4dff-a563-4a510db0c726 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:58.358781 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1c654-b0a8-4330-b8b3-d949284a76b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:58.359087 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1c654-b0a8-4330-b8b3-d949284a76b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:58.359875 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906969d-af0d-4dff-a563-4a510db0c726 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:58.360633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1c654-b0a8-4330-b8b3-d949284a76b3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:58.382029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 441/882] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Mar 8 15:20:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:58.382029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1c654-b0a8-4330-b8b3-d949284a76b3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:58.414339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 442/883] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:20:58 2022] POST /identity/v3/services => generated 269 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:20:58.417093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906969d-af0d-4dff-a563-4a510db0c726 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:58.485469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1c654-b0a8-4330-b8b3-d949284a76b3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:58.527642 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7fa7b-9837-4b4e-926d-bc5164ec8861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:58.528350 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7fa7b-9837-4b4e-926d-bc5164ec8861 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.528630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7fa7b-9837-4b4e-926d-bc5164ec8861 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.528920 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7fa7b-9837-4b4e-926d-bc5164ec8861 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.529630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7fa7b-9837-4b4e-926d-bc5164ec8861 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:58.530268 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906969d-af0d-4dff-a563-4a510db0c726 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:58.531008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7fa7b-9837-4b4e-926d-bc5164ec8861 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:58.566987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7cf4d-32e8-416a-92ee-6d8368f124ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:58.567645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7cf4d-32e8-416a-92ee-6d8368f124ff None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.567934 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7cf4d-32e8-416a-92ee-6d8368f124ff None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.568263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7cf4d-32e8-416a-92ee-6d8368f124ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.607993 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 442/884] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:20:58 2022] POST /identity/v3/services => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:20:58.609635 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432903e-a591-4d71-9379-2e645a2ad14f None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.609930 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432903e-a591-4d71-9379-2e645a2ad14f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.610210 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432903e-a591-4d71-9379-2e645a2ad14f None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.612366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 443/885] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:20:58.618464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bf102-e3a2-456e-adf6-5bf2604e0a98 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.618770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bf102-e3a2-456e-adf6-5bf2604e0a98 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.619010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bf102-e3a2-456e-adf6-5bf2604e0a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.639573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-901bf102-e3a2-456e-adf6-5bf2604e0a98 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:20:58.641666 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-901bf102-e3a2-456e-adf6-5bf2604e0a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:20:58.645649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7cf4d-32e8-416a-92ee-6d8368f124ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:58.648200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7cf4d-32e8-416a-92ee-6d8368f124ff None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:58.735124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 444/886] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:20:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:20:58.758271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bf102-e3a2-456e-adf6-5bf2604e0a98 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:58.775845 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 443/887] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:20:58 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:20:58.781461 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7cf4d-32e8-416a-92ee-6d8368f124ff None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:58.868993 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bf102-e3a2-456e-adf6-5bf2604e0a98 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:58.888215 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7cf4d-32e8-416a-92ee-6d8368f124ff None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:58.914298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35938d3d-278b-4174-9a1a-f6bf69027704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:58.915773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35938d3d-278b-4174-9a1a-f6bf69027704 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.916511 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35938d3d-278b-4174-9a1a-f6bf69027704 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.916937 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35938d3d-278b-4174-9a1a-f6bf69027704 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.917915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35938d3d-278b-4174-9a1a-f6bf69027704 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:58.920046 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35938d3d-278b-4174-9a1a-f6bf69027704 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:58.924082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab2d1e-c554-44f8-8cee-c5c308f79670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:58.925009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab2d1e-c554-44f8-8cee-c5c308f79670 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:58.925400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab2d1e-c554-44f8-8cee-c5c308f79670 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:58.925762 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab2d1e-c554-44f8-8cee-c5c308f79670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:58.934644 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-35938d3d-278b-4174-9a1a-f6bf69027704 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 15:20:58.936019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab2d1e-c554-44f8-8cee-c5c308f79670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:58.936784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 445/888] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Mar 8 15:20:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:58.937719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab2d1e-c554-44f8-8cee-c5c308f79670 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:58.942058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35938d3d-278b-4174-9a1a-f6bf69027704 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:58.960076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-c2ab2d1e-c554-44f8-8cee-c5c308f79670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:20:58.961675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 444/889] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:20:58.967031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab2d1e-c554-44f8-8cee-c5c308f79670 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:59.050830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35938d3d-278b-4174-9a1a-f6bf69027704 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:59.084689 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4b92-77c5-43bd-b281-67f309ce6ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:59.085411 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab2d1e-c554-44f8-8cee-c5c308f79670 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:59.085522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4b92-77c5-43bd-b281-67f309ce6ed2 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:59.085847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4b92-77c5-43bd-b281-67f309ce6ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:59.086201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b4b92-77c5-43bd-b281-67f309ce6ed2 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:59.087029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b4b92-77c5-43bd-b281-67f309ce6ed2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:59.087407 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b4b92-77c5-43bd-b281-67f309ce6ed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:59.089291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b4b92-77c5-43bd-b281-67f309ce6ed2 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:59.097340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 446/890] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Mar 8 15:20:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:20:59.103026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4b92-77c5-43bd-b281-67f309ce6ed2 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:59.129642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9730807-3570-4059-a193-9eb9a5e3685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:59.130308 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9730807-3570-4059-a193-9eb9a5e3685e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:59.130789 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9730807-3570-4059-a193-9eb9a5e3685e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:59.131070 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9730807-3570-4059-a193-9eb9a5e3685e None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:59.132138 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9730807-3570-4059-a193-9eb9a5e3685e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:59.132488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9730807-3570-4059-a193-9eb9a5e3685e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:59.134294 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9730807-3570-4059-a193-9eb9a5e3685e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:59.152220 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 445/891] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:59.153732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9730807-3570-4059-a193-9eb9a5e3685e None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:59.211949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b4b92-77c5-43bd-b281-67f309ce6ed2 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:59.245777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e960e-8c39-407f-bd32-228570a8777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:59.246432 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e960e-8c39-407f-bd32-228570a8777f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:59.246716 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e960e-8c39-407f-bd32-228570a8777f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:59.246987 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e960e-8c39-407f-bd32-228570a8777f None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:59.247685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e960e-8c39-407f-bd32-228570a8777f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:59.247985 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e960e-8c39-407f-bd32-228570a8777f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:59.249364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e960e-8c39-407f-bd32-228570a8777f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:59.258628 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9730807-3570-4059-a193-9eb9a5e3685e None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:59.260620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 447/892] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Mar 8 15:20:59 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:59.298513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3359c2-8b96-4066-9c12-65371f1f0672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:59.299727 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3359c2-8b96-4066-9c12-65371f1f0672 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:59.300255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3359c2-8b96-4066-9c12-65371f1f0672 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:59.300825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3359c2-8b96-4066-9c12-65371f1f0672 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:59.308751 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3359c2-8b96-4066-9c12-65371f1f0672 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:59.310560 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3359c2-8b96-4066-9c12-65371f1f0672 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:59.325677 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-ee3359c2-8b96-4066-9c12-65371f1f0672 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:20:59.328080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 446/893] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:20:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:20:59.334757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e960e-8c39-407f-bd32-228570a8777f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:59.443439 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e960e-8c39-407f-bd32-228570a8777f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:59.476803 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165651e-8e94-4f00-b0e6-4ed11b52491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:59.477387 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165651e-8e94-4f00-b0e6-4ed11b52491d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:59.477671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165651e-8e94-4f00-b0e6-4ed11b52491d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:59.477942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165651e-8e94-4f00-b0e6-4ed11b52491d None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:59.478722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165651e-8e94-4f00-b0e6-4ed11b52491d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:59.479025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165651e-8e94-4f00-b0e6-4ed11b52491d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:59.480479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165651e-8e94-4f00-b0e6-4ed11b52491d None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:59.492802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 448/894] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:20:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:20:59.498875 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3359c2-8b96-4066-9c12-65371f1f0672 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:20:59.599368 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3359c2-8b96-4066-9c12-65371f1f0672 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:20:59.633979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18483d3e-0ac6-45ea-81bc-bf99aff2f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:20:59.634640 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483d3e-0ac6-45ea-81bc-bf99aff2f65f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:20:59.634923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483d3e-0ac6-45ea-81bc-bf99aff2f65f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:20:59.635201 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18483d3e-0ac6-45ea-81bc-bf99aff2f65f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:20:59.636030 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18483d3e-0ac6-45ea-81bc-bf99aff2f65f None admin] RBAC: Adding query filter params (role.id=da838bc59061451a83ba92732ebec16f, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=21f49c3c297e4a2b89260910c90bc21d) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:20:59.636375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18483d3e-0ac6-45ea-81bc-bf99aff2f65f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:20:59.637823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18483d3e-0ac6-45ea-81bc-bf99aff2f65f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:20:59.644201 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 447/895] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:20:59 2022] GET /identity/v3/role_assignments?user.id=21f49c3c297e4a2b89260910c90bc21d&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=da838bc59061451a83ba92732ebec16f => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:00.864656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2517b4-384d-4052-96dc-a4e419cd23ea None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:00.865191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2517b4-384d-4052-96dc-a4e419cd23ea None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:00.865266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2517b4-384d-4052-96dc-a4e419cd23ea None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:00.867250 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 449/896] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:00.872672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127301-a687-4870-97f1-50d420115f84 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:00.873072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127301-a687-4870-97f1-50d420115f84 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:00.873253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127301-a687-4870-97f1-50d420115f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:00.890581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ed127301-a687-4870-97f1-50d420115f84 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:00.891809 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ed127301-a687-4870-97f1-50d420115f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:00.967322 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 448/897] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:00.990115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2517b4-384d-4052-96dc-a4e419cd23ea None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:01.015250 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44477-e41e-4fe5-8168-62ff248872b5 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.015541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44477-e41e-4fe5-8168-62ff248872b5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.015824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e44477-e41e-4fe5-8168-62ff248872b5 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.018434 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 449/898] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:21:01.023673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a097318-6487-43e2-a00e-d6e1067c38ee None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.023958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a097318-6487-43e2-a00e-d6e1067c38ee None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.024266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a097318-6487-43e2-a00e-d6e1067c38ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.041210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7a097318-6487-43e2-a00e-d6e1067c38ee None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:01.042386 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7a097318-6487-43e2-a00e-d6e1067c38ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:01.096869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2517b4-384d-4052-96dc-a4e419cd23ea None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:01.116289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 450/899] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:01.131998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1b402-f3d9-4fca-ab5b-6dc45aca671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:01.132932 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1b402-f3d9-4fca-ab5b-6dc45aca671a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.133219 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1b402-f3d9-4fca-ab5b-6dc45aca671a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.133491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a097318-6487-43e2-a00e-d6e1067c38ee None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:01.133679 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1b402-f3d9-4fca-ab5b-6dc45aca671a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.134144 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1b402-f3d9-4fca-ab5b-6dc45aca671a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:01.135517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1b402-f3d9-4fca-ab5b-6dc45aca671a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:01.147727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-d0d1b402-f3d9-4fca-ab5b-6dc45aca671a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 15:21:01.149270 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 450/900] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Mar 8 15:21:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:01.155342 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1b402-f3d9-4fca-ab5b-6dc45aca671a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:01.232781 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a097318-6487-43e2-a00e-d6e1067c38ee None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:01.257594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1b402-f3d9-4fca-ab5b-6dc45aca671a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:01.270058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b02c-8f8e-4903-a7fc-298331d81920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:01.270938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b02c-8f8e-4903-a7fc-298331d81920 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.271219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b02c-8f8e-4903-a7fc-298331d81920 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.271536 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b02c-8f8e-4903-a7fc-298331d81920 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.272242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92b02c-8f8e-4903-a7fc-298331d81920 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:01.273672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92b02c-8f8e-4903-a7fc-298331d81920 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:01.285619 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-6b92b02c-8f8e-4903-a7fc-298331d81920 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 15:21:01.287109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 451/901] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:21:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:01.292845 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b02c-8f8e-4903-a7fc-298331d81920 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:01.295456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3360427-d482-4f03-a21d-5ec46863d145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:01.296126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3360427-d482-4f03-a21d-5ec46863d145 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.296456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3360427-d482-4f03-a21d-5ec46863d145 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.296735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3360427-d482-4f03-a21d-5ec46863d145 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.297449 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3360427-d482-4f03-a21d-5ec46863d145 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:01.297753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3360427-d482-4f03-a21d-5ec46863d145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:01.299670 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3360427-d482-4f03-a21d-5ec46863d145 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:01.305006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 451/902] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Mar 8 15:21:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:01.310518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3360427-d482-4f03-a21d-5ec46863d145 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:01.392500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b02c-8f8e-4903-a7fc-298331d81920 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:01.410138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3360427-d482-4f03-a21d-5ec46863d145 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:01.425655 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3913c4-647d-449a-9ae1-4c9c9cee26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:01.426318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3913c4-647d-449a-9ae1-4c9c9cee26ca None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.426597 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3913c4-647d-449a-9ae1-4c9c9cee26ca None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.426869 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3913c4-647d-449a-9ae1-4c9c9cee26ca None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.427571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3913c4-647d-449a-9ae1-4c9c9cee26ca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:01.427878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3913c4-647d-449a-9ae1-4c9c9cee26ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:01.429274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3913c4-647d-449a-9ae1-4c9c9cee26ca None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:01.439409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 452/903] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:21:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:01.440322 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3913c4-647d-449a-9ae1-4c9c9cee26ca None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:01.445088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbcf8e-5ac1-4141-bddf-38f23b1202da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:01.445868 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbcf8e-5ac1-4141-bddf-38f23b1202da None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.446157 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbcf8e-5ac1-4141-bddf-38f23b1202da None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.446438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbcf8e-5ac1-4141-bddf-38f23b1202da None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.447148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbcf8e-5ac1-4141-bddf-38f23b1202da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:01.447457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbcf8e-5ac1-4141-bddf-38f23b1202da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:01.448936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbcf8e-5ac1-4141-bddf-38f23b1202da None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:01.458919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 452/904] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Mar 8 15:21:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:01.459995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbcf8e-5ac1-4141-bddf-38f23b1202da None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:01.543512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3913c4-647d-449a-9ae1-4c9c9cee26ca None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:01.576735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103c6b2-a936-42e7-9057-f92aad19621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:01.577404 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103c6b2-a936-42e7-9057-f92aad19621e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.577745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103c6b2-a936-42e7-9057-f92aad19621e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.578031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103c6b2-a936-42e7-9057-f92aad19621e None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.578750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103c6b2-a936-42e7-9057-f92aad19621e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:01.578919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbcf8e-5ac1-4141-bddf-38f23b1202da None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:01.579083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103c6b2-a936-42e7-9057-f92aad19621e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:01.581029 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103c6b2-a936-42e7-9057-f92aad19621e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:01.586884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 453/905] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:21:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:01.593506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103c6b2-a936-42e7-9057-f92aad19621e None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:01.618737 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb382f-0bd5-47d4-8636-c73b6aeb01ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:01.619560 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb382f-0bd5-47d4-8636-c73b6aeb01ea None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.619947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb382f-0bd5-47d4-8636-c73b6aeb01ea None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.620372 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb382f-0bd5-47d4-8636-c73b6aeb01ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.621295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb382f-0bd5-47d4-8636-c73b6aeb01ea None admin] RBAC: Adding query filter params (interface=public, service_id=57e37ad0dcb547a3bd5129b48659fcd0, region_id=RegionOne) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:01.621715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb382f-0bd5-47d4-8636-c73b6aeb01ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:01.623192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb382f-0bd5-47d4-8636-c73b6aeb01ea None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:01.629308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 453/906] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Mar 8 15:21:01 2022] GET /identity/v3/endpoints?service_id=57e37ad0dcb547a3bd5129b48659fcd0&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:01.630647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90d66f-839c-464a-aec5-04c0c15a8a89 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.631037 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90d66f-839c-464a-aec5-04c0c15a8a89 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.631399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90d66f-839c-464a-aec5-04c0c15a8a89 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.633303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 454/907] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:01.635480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90d66f-839c-464a-aec5-04c0c15a8a89 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:01.708405 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103c6b2-a936-42e7-9057-f92aad19621e None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:01.737073 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90d66f-839c-464a-aec5-04c0c15a8a89 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:01.741386 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18aef9-367f-4ac6-9523-a41b080d6bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:01.742306 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18aef9-367f-4ac6-9523-a41b080d6bae None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.742594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18aef9-367f-4ac6-9523-a41b080d6bae None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.742864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18aef9-367f-4ac6-9523-a41b080d6bae None admin] PATH_INFO: `/v3/endpoints` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.743642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18aef9-367f-4ac6-9523-a41b080d6bae None admin] RBAC: Adding query filter params (interface=public, service_id=c85be912c14b4f178b606c3d9441de7c, region_id=RegionOne) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:01.743951 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18aef9-367f-4ac6-9523-a41b080d6bae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:01.745350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18aef9-367f-4ac6-9523-a41b080d6bae None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:01.750275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 454/908] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Mar 8 15:21:01 2022] GET /identity/v3/endpoints?service_id=c85be912c14b4f178b606c3d9441de7c&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:01.751998 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fd090-53db-4836-934d-a6aac0bcf2b4 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.752321 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fd090-53db-4836-934d-a6aac0bcf2b4 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.752602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fd090-53db-4836-934d-a6aac0bcf2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.769007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-592fd090-53db-4836-934d-a6aac0bcf2b4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:01.770194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-592fd090-53db-4836-934d-a6aac0bcf2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:01.775963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb134e-4eba-4639-ae58-9279f8484a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:01.776660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb134e-4eba-4639-ae58-9279f8484a61 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.776947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb134e-4eba-4639-ae58-9279f8484a61 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.777230 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb134e-4eba-4639-ae58-9279f8484a61 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.777910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb134e-4eba-4639-ae58-9279f8484a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:01.779273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb134e-4eba-4639-ae58-9279f8484a61 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:01.784814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 455/909] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Mar 8 15:21:01 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:21:01.791453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb134e-4eba-4639-ae58-9279f8484a61 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:01.864255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 455/910] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:01.886956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fd090-53db-4836-934d-a6aac0bcf2b4 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:01.911789 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb134e-4eba-4639-ae58-9279f8484a61 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:01.949317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad457ca-873c-46f5-9cf7-dc9e33f3322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:01.950404 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad457ca-873c-46f5-9cf7-dc9e33f3322b None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.950906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad457ca-873c-46f5-9cf7-dc9e33f3322b None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.951385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad457ca-873c-46f5-9cf7-dc9e33f3322b None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.952336 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad457ca-873c-46f5-9cf7-dc9e33f3322b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:01.953950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad457ca-873c-46f5-9cf7-dc9e33f3322b None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:01.961351 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 456/911] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Mar 8 15:21:01 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:21:01.962919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d2546-3e69-4539-84a8-15ada2bc8528 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.963371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d2546-3e69-4539-84a8-15ada2bc8528 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.963860 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d2546-3e69-4539-84a8-15ada2bc8528 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.966156 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 457/912] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:01.972353 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dcf74-4036-48f3-a88e-df9ffb70105c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:01.972902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dcf74-4036-48f3-a88e-df9ffb70105c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:01.973177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dcf74-4036-48f3-a88e-df9ffb70105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:01.992484 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-029dcf74-4036-48f3-a88e-df9ffb70105c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:01.994051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-029dcf74-4036-48f3-a88e-df9ffb70105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:01.999953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fd090-53db-4836-934d-a6aac0bcf2b4 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:02.043230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0afdb-b069-49c1-953b-8ae56f47d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:02.044256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0afdb-b069-49c1-953b-8ae56f47d8a9 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:02.044691 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0afdb-b069-49c1-953b-8ae56f47d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:02.045116 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0afdb-b069-49c1-953b-8ae56f47d8a9 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:02.046047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0afdb-b069-49c1-953b-8ae56f47d8a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:02.047632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0afdb-b069-49c1-953b-8ae56f47d8a9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:02.070890 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 458/913] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:02.093884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dcf74-4036-48f3-a88e-df9ffb70105c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:02.125188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 456/914] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:21:01 2022] POST /identity/v3/services => generated 241 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:21:02.214091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dcf74-4036-48f3-a88e-df9ffb70105c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:02.258786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846845e-c746-4577-bc5e-00d0379cbdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:02.259599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846845e-c746-4577-bc5e-00d0379cbdec None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:02.259875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846845e-c746-4577-bc5e-00d0379cbdec None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:02.260166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846845e-c746-4577-bc5e-00d0379cbdec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:02.272104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846845e-c746-4577-bc5e-00d0379cbdec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:21:02.279665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-2846845e-c746-4577-bc5e-00d0379cbdec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 15:21:02.286352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 459/915] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Mar 8 15:21:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:02.287787 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0afdb-b069-49c1-953b-8ae56f47d8a9 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:02.390801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0afdb-b069-49c1-953b-8ae56f47d8a9 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:02.423917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67a2b2-7492-46f3-b2e1-f1cef8029415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:02.424608 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67a2b2-7492-46f3-b2e1-f1cef8029415 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:02.424887 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67a2b2-7492-46f3-b2e1-f1cef8029415 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:02.425158 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67a2b2-7492-46f3-b2e1-f1cef8029415 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:02.425899 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67a2b2-7492-46f3-b2e1-f1cef8029415 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:02.426200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67a2b2-7492-46f3-b2e1-f1cef8029415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:02.427569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67a2b2-7492-46f3-b2e1-f1cef8029415 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:02.435626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 457/916] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Mar 8 15:21:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:02.441579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846845e-c746-4577-bc5e-00d0379cbdec None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:02.541640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846845e-c746-4577-bc5e-00d0379cbdec None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:02.575190 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54da25-fe75-4565-80e9-abcf76978334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:02.581411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54da25-fe75-4565-80e9-abcf76978334 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:02.581411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54da25-fe75-4565-80e9-abcf76978334 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:02.581411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54da25-fe75-4565-80e9-abcf76978334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:02.587460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54da25-fe75-4565-80e9-abcf76978334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:02.588943 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54da25-fe75-4565-80e9-abcf76978334 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:02.605147 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-6b54da25-fe75-4565-80e9-abcf76978334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:21:02.606661 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 460/917] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:02.612363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67a2b2-7492-46f3-b2e1-f1cef8029415 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:02.718464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67a2b2-7492-46f3-b2e1-f1cef8029415 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:02.752338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b686e6-7217-47af-b7c1-06caf79ce22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:02.752994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b686e6-7217-47af-b7c1-06caf79ce22d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:02.753278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b686e6-7217-47af-b7c1-06caf79ce22d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:02.753842 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b686e6-7217-47af-b7c1-06caf79ce22d None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:02.754561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b686e6-7217-47af-b7c1-06caf79ce22d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:02.754866 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b686e6-7217-47af-b7c1-06caf79ce22d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:02.756251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b686e6-7217-47af-b7c1-06caf79ce22d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:02.768945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 458/918] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:02.774192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54da25-fe75-4565-80e9-abcf76978334 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:02.874983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54da25-fe75-4565-80e9-abcf76978334 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:02.908480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132b8c5-559c-4323-9da3-b133120769a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:02.909310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132b8c5-559c-4323-9da3-b133120769a7 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:02.909590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132b8c5-559c-4323-9da3-b133120769a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:02.909867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132b8c5-559c-4323-9da3-b133120769a7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:02.917730 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132b8c5-559c-4323-9da3-b133120769a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:02.919183 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132b8c5-559c-4323-9da3-b133120769a7 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:02.933313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-e132b8c5-559c-4323-9da3-b133120769a7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 15:21:02.934780 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 461/919] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Mar 8 15:21:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:02.940773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b686e6-7217-47af-b7c1-06caf79ce22d None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:03.053982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b686e6-7217-47af-b7c1-06caf79ce22d None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:03.088043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301f515-5e95-447a-a8a1-7bf68ed8c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:03.088741 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301f515-5e95-447a-a8a1-7bf68ed8c105 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:03.089029 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301f515-5e95-447a-a8a1-7bf68ed8c105 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:03.089311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301f515-5e95-447a-a8a1-7bf68ed8c105 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:03.090150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301f515-5e95-447a-a8a1-7bf68ed8c105 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:03.090465 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301f515-5e95-447a-a8a1-7bf68ed8c105 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:03.097579 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301f515-5e95-447a-a8a1-7bf68ed8c105 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:03.116464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 459/920] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Mar 8 15:21:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:03.121717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132b8c5-559c-4323-9da3-b133120769a7 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:03.228234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132b8c5-559c-4323-9da3-b133120769a7 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:03.261853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95167167-83d2-4cd3-bcfa-468f95207b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:03.262650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95167167-83d2-4cd3-bcfa-468f95207b23 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:03.262935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95167167-83d2-4cd3-bcfa-468f95207b23 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:03.263209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95167167-83d2-4cd3-bcfa-468f95207b23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:03.274010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95167167-83d2-4cd3-bcfa-468f95207b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:03.275462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95167167-83d2-4cd3-bcfa-468f95207b23 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:03.292207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-95167167-83d2-4cd3-bcfa-468f95207b23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:21:03.293704 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 462/921] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:03.299630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301f515-5e95-447a-a8a1-7bf68ed8c105 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:03.409170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301f515-5e95-447a-a8a1-7bf68ed8c105 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:03.443355 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b40ea6-a7a9-42e6-860e-e575cf6b8e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:03.444016 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b40ea6-a7a9-42e6-860e-e575cf6b8e96 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:03.444333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b40ea6-a7a9-42e6-860e-e575cf6b8e96 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:03.444619 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b40ea6-a7a9-42e6-860e-e575cf6b8e96 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:03.445340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b40ea6-a7a9-42e6-860e-e575cf6b8e96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:03.445651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b40ea6-a7a9-42e6-860e-e575cf6b8e96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:03.447031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b40ea6-a7a9-42e6-860e-e575cf6b8e96 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:03.458868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 460/922] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:03.464115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95167167-83d2-4cd3-bcfa-468f95207b23 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:03.562705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95167167-83d2-4cd3-bcfa-468f95207b23 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:03.596846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35257cd-9c0c-49ac-bf41-75e677f93c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:03.597640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35257cd-9c0c-49ac-bf41-75e677f93c15 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:03.597923 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35257cd-9c0c-49ac-bf41-75e677f93c15 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:03.598203 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35257cd-9c0c-49ac-bf41-75e677f93c15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:03.605025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35257cd-9c0c-49ac-bf41-75e677f93c15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:03.606506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35257cd-9c0c-49ac-bf41-75e677f93c15 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:03.621809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-d35257cd-9c0c-49ac-bf41-75e677f93c15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:21:03.622842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 463/923] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:21:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:03.628799 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b40ea6-a7a9-42e6-860e-e575cf6b8e96 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:03.731780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b40ea6-a7a9-42e6-860e-e575cf6b8e96 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:03.766067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2d2ef-6377-4354-b87f-5344ea27a5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:03.767283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2d2ef-6377-4354-b87f-5344ea27a5f1 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:03.767571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2d2ef-6377-4354-b87f-5344ea27a5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:03.767851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2d2ef-6377-4354-b87f-5344ea27a5f1 None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:03.768671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2d2ef-6377-4354-b87f-5344ea27a5f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:03.768985 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2d2ef-6377-4354-b87f-5344ea27a5f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:03.770439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2d2ef-6377-4354-b87f-5344ea27a5f1 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:03.783930 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 461/924] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:21:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:03.789475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35257cd-9c0c-49ac-bf41-75e677f93c15 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:03.887328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35257cd-9c0c-49ac-bf41-75e677f93c15 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:03.923876 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fc67f-7217-4d11-b2ed-33b408e83623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:03.924888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fc67f-7217-4d11-b2ed-33b408e83623 None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:03.925166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fc67f-7217-4d11-b2ed-33b408e83623 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:03.925441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fc67f-7217-4d11-b2ed-33b408e83623 None admin] PATH_INFO: `/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/21f49c3c297e4a2b89260910c90bc21d/roles/da838bc59061451a83ba92732ebec16f` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:03.927807 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fc67f-7217-4d11-b2ed-33b408e83623 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdaa0405e224334ac42dc4cde1c01c5, user_id=21f49c3c297e4a2b89260910c90bc21d, role_id=da838bc59061451a83ba92732ebec16f)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:03.929322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fc67f-7217-4d11-b2ed-33b408e83623 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:04.032552 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 464/925] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:21:03 2022] PUT /identity/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/21f49c3c297e4a2b89260910c90bc21d/roles/da838bc59061451a83ba92732ebec16f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:21:04.286710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5d367-64c7-40ae-82b9-16d1d6f237dd None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:04.287371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5d367-64c7-40ae-82b9-16d1d6f237dd None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:04.287371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5d367-64c7-40ae-82b9-16d1d6f237dd None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:04.289252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 462/926] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:04.297548 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e19a4-5475-4c67-bf32-6be792372c6f None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:04.298497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e19a4-5475-4c67-bf32-6be792372c6f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:04.298876 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e19a4-5475-4c67-bf32-6be792372c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:04.316206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f44e19a4-5475-4c67-bf32-6be792372c6f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:04.317400 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f44e19a4-5475-4c67-bf32-6be792372c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:04.388269 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 465/927] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:04.408019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38df4af-9db6-4613-bcdc-a0b2f7c314fb None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:04.408313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38df4af-9db6-4613-bcdc-a0b2f7c314fb None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:04.408598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38df4af-9db6-4613-bcdc-a0b2f7c314fb None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:04.410628 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 463/928] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:04.413915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e19a4-5475-4c67-bf32-6be792372c6f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:04.415158 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc59b74-e565-4bc3-8847-e85b7e26f31e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:04.415549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc59b74-e565-4bc3-8847-e85b7e26f31e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:04.415931 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc59b74-e565-4bc3-8847-e85b7e26f31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:04.433395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-3bc59b74-e565-4bc3-8847-e85b7e26f31e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:04.434738 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3bc59b74-e565-4bc3-8847-e85b7e26f31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:04.503304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 464/929] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:04.518697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e19a4-5475-4c67-bf32-6be792372c6f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:04.525513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc59b74-e565-4bc3-8847-e85b7e26f31e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:04.554709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3437ef-ac4d-4d45-8307-ba2d79077018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:04.555871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3437ef-ac4d-4d45-8307-ba2d79077018 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:04.556425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3437ef-ac4d-4d45-8307-ba2d79077018 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:04.556914 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3437ef-ac4d-4d45-8307-ba2d79077018 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:04.557752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3437ef-ac4d-4d45-8307-ba2d79077018 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:04.559423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3437ef-ac4d-4d45-8307-ba2d79077018 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:04.571211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-3c3437ef-ac4d-4d45-8307-ba2d79077018 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 15:21:04.573038 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 466/930] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Mar 8 15:21:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:04.579199 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3437ef-ac4d-4d45-8307-ba2d79077018 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:04.639185 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc59b74-e565-4bc3-8847-e85b7e26f31e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:04.674220 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2021-076f-4d14-aa26-7b17349b6eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:04.675275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2021-076f-4d14-aa26-7b17349b6eb4 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:04.675627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2021-076f-4d14-aa26-7b17349b6eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:04.675899 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2021-076f-4d14-aa26-7b17349b6eb4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:04.676579 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b2021-076f-4d14-aa26-7b17349b6eb4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:04.677948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b2021-076f-4d14-aa26-7b17349b6eb4 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:04.681708 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3437ef-ac4d-4d45-8307-ba2d79077018 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:04.692959 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-b76b2021-076f-4d14-aa26-7b17349b6eb4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 15:21:04.698969 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 465/931] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:21:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:04.698969 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d827a-c35f-4ef5-bd62-b250ad795257 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:04.698969 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d827a-c35f-4ef5-bd62-b250ad795257 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:04.698969 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d827a-c35f-4ef5-bd62-b250ad795257 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:04.698969 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 466/932] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:04.702583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d827a-c35f-4ef5-bd62-b250ad795257 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:04.719234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae2087-6b93-4a1b-b358-c00f3d0e0f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:04.720488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2087-6b93-4a1b-b358-c00f3d0e0f47 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:04.720777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2087-6b93-4a1b-b358-c00f3d0e0f47 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:04.721058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2087-6b93-4a1b-b358-c00f3d0e0f47 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:04.721763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae2087-6b93-4a1b-b358-c00f3d0e0f47 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:04.722072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae2087-6b93-4a1b-b358-c00f3d0e0f47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:04.723442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae2087-6b93-4a1b-b358-c00f3d0e0f47 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:04.728172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 467/933] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Mar 8 15:21:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:04.734093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d90f71-9854-4452-bf2e-4cf9ee270939 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:04.737433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d90f71-9854-4452-bf2e-4cf9ee270939 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:04.737433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d90f71-9854-4452-bf2e-4cf9ee270939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:04.758843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-77d90f71-9854-4452-bf2e-4cf9ee270939 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:04.760514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-77d90f71-9854-4452-bf2e-4cf9ee270939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:04.804320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d827a-c35f-4ef5-bd62-b250ad795257 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:04.836254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 468/934] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:04.836254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d90f71-9854-4452-bf2e-4cf9ee270939 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:04.849697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345e68f-b938-4d7b-996c-6f4f4ed12e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:04.850366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345e68f-b938-4d7b-996c-6f4f4ed12e15 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:04.850803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345e68f-b938-4d7b-996c-6f4f4ed12e15 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:04.851087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345e68f-b938-4d7b-996c-6f4f4ed12e15 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:04.852117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345e68f-b938-4d7b-996c-6f4f4ed12e15 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:04.852715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345e68f-b938-4d7b-996c-6f4f4ed12e15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:04.854556 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345e68f-b938-4d7b-996c-6f4f4ed12e15 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:04.860265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 467/935] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:21:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:04.864196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345e68f-b938-4d7b-996c-6f4f4ed12e15 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:04.923728 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d90f71-9854-4452-bf2e-4cf9ee270939 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:04.959257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4970c75-cd86-4d89-a8f5-d8772c0504df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:04.960018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4970c75-cd86-4d89-a8f5-d8772c0504df None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:04.960233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4970c75-cd86-4d89-a8f5-d8772c0504df None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:04.960493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4970c75-cd86-4d89-a8f5-d8772c0504df None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:04.960709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345e68f-b938-4d7b-996c-6f4f4ed12e15 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:04.961198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4970c75-cd86-4d89-a8f5-d8772c0504df None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:04.961507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4970c75-cd86-4d89-a8f5-d8772c0504df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:04.963763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4970c75-cd86-4d89-a8f5-d8772c0504df None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:04.975065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 469/936] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Mar 8 15:21:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:04.975065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4970c75-cd86-4d89-a8f5-d8772c0504df None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:04.993861 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463ccf1-fbfb-4d03-a46a-cfe20affb90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:04.994661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ccf1-fbfb-4d03-a46a-cfe20affb90e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:04.994948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ccf1-fbfb-4d03-a46a-cfe20affb90e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:04.995224 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ccf1-fbfb-4d03-a46a-cfe20affb90e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:04.995906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463ccf1-fbfb-4d03-a46a-cfe20affb90e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:04.997278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463ccf1-fbfb-4d03-a46a-cfe20affb90e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:05.008635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-6463ccf1-fbfb-4d03-a46a-cfe20affb90e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 15:21:05.009923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 468/937] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Mar 8 15:21:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:05.010516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463ccf1-fbfb-4d03-a46a-cfe20affb90e None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:05.077703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4970c75-cd86-4d89-a8f5-d8772c0504df None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:05.107328 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463ccf1-fbfb-4d03-a46a-cfe20affb90e None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:05.120385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca31a55-ac6e-4a7c-8a74-cf693607b9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:05.121782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca31a55-ac6e-4a7c-8a74-cf693607b9b0 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:05.122341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca31a55-ac6e-4a7c-8a74-cf693607b9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:05.122801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca31a55-ac6e-4a7c-8a74-cf693607b9b0 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:05.124098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca31a55-ac6e-4a7c-8a74-cf693607b9b0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:05.124602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca31a55-ac6e-4a7c-8a74-cf693607b9b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:05.126681 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca31a55-ac6e-4a7c-8a74-cf693607b9b0 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:05.133816 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 470/938] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Mar 8 15:21:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:05.134878 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca31a55-ac6e-4a7c-8a74-cf693607b9b0 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:05.141299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b617743-1fbe-42b5-850f-6864cd7ce3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:05.142517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b617743-1fbe-42b5-850f-6864cd7ce3d7 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:05.142801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b617743-1fbe-42b5-850f-6864cd7ce3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:05.143076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b617743-1fbe-42b5-850f-6864cd7ce3d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:05.143977 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b617743-1fbe-42b5-850f-6864cd7ce3d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:05.145541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b617743-1fbe-42b5-850f-6864cd7ce3d7 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:05.234429 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca31a55-ac6e-4a7c-8a74-cf693607b9b0 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:05.241194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 469/939] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Mar 8 15:21:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:21:05.241194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b617743-1fbe-42b5-850f-6864cd7ce3d7 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:05.279094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdb050-229f-4318-ab42-d45a8f09cc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:05.280050 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdb050-229f-4318-ab42-d45a8f09cc44 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:05.280364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdb050-229f-4318-ab42-d45a8f09cc44 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:05.280641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdb050-229f-4318-ab42-d45a8f09cc44 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:05.281522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdb050-229f-4318-ab42-d45a8f09cc44 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:05.282193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdb050-229f-4318-ab42-d45a8f09cc44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:05.284194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdb050-229f-4318-ab42-d45a8f09cc44 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:05.291367 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 471/940] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Mar 8 15:21:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:05.296690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdb050-229f-4318-ab42-d45a8f09cc44 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:05.360077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b617743-1fbe-42b5-850f-6864cd7ce3d7 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:05.397486 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb9a64-4a31-4c23-8260-e2d076b6c1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:05.398362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb9a64-4a31-4c23-8260-e2d076b6c1b9 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:05.398712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb9a64-4a31-4c23-8260-e2d076b6c1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:05.399104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb9a64-4a31-4c23-8260-e2d076b6c1b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:05.399988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb9a64-4a31-4c23-8260-e2d076b6c1b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:05.401574 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb9a64-4a31-4c23-8260-e2d076b6c1b9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:05.423547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdb050-229f-4318-ab42-d45a8f09cc44 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:05.460523 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923b3bc-5cfa-4945-9b83-98850633ddf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:05.461616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923b3bc-5cfa-4945-9b83-98850633ddf1 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:05.461616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923b3bc-5cfa-4945-9b83-98850633ddf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:05.461817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923b3bc-5cfa-4945-9b83-98850633ddf1 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:05.462505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923b3bc-5cfa-4945-9b83-98850633ddf1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:05.462813 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923b3bc-5cfa-4945-9b83-98850633ddf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:05.464211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923b3bc-5cfa-4945-9b83-98850633ddf1 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:05.469262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 472/941] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Mar 8 15:21:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:05.475051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923b3bc-5cfa-4945-9b83-98850633ddf1 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:05.488398 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 470/942] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Mar 8 15:21:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:21:05.597571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923b3bc-5cfa-4945-9b83-98850633ddf1 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:05.642828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306068fd-8209-4da8-82a8-d190ae0f19f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:05.643554 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306068fd-8209-4da8-82a8-d190ae0f19f4 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:05.643842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306068fd-8209-4da8-82a8-d190ae0f19f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:05.644189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306068fd-8209-4da8-82a8-d190ae0f19f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:05.645001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306068fd-8209-4da8-82a8-d190ae0f19f4 None admin] RBAC: Adding query filter params (interface=public, service_id=ea81cddae6e64f26bb175f01f50616f9, region_id=RegionOne) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:05.645316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306068fd-8209-4da8-82a8-d190ae0f19f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:05.646746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306068fd-8209-4da8-82a8-d190ae0f19f4 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:05.652808 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 473/943] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Mar 8 15:21:05 2022] GET /identity/v3/endpoints?service_id=ea81cddae6e64f26bb175f01f50616f9&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:05.658593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb9a64-4a31-4c23-8260-e2d076b6c1b9 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:05.762340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb9a64-4a31-4c23-8260-e2d076b6c1b9 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:05.795728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3063bdd-5ae4-4401-89a3-fa202421a23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:05.796481 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3063bdd-5ae4-4401-89a3-fa202421a23c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:05.796768 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3063bdd-5ae4-4401-89a3-fa202421a23c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:05.797060 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3063bdd-5ae4-4401-89a3-fa202421a23c None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:05.798314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3063bdd-5ae4-4401-89a3-fa202421a23c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:05.799749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3063bdd-5ae4-4401-89a3-fa202421a23c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:05.806118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 471/944] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Mar 8 15:21:05 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:21:06.399184 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d87c9a-7eba-4647-8c04-6f80785f175e None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:06.399690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d87c9a-7eba-4647-8c04-6f80785f175e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:06.399690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d87c9a-7eba-4647-8c04-6f80785f175e None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:06.401736 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 474/945] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:06.407319 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747d0d8-50a3-4c90-9441-1f67888d1b73 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:06.407732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747d0d8-50a3-4c90-9441-1f67888d1b73 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:06.407942 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747d0d8-50a3-4c90-9441-1f67888d1b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:06.425106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-1747d0d8-50a3-4c90-9441-1f67888d1b73 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:06.426281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1747d0d8-50a3-4c90-9441-1f67888d1b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:06.498356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 472/946] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:06.518459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d87c9a-7eba-4647-8c04-6f80785f175e None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:06.622017 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d87c9a-7eba-4647-8c04-6f80785f175e None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:06.658283 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5e744-1a1d-4416-abbd-5d656fb70e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:06.659041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5e744-1a1d-4416-abbd-5d656fb70e89 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:06.659326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5e744-1a1d-4416-abbd-5d656fb70e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:06.659607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5e744-1a1d-4416-abbd-5d656fb70e89 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:06.672030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5e744-1a1d-4416-abbd-5d656fb70e89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:21:06.680268 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-97a5e744-1a1d-4416-abbd-5d656fb70e89 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 15:21:06.686531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 475/947] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Mar 8 15:21:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:06.687929 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747d0d8-50a3-4c90-9441-1f67888d1b73 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:06.789567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747d0d8-50a3-4c90-9441-1f67888d1b73 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:06.822979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfb121-41a8-43d8-b051-c13192b1fb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:06.823978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb121-41a8-43d8-b051-c13192b1fb33 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:06.824475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb121-41a8-43d8-b051-c13192b1fb33 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:06.824961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb121-41a8-43d8-b051-c13192b1fb33 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:06.825889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfb121-41a8-43d8-b051-c13192b1fb33 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:06.826419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfb121-41a8-43d8-b051-c13192b1fb33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:06.827964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfb121-41a8-43d8-b051-c13192b1fb33 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:06.836451 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 473/948] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Mar 8 15:21:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:06.841923 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5e744-1a1d-4416-abbd-5d656fb70e89 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:06.944686 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5e744-1a1d-4416-abbd-5d656fb70e89 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:06.978623 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274818a-e97b-412e-95a3-b3b3d5e22a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:06.979431 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274818a-e97b-412e-95a3-b3b3d5e22a6b None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:06.979714 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274818a-e97b-412e-95a3-b3b3d5e22a6b None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:06.979990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274818a-e97b-412e-95a3-b3b3d5e22a6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:06.992968 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274818a-e97b-412e-95a3-b3b3d5e22a6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:06.994451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274818a-e97b-412e-95a3-b3b3d5e22a6b None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:07.011521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-a274818a-e97b-412e-95a3-b3b3d5e22a6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:21:07.018032 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 476/949] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:07.019376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfb121-41a8-43d8-b051-c13192b1fb33 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:07.123272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfb121-41a8-43d8-b051-c13192b1fb33 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:07.156835 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5b350-d1c6-4169-a64a-6aaf36b04422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:07.158056 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5b350-d1c6-4169-a64a-6aaf36b04422 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:07.158338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5b350-d1c6-4169-a64a-6aaf36b04422 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:07.158608 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5b350-d1c6-4169-a64a-6aaf36b04422 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:07.159318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5b350-d1c6-4169-a64a-6aaf36b04422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:07.159620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5b350-d1c6-4169-a64a-6aaf36b04422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:07.161008 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5b350-d1c6-4169-a64a-6aaf36b04422 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:07.173029 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 474/950] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:07.178488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274818a-e97b-412e-95a3-b3b3d5e22a6b None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:07.279643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274818a-e97b-412e-95a3-b3b3d5e22a6b None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:07.316547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23434fd9-8025-45d2-86ba-3c1a9bf1eb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:07.317758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434fd9-8025-45d2-86ba-3c1a9bf1eb0e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:07.318249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434fd9-8025-45d2-86ba-3c1a9bf1eb0e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:07.318731 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23434fd9-8025-45d2-86ba-3c1a9bf1eb0e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:07.327928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23434fd9-8025-45d2-86ba-3c1a9bf1eb0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:07.330323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23434fd9-8025-45d2-86ba-3c1a9bf1eb0e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:07.345764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-23434fd9-8025-45d2-86ba-3c1a9bf1eb0e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 15:21:07.352060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 477/951] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Mar 8 15:21:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:07.353631 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5b350-d1c6-4169-a64a-6aaf36b04422 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:07.452601 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5b350-d1c6-4169-a64a-6aaf36b04422 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:07.488747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556d8af-7edc-4f11-aaa8-0ca239ec0240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:07.489430 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556d8af-7edc-4f11-aaa8-0ca239ec0240 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:07.489711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556d8af-7edc-4f11-aaa8-0ca239ec0240 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:07.489986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556d8af-7edc-4f11-aaa8-0ca239ec0240 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:07.490848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556d8af-7edc-4f11-aaa8-0ca239ec0240 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:07.491156 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556d8af-7edc-4f11-aaa8-0ca239ec0240 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:07.492690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556d8af-7edc-4f11-aaa8-0ca239ec0240 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:07.514486 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 475/952] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Mar 8 15:21:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:07.520977 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23434fd9-8025-45d2-86ba-3c1a9bf1eb0e None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:07.624266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23434fd9-8025-45d2-86ba-3c1a9bf1eb0e None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:07.659884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f1bb1-2c8b-4da2-8bcc-143a9540ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:07.660979 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f1bb1-2c8b-4da2-8bcc-143a9540ca99 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:07.661476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f1bb1-2c8b-4da2-8bcc-143a9540ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:07.662007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f1bb1-2c8b-4da2-8bcc-143a9540ca99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:07.673805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487951dc-37dc-47d3-bf1c-7e3c0d8051e5 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:07.674098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487951dc-37dc-47d3-bf1c-7e3c0d8051e5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:07.674366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487951dc-37dc-47d3-bf1c-7e3c0d8051e5 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:07.676284 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 476/953] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:07.683313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdc362-e080-4aae-9661-14efdf02b936 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:07.684109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdc362-e080-4aae-9661-14efdf02b936 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:07.685077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdc362-e080-4aae-9661-14efdf02b936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:07.707689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-1cfdc362-e080-4aae-9661-14efdf02b936 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:07.709830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1cfdc362-e080-4aae-9661-14efdf02b936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:07.730271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f1bb1-2c8b-4da2-8bcc-143a9540ca99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:07.731731 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f1bb1-2c8b-4da2-8bcc-143a9540ca99 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:07.788732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 477/954] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:07.811287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdc362-e080-4aae-9661-14efdf02b936 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:07.835767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 478/955] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:21:07 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:21:07.841230 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f1bb1-2c8b-4da2-8bcc-143a9540ca99 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:07.914003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdc362-e080-4aae-9661-14efdf02b936 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:07.940928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f1bb1-2c8b-4da2-8bcc-143a9540ca99 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:07.948797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a2346-ff86-4b91-8376-dada01f08d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:07.949589 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a2346-ff86-4b91-8376-dada01f08d6f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:07.949873 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a2346-ff86-4b91-8376-dada01f08d6f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:07.950159 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a2346-ff86-4b91-8376-dada01f08d6f None admin] PATH_INFO: `/v3/services/compute` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:07.950810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a2346-ff86-4b91-8376-dada01f08d6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:07.952214 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a2346-ff86-4b91-8376-dada01f08d6f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:07.963178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-2e0a2346-ff86-4b91-8376-dada01f08d6f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 15:21:07.964723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 478/956] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:21:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:07.965922 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2a2e7-0fcc-45a1-9ebb-c2495051ad21 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:07.966207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2a2e7-0fcc-45a1-9ebb-c2495051ad21 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:07.966480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2a2e7-0fcc-45a1-9ebb-c2495051ad21 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:07.972268 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 479/957] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:07.973041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2a2e7-0fcc-45a1-9ebb-c2495051ad21 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:07.982339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88d514-27e0-46ea-9a8b-8ec9daf473ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:07.983139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88d514-27e0-46ea-9a8b-8ec9daf473ca None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:07.983422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88d514-27e0-46ea-9a8b-8ec9daf473ca None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:07.983701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88d514-27e0-46ea-9a8b-8ec9daf473ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:07.995606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88d514-27e0-46ea-9a8b-8ec9daf473ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:07.997100 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88d514-27e0-46ea-9a8b-8ec9daf473ca None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:08.020286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-ff88d514-27e0-46ea-9a8b-8ec9daf473ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:21:08.021853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 479/958] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:08.023123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabb10b-e75a-4a83-a2c2-a57808c23083 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.023412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabb10b-e75a-4a83-a2c2-a57808c23083 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.023687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabb10b-e75a-4a83-a2c2-a57808c23083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.039357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5aabb10b-e75a-4a83-a2c2-a57808c23083 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:08.040830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5aabb10b-e75a-4a83-a2c2-a57808c23083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:08.076994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2a2e7-0fcc-45a1-9ebb-c2495051ad21 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:08.108719 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 480/959] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:08.109479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabb10b-e75a-4a83-a2c2-a57808c23083 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:08.117701 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b71fc-0333-4619-9ac2-e17721d7f80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:08.119238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b71fc-0333-4619-9ac2-e17721d7f80c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.119728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b71fc-0333-4619-9ac2-e17721d7f80c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.120243 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b71fc-0333-4619-9ac2-e17721d7f80c None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.121491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b71fc-0333-4619-9ac2-e17721d7f80c None admin] RBAC: Adding query filter params (name=compute) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:08.122342 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b71fc-0333-4619-9ac2-e17721d7f80c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:08.124235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b71fc-0333-4619-9ac2-e17721d7f80c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:08.135109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 480/960] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:21:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:08.135109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b71fc-0333-4619-9ac2-e17721d7f80c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:08.217512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabb10b-e75a-4a83-a2c2-a57808c23083 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:08.230952 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b71fc-0333-4619-9ac2-e17721d7f80c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:08.262036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dacd76-b84b-48e4-926d-e923d1bd0c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:08.262763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dacd76-b84b-48e4-926d-e923d1bd0c20 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.263046 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dacd76-b84b-48e4-926d-e923d1bd0c20 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.263321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dacd76-b84b-48e4-926d-e923d1bd0c20 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.264043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dacd76-b84b-48e4-926d-e923d1bd0c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:08.264382 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dacd76-b84b-48e4-926d-e923d1bd0c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:08.265212 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3edba6-e2ad-407e-a308-561dfa17e6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:08.265766 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dacd76-b84b-48e4-926d-e923d1bd0c20 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:08.265862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3edba6-e2ad-407e-a308-561dfa17e6f5 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.266143 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3edba6-e2ad-407e-a308-561dfa17e6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.266427 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3edba6-e2ad-407e-a308-561dfa17e6f5 None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.267131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3edba6-e2ad-407e-a308-561dfa17e6f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:08.268596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3edba6-e2ad-407e-a308-561dfa17e6f5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:08.269993 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.common [None req-ff3edba6-e2ad-407e-a308-561dfa17e6f5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 08 15:21:08.277326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 481/961] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:08.278116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dacd76-b84b-48e4-926d-e923d1bd0c20 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:08.320948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.sql.core [None req-ff3edba6-e2ad-407e-a308-561dfa17e6f5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 08 15:21:08.320948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 08 15:21:08.320948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [parameters: {'id': '456d9a6884564eb0bfd232eea431b98c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 08 15:21:08.320948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79757) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 15:21:08.335706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-ff3edba6-e2ad-407e-a308-561dfa17e6f5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 456d9a6884564eb0bfd232eea431b98c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 456d9a6884564eb0bfd232eea431b98c. Mar 08 15:21:08.337077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 481/962] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Mar 8 15:21:08 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:08.338635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd592572-62e4-48ad-9434-f714479cfb42 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.338923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd592572-62e4-48ad-9434-f714479cfb42 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.339202 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd592572-62e4-48ad-9434-f714479cfb42 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.343882 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 482/963] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:08.345030 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd592572-62e4-48ad-9434-f714479cfb42 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:08.375799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dacd76-b84b-48e4-926d-e923d1bd0c20 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:08.407827 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba2d65-a392-4339-93a7-02f36251cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:08.408517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba2d65-a392-4339-93a7-02f36251cca0 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.408810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba2d65-a392-4339-93a7-02f36251cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.409079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba2d65-a392-4339-93a7-02f36251cca0 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.409773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba2d65-a392-4339-93a7-02f36251cca0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:08.410078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba2d65-a392-4339-93a7-02f36251cca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:08.411471 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba2d65-a392-4339-93a7-02f36251cca0 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:08.415657 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 482/964] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:21:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:08.416454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba2d65-a392-4339-93a7-02f36251cca0 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:08.449004 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd592572-62e4-48ad-9434-f714479cfb42 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:08.486092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442eb4da-fdb2-4a1b-9709-97ae73bc00af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:08.486838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eb4da-fdb2-4a1b-9709-97ae73bc00af None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.487122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eb4da-fdb2-4a1b-9709-97ae73bc00af None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.487398 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eb4da-fdb2-4a1b-9709-97ae73bc00af None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.494901 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442eb4da-fdb2-4a1b-9709-97ae73bc00af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:08.496572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442eb4da-fdb2-4a1b-9709-97ae73bc00af None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:08.512357 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-442eb4da-fdb2-4a1b-9709-97ae73bc00af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:21:08.519105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 483/965] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:21:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:08.520395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f851a-2deb-4479-947a-1cb7c2d0099e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.520689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f851a-2deb-4479-947a-1cb7c2d0099e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.520967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f851a-2deb-4479-947a-1cb7c2d0099e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.522737 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba2d65-a392-4339-93a7-02f36251cca0 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:08.538551 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-a09f851a-2deb-4479-947a-1cb7c2d0099e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:08.540198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a09f851a-2deb-4479-947a-1cb7c2d0099e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:08.557841 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac44bb1-c2e2-4bbe-8e1b-46c4f2318bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:08.558637 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac44bb1-c2e2-4bbe-8e1b-46c4f2318bf1 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.558917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac44bb1-c2e2-4bbe-8e1b-46c4f2318bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.559186 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac44bb1-c2e2-4bbe-8e1b-46c4f2318bf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.566540 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac44bb1-c2e2-4bbe-8e1b-46c4f2318bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:08.568009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac44bb1-c2e2-4bbe-8e1b-46c4f2318bf1 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:08.582408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-7ac44bb1-c2e2-4bbe-8e1b-46c4f2318bf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:21:08.588611 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 483/966] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:21:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:08.588611 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac44bb1-c2e2-4bbe-8e1b-46c4f2318bf1 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:08.611366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 484/967] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:08.612662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f851a-2deb-4479-947a-1cb7c2d0099e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:08.691238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac44bb1-c2e2-4bbe-8e1b-46c4f2318bf1 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:08.717300 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f851a-2deb-4479-947a-1cb7c2d0099e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:08.727985 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f264acb-eba4-4025-9f0b-9e501fb38ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:08.728939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f264acb-eba4-4025-9f0b-9e501fb38ce9 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.729366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f264acb-eba4-4025-9f0b-9e501fb38ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.729815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f264acb-eba4-4025-9f0b-9e501fb38ce9 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.730747 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f264acb-eba4-4025-9f0b-9e501fb38ce9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:08.731204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f264acb-eba4-4025-9f0b-9e501fb38ce9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:08.732817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f264acb-eba4-4025-9f0b-9e501fb38ce9 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:08.745330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 484/968] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:21:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:08.745906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f264acb-eba4-4025-9f0b-9e501fb38ce9 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:08.755748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6b47e-ca2c-490f-9988-21fe04fd5cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:08.756444 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6b47e-ca2c-490f-9988-21fe04fd5cde None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.756729 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6b47e-ca2c-490f-9988-21fe04fd5cde None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.757008 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6b47e-ca2c-490f-9988-21fe04fd5cde None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.757765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6b47e-ca2c-490f-9988-21fe04fd5cde None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:08.758074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6b47e-ca2c-490f-9988-21fe04fd5cde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:08.759526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6b47e-ca2c-490f-9988-21fe04fd5cde None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:08.777152 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 485/969] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:21:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:08.778212 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6b47e-ca2c-490f-9988-21fe04fd5cde None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:08.850026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f264acb-eba4-4025-9f0b-9e501fb38ce9 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:08.890512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c533fd-cf2a-4add-956f-d3fe58dc8151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:08.891974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c533fd-cf2a-4add-956f-d3fe58dc8151 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.892297 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c533fd-cf2a-4add-956f-d3fe58dc8151 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.892572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c533fd-cf2a-4add-956f-d3fe58dc8151 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.893240 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c533fd-cf2a-4add-956f-d3fe58dc8151 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:08.894712 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c533fd-cf2a-4add-956f-d3fe58dc8151 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:08.906476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-40c533fd-cf2a-4add-956f-d3fe58dc8151 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 15:21:08.907945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 485/970] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Mar 8 15:21:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:08.911886 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6b47e-ca2c-490f-9988-21fe04fd5cde None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:08.913847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c533fd-cf2a-4add-956f-d3fe58dc8151 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:08.958675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa404f-380b-44c9-8a7f-6e14693384ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:08.959649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa404f-380b-44c9-8a7f-6e14693384ae None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:08.960105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa404f-380b-44c9-8a7f-6e14693384ae None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:08.960580 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa404f-380b-44c9-8a7f-6e14693384ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:08.962159 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa404f-380b-44c9-8a7f-6e14693384ae None admin] RBAC: Adding query filter params (role.id=da838bc59061451a83ba92732ebec16f, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=21f49c3c297e4a2b89260910c90bc21d) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:08.962672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa404f-380b-44c9-8a7f-6e14693384ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:08.965516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa404f-380b-44c9-8a7f-6e14693384ae None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:08.974237 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 486/971] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:21:08 2022] GET /identity/v3/role_assignments?user.id=21f49c3c297e4a2b89260910c90bc21d&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=da838bc59061451a83ba92732ebec16f => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:09.037740 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c533fd-cf2a-4add-956f-d3fe58dc8151 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:09.076375 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38fba-0fb8-470a-80d6-0bfe78e4e6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:09.077165 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38fba-0fb8-470a-80d6-0bfe78e4e6c7 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:09.077454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38fba-0fb8-470a-80d6-0bfe78e4e6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:09.077736 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38fba-0fb8-470a-80d6-0bfe78e4e6c7 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:09.078454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38fba-0fb8-470a-80d6-0bfe78e4e6c7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:09.079312 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38fba-0fb8-470a-80d6-0bfe78e4e6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:09.080759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38fba-0fb8-470a-80d6-0bfe78e4e6c7 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:09.086181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 486/972] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Mar 8 15:21:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:09.092384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa404f-380b-44c9-8a7f-6e14693384ae None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:09.209450 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa404f-380b-44c9-8a7f-6e14693384ae None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:09.244723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c6345-ab42-4e82-87e4-dab776d6ecef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:09.245455 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c6345-ab42-4e82-87e4-dab776d6ecef None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:09.245742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c6345-ab42-4e82-87e4-dab776d6ecef None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:09.246026 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c6345-ab42-4e82-87e4-dab776d6ecef None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:09.246742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c6345-ab42-4e82-87e4-dab776d6ecef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:09.247055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c6345-ab42-4e82-87e4-dab776d6ecef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:09.248472 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c6345-ab42-4e82-87e4-dab776d6ecef None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:09.254606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 487/973] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Mar 8 15:21:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:09.259837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38fba-0fb8-470a-80d6-0bfe78e4e6c7 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:09.361053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38fba-0fb8-470a-80d6-0bfe78e4e6c7 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:09.394778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f33083-03e3-421b-ab7a-b5060f6ac676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:09.395692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33083-03e3-421b-ab7a-b5060f6ac676 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:09.395983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33083-03e3-421b-ab7a-b5060f6ac676 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:09.396284 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33083-03e3-421b-ab7a-b5060f6ac676 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:09.397010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33083-03e3-421b-ab7a-b5060f6ac676 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:09.398510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33083-03e3-421b-ab7a-b5060f6ac676 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:09.488566 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 487/974] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Mar 8 15:21:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:21:10.793983 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d63162-aad4-4881-8780-0bb363726ad5 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:10.794985 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d63162-aad4-4881-8780-0bb363726ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:10.795484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d63162-aad4-4881-8780-0bb363726ad5 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:10.797944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 488/975] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:10.803607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae59ea-6f48-4daf-bee4-0e3e890b8772 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:10.804492 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae59ea-6f48-4daf-bee4-0e3e890b8772 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:10.804997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae59ea-6f48-4daf-bee4-0e3e890b8772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:10.822148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f5ae59ea-6f48-4daf-bee4-0e3e890b8772 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:10.823650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f5ae59ea-6f48-4daf-bee4-0e3e890b8772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:10.897648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 488/976] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:10.921457 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d63162-aad4-4881-8780-0bb363726ad5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:11.026075 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d63162-aad4-4881-8780-0bb363726ad5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:11.064943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcf5ad-a61d-4f9f-940e-e72b0b3ad7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:11.065529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcf5ad-a61d-4f9f-940e-e72b0b3ad7a5 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:11.065811 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcf5ad-a61d-4f9f-940e-e72b0b3ad7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:11.066089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcf5ad-a61d-4f9f-940e-e72b0b3ad7a5 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:11.066826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcf5ad-a61d-4f9f-940e-e72b0b3ad7a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:11.068222 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcf5ad-a61d-4f9f-940e-e72b0b3ad7a5 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:11.180024 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 489/977] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:21:10 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:21:11.284421 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8463b3-0b6a-4e5b-8846-5ae6cee447e7 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:11.284742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8463b3-0b6a-4e5b-8846-5ae6cee447e7 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:11.284992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8463b3-0b6a-4e5b-8846-5ae6cee447e7 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:11.287103 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 489/978] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:11.292949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c5587-3b77-4958-9fca-2e14bedef7f8 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:11.293236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c5587-3b77-4958-9fca-2e14bedef7f8 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:11.293514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c5587-3b77-4958-9fca-2e14bedef7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:11.316211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-531c5587-3b77-4958-9fca-2e14bedef7f8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:11.317380 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-531c5587-3b77-4958-9fca-2e14bedef7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:11.383934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2f19a-5a77-4685-ac4f-9a10e07a93b2 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:11.384274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2f19a-5a77-4685-ac4f-9a10e07a93b2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:11.384524 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2f19a-5a77-4685-ac4f-9a10e07a93b2 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:11.386269 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 490/979] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:11.392837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac71da-d15b-4dc8-81ec-b42328015cb8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:11.393247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac71da-d15b-4dc8-81ec-b42328015cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:11.393602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac71da-d15b-4dc8-81ec-b42328015cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:11.400995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 490/980] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:11.412473 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-4aac71da-d15b-4dc8-81ec-b42328015cb8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:11.413747 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4aac71da-d15b-4dc8-81ec-b42328015cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:11.425679 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c5587-3b77-4958-9fca-2e14bedef7f8 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:11.494451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 491/981] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:11.518904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac71da-d15b-4dc8-81ec-b42328015cb8 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:11.548762 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c5587-3b77-4958-9fca-2e14bedef7f8 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:11.595675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd2d20-09dc-4d61-b04e-7f607021534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:11.596621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd2d20-09dc-4d61-b04e-7f607021534f None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:11.596913 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd2d20-09dc-4d61-b04e-7f607021534f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:11.597460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd2d20-09dc-4d61-b04e-7f607021534f None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:11.598197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd2d20-09dc-4d61-b04e-7f607021534f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:11.599831 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd2d20-09dc-4d61-b04e-7f607021534f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:11.621291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac71da-d15b-4dc8-81ec-b42328015cb8 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:11.652674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.sql.core [None req-5ffd2d20-09dc-4d61-b04e-7f607021534f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 08 15:21:11.652674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 08 15:21:11.652674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [parameters: {'user_id': '740620f735c94f84b107d558c5ba7427', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 08 15:21:11.652674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79757) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 15:21:11.658927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c1782-e328-4f95-970f-94be79cfb34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:11.659718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c1782-e328-4f95-970f-94be79cfb34c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:11.660055 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c1782-e328-4f95-970f-94be79cfb34c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:11.660364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c1782-e328-4f95-970f-94be79cfb34c None admin] PATH_INFO: `/v3/services/image` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:11.660625 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-5ffd2d20-09dc-4d61-b04e-7f607021534f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 08 15:21:11.661019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c1782-e328-4f95-970f-94be79cfb34c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:11.662505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c1782-e328-4f95-970f-94be79cfb34c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:11.667044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 491/982] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Mar 8 15:21:11 2022] POST /identity/v3/users => generated 160 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:11.669298 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd2d20-09dc-4d61-b04e-7f607021534f None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:11.678231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-bd8c1782-e328-4f95-970f-94be79cfb34c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 15:21:11.684620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 492/983] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Mar 8 15:21:11 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:11.685545 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c1782-e328-4f95-970f-94be79cfb34c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:11.788273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c1782-e328-4f95-970f-94be79cfb34c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:11.800506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd2d20-09dc-4d61-b04e-7f607021534f None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:11.824091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2339aba-ab2d-4af0-b15f-b70a70970056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:11.824786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2339aba-ab2d-4af0-b15f-b70a70970056 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:11.825073 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2339aba-ab2d-4af0-b15f-b70a70970056 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:11.828022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2339aba-ab2d-4af0-b15f-b70a70970056 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:11.828022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2339aba-ab2d-4af0-b15f-b70a70970056 None admin] RBAC: Adding query filter params (name=image) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:11.828022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2339aba-ab2d-4af0-b15f-b70a70970056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:11.828022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2339aba-ab2d-4af0-b15f-b70a70970056 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:11.832822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 493/984] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:11.834182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419dfe6-1a67-4310-b2f7-0de5726c45da None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:11.834472 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419dfe6-1a67-4310-b2f7-0de5726c45da None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:11.834750 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419dfe6-1a67-4310-b2f7-0de5726c45da None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:11.836159 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af31b6-c3f4-4d01-8d70-fe589d759dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:11.836788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 494/985] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:11.837097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af31b6-c3f4-4d01-8d70-fe589d759dac None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:11.837389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af31b6-c3f4-4d01-8d70-fe589d759dac None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:11.837723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af31b6-c3f4-4d01-8d70-fe589d759dac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:11.841321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8941b-6ebb-484c-9c86-9b867def60a8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:11.841834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8941b-6ebb-484c-9c86-9b867def60a8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:11.842112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8941b-6ebb-484c-9c86-9b867def60a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:11.846682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af31b6-c3f4-4d01-8d70-fe589d759dac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:11.849092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af31b6-c3f4-4d01-8d70-fe589d759dac None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:11.859055 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-e8c8941b-6ebb-484c-9c86-9b867def60a8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:11.861057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e8c8941b-6ebb-484c-9c86-9b867def60a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:11.862895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-42af31b6-c3f4-4d01-8d70-fe589d759dac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 15:21:11.864195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 492/986] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:21:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:11.864865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af31b6-c3f4-4d01-8d70-fe589d759dac None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:11.931741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 495/987] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:11.943705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8941b-6ebb-484c-9c86-9b867def60a8 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:11.973058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af31b6-c3f4-4d01-8d70-fe589d759dac None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:12.012172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682544b-446e-4fd2-8c14-d739eadfe5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:12.012863 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682544b-446e-4fd2-8c14-d739eadfe5f9 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:12.013145 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682544b-446e-4fd2-8c14-d739eadfe5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:12.013421 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682544b-446e-4fd2-8c14-d739eadfe5f9 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:12.014127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682544b-446e-4fd2-8c14-d739eadfe5f9 None admin] RBAC: Adding query filter params (type=image) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:12.014431 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682544b-446e-4fd2-8c14-d739eadfe5f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:12.015800 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682544b-446e-4fd2-8c14-d739eadfe5f9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:12.032174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 493/988] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:12.032174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682544b-446e-4fd2-8c14-d739eadfe5f9 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:12.055931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8941b-6ebb-484c-9c86-9b867def60a8 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:12.105688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e85c8-e5d7-4415-80e4-f16a1bf13345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:12.106475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e85c8-e5d7-4415-80e4-f16a1bf13345 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:12.107649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e85c8-e5d7-4415-80e4-f16a1bf13345 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:12.107934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e85c8-e5d7-4415-80e4-f16a1bf13345 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:12.108797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e85c8-e5d7-4415-80e4-f16a1bf13345 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:12.109182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e85c8-e5d7-4415-80e4-f16a1bf13345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:12.111447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e85c8-e5d7-4415-80e4-f16a1bf13345 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:12.145851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682544b-446e-4fd2-8c14-d739eadfe5f9 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:12.165242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 496/989] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Mar 8 15:21:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:12.189666 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9cca5-7741-4c30-9700-25ab970eaa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:12.190896 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9cca5-7741-4c30-9700-25ab970eaa67 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:12.191410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9cca5-7741-4c30-9700-25ab970eaa67 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:12.191902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9cca5-7741-4c30-9700-25ab970eaa67 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:12.192851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9cca5-7741-4c30-9700-25ab970eaa67 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:12.194560 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9cca5-7741-4c30-9700-25ab970eaa67 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:12.207292 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-74b9cca5-7741-4c30-9700-25ab970eaa67 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 15:21:12.209401 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 494/990] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Mar 8 15:21:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:12.215861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e85c8-e5d7-4415-80e4-f16a1bf13345 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:12.330767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e85c8-e5d7-4415-80e4-f16a1bf13345 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:12.374342 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a63714-d332-4e97-bb53-d23fb483aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:12.375371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a63714-d332-4e97-bb53-d23fb483aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:12.375902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a63714-d332-4e97-bb53-d23fb483aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:12.376397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a63714-d332-4e97-bb53-d23fb483aaf4 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:12.377303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a63714-d332-4e97-bb53-d23fb483aaf4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:12.377843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a63714-d332-4e97-bb53-d23fb483aaf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:12.379438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a63714-d332-4e97-bb53-d23fb483aaf4 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:12.385324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 497/991] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Mar 8 15:21:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:12.391928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9cca5-7741-4c30-9700-25ab970eaa67 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:12.497488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9cca5-7741-4c30-9700-25ab970eaa67 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:12.529689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005e423-f4b6-4b22-888e-f49c2e700c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:12.530697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e423-f4b6-4b22-888e-f49c2e700c5c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:12.531176 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e423-f4b6-4b22-888e-f49c2e700c5c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:12.532246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e423-f4b6-4b22-888e-f49c2e700c5c None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:12.533145 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005e423-f4b6-4b22-888e-f49c2e700c5c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:12.533656 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005e423-f4b6-4b22-888e-f49c2e700c5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:12.535344 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005e423-f4b6-4b22-888e-f49c2e700c5c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:12.540528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 495/992] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Mar 8 15:21:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:12.545931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a63714-d332-4e97-bb53-d23fb483aaf4 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:12.638893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a63714-d332-4e97-bb53-d23fb483aaf4 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:12.683011 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77a8c4-349f-4a66-9302-ba38d7ffdf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:12.683668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77a8c4-349f-4a66-9302-ba38d7ffdf18 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:12.683951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77a8c4-349f-4a66-9302-ba38d7ffdf18 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:12.684265 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77a8c4-349f-4a66-9302-ba38d7ffdf18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:12.685059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77a8c4-349f-4a66-9302-ba38d7ffdf18 None admin] RBAC: Adding query filter params (interface=admin, service_id=ea81cddae6e64f26bb175f01f50616f9, region_id=RegionOne) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:12.685383 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77a8c4-349f-4a66-9302-ba38d7ffdf18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:12.686755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77a8c4-349f-4a66-9302-ba38d7ffdf18 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:12.692386 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 498/993] 10.222.0.25 () {56 vars in 1249 bytes} [Tue Mar 8 15:21:12 2022] GET /identity/v3/endpoints?service_id=ea81cddae6e64f26bb175f01f50616f9&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:12.697679 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005e423-f4b6-4b22-888e-f49c2e700c5c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:12.798032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005e423-f4b6-4b22-888e-f49c2e700c5c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:12.830613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f40b00-d627-4139-aec1-08b4c99bec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:12.831346 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40b00-d627-4139-aec1-08b4c99bec83 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:12.831562 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40b00-d627-4139-aec1-08b4c99bec83 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:12.831832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40b00-d627-4139-aec1-08b4c99bec83 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:12.832555 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f40b00-d627-4139-aec1-08b4c99bec83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:12.833953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f40b00-d627-4139-aec1-08b4c99bec83 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:12.840311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 496/994] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Mar 8 15:21:12 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:21:13.574400 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce248-db10-4eb3-9aa8-488548275436 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:13.574886 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce248-db10-4eb3-9aa8-488548275436 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:13.574886 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce248-db10-4eb3-9aa8-488548275436 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:13.576810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 499/995] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:13.581907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d49e99-aff5-40ac-9bd4-7704b2692795 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:13.582201 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d49e99-aff5-40ac-9bd4-7704b2692795 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:13.582478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d49e99-aff5-40ac-9bd4-7704b2692795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:13.599584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-37d49e99-aff5-40ac-9bd4-7704b2692795 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:13.601116 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-37d49e99-aff5-40ac-9bd4-7704b2692795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:13.671975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 497/996] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:13.694824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce248-db10-4eb3-9aa8-488548275436 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:13.792391 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce248-db10-4eb3-9aa8-488548275436 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:13.823920 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344e922-c1fb-439f-892a-a440a1097874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:13.824782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344e922-c1fb-439f-892a-a440a1097874 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:13.825015 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344e922-c1fb-439f-892a-a440a1097874 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:13.825286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344e922-c1fb-439f-892a-a440a1097874 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:13.825926 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344e922-c1fb-439f-892a-a440a1097874 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:13.827302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344e922-c1fb-439f-892a-a440a1097874 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:13.838362 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-f344e922-c1fb-439f-892a-a440a1097874 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 15:21:13.839694 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 500/997] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:21:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:13.846033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d49e99-aff5-40ac-9bd4-7704b2692795 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:13.939566 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d49e99-aff5-40ac-9bd4-7704b2692795 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:13.974141 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0ca5-2528-42bc-b6b2-f33ce50186ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:13.974813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0ca5-2528-42bc-b6b2-f33ce50186ea None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:13.975096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0ca5-2528-42bc-b6b2-f33ce50186ea None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:13.975371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0ca5-2528-42bc-b6b2-f33ce50186ea None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:13.976084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0ca5-2528-42bc-b6b2-f33ce50186ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:13.976436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0ca5-2528-42bc-b6b2-f33ce50186ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:13.977829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0ca5-2528-42bc-b6b2-f33ce50186ea None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:13.987493 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 498/998] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:21:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:13.988705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344e922-c1fb-439f-892a-a440a1097874 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:14.098340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344e922-c1fb-439f-892a-a440a1097874 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:14.130740 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770fbea-b92b-4312-81f7-978ff27daf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:14.131401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770fbea-b92b-4312-81f7-978ff27daf7b None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:14.131687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770fbea-b92b-4312-81f7-978ff27daf7b None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:14.131966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770fbea-b92b-4312-81f7-978ff27daf7b None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:14.132697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770fbea-b92b-4312-81f7-978ff27daf7b None admin] RBAC: Adding query filter params (type=compute) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:14.133008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770fbea-b92b-4312-81f7-978ff27daf7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:14.134372 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770fbea-b92b-4312-81f7-978ff27daf7b None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:14.148509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 501/999] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:21:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:14.150030 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0ca5-2528-42bc-b6b2-f33ce50186ea None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:14.244559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0ca5-2528-42bc-b6b2-f33ce50186ea None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:14.278359 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fb731-11db-4a97-9120-82c8183e9ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:14.279349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fb731-11db-4a97-9120-82c8183e9ba6 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:14.279815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fb731-11db-4a97-9120-82c8183e9ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:14.280347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fb731-11db-4a97-9120-82c8183e9ba6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:14.281329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fb731-11db-4a97-9120-82c8183e9ba6 None admin] RBAC: Adding query filter params (interface=public, service_id=050e8968335c42ee84afa5aaa2dc277d, region_id=RegionOne) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:14.281851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fb731-11db-4a97-9120-82c8183e9ba6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:14.283405 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fb731-11db-4a97-9120-82c8183e9ba6 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:14.288984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 499/1000] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Mar 8 15:21:14 2022] GET /identity/v3/endpoints?service_id=050e8968335c42ee84afa5aaa2dc277d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:14.295312 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770fbea-b92b-4312-81f7-978ff27daf7b None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:14.394150 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770fbea-b92b-4312-81f7-978ff27daf7b None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:14.398845 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3471c-ac32-4e2e-8670-eafed228145e None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:14.399143 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3471c-ac32-4e2e-8670-eafed228145e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:14.399424 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3471c-ac32-4e2e-8670-eafed228145e None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:14.401389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 500/1001] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:21:14.406086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d376e0-dada-4a79-8f41-8bd6a5a6a59f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:14.406376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d376e0-dada-4a79-8f41-8bd6a5a6a59f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:14.406696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d376e0-dada-4a79-8f41-8bd6a5a6a59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:14.423221 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-c1d376e0-dada-4a79-8f41-8bd6a5a6a59f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:14.424430 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c1d376e0-dada-4a79-8f41-8bd6a5a6a59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:14.426920 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c040d2-9c8f-4ae9-bac8-e765b683f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:14.427582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c040d2-9c8f-4ae9-bac8-e765b683f805 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:14.427860 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c040d2-9c8f-4ae9-bac8-e765b683f805 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:14.428134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c040d2-9c8f-4ae9-bac8-e765b683f805 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:14.428842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c040d2-9c8f-4ae9-bac8-e765b683f805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:14.430193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c040d2-9c8f-4ae9-bac8-e765b683f805 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:14.444464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 502/1002] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Mar 8 15:21:14 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:21:14.495393 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 501/1003] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:14.518598 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c040d2-9c8f-4ae9-bac8-e765b683f805 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:14.623873 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c040d2-9c8f-4ae9-bac8-e765b683f805 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:14.654428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b0a8c-46bd-484b-a6d8-748d43aa3486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:14.655018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b0a8c-46bd-484b-a6d8-748d43aa3486 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:14.655300 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b0a8c-46bd-484b-a6d8-748d43aa3486 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:14.655575 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b0a8c-46bd-484b-a6d8-748d43aa3486 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:14.656331 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b0a8c-46bd-484b-a6d8-748d43aa3486 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:14.658261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b0a8c-46bd-484b-a6d8-748d43aa3486 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:14.773971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 503/1004] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:21:14 2022] POST /identity/v3/services => generated 242 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:21:15.189730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3181ca6-3ff4-41a5-90b4-e74d67f58b8a None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:15.190237 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3181ca6-3ff4-41a5-90b4-e74d67f58b8a None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:15.190345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3181ca6-3ff4-41a5-90b4-e74d67f58b8a None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:15.192251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 502/1005] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:15.197329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a186866-3c02-44b7-a67e-283b59308c51 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:15.197627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a186866-3c02-44b7-a67e-283b59308c51 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:15.197909 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a186866-3c02-44b7-a67e-283b59308c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:15.214948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5a186866-3c02-44b7-a67e-283b59308c51 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:15.216157 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5a186866-3c02-44b7-a67e-283b59308c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:15.286074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 504/1006] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:15 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:15.309245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3181ca6-3ff4-41a5-90b4-e74d67f58b8a None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:15.405786 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3181ca6-3ff4-41a5-90b4-e74d67f58b8a None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:15.439092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a483ba-8ddb-4692-90c2-db33deeec0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:15.439895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a483ba-8ddb-4692-90c2-db33deeec0d7 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:15.440204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a483ba-8ddb-4692-90c2-db33deeec0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:15.440537 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a483ba-8ddb-4692-90c2-db33deeec0d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:15.441197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a483ba-8ddb-4692-90c2-db33deeec0d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:15.442633 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a483ba-8ddb-4692-90c2-db33deeec0d7 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:15.454167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-d1a483ba-8ddb-4692-90c2-db33deeec0d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 15:21:15.455495 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 503/1007] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Mar 8 15:21:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:15.461289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a186866-3c02-44b7-a67e-283b59308c51 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:15.555561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a186866-3c02-44b7-a67e-283b59308c51 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:15.590892 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc090-e61b-467c-b2bd-02845c7eb710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:15.591562 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc090-e61b-467c-b2bd-02845c7eb710 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:15.591852 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc090-e61b-467c-b2bd-02845c7eb710 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:15.592134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbc090-e61b-467c-b2bd-02845c7eb710 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:15.592877 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbc090-e61b-467c-b2bd-02845c7eb710 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:15.593188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbc090-e61b-467c-b2bd-02845c7eb710 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:15.595135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbc090-e61b-467c-b2bd-02845c7eb710 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:15.600425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 505/1008] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Mar 8 15:21:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:15.605965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a483ba-8ddb-4692-90c2-db33deeec0d7 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:15.713525 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a483ba-8ddb-4692-90c2-db33deeec0d7 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:15.745033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c3c4e-1ab4-41de-8702-16c205c5659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:15.745693 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c3c4e-1ab4-41de-8702-16c205c5659c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:15.745977 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c3c4e-1ab4-41de-8702-16c205c5659c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:15.746259 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c3c4e-1ab4-41de-8702-16c205c5659c None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:15.746961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c3c4e-1ab4-41de-8702-16c205c5659c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:15.747271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c3c4e-1ab4-41de-8702-16c205c5659c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:15.748748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c3c4e-1ab4-41de-8702-16c205c5659c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:15.758583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 504/1009] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Mar 8 15:21:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:15.759769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc090-e61b-467c-b2bd-02845c7eb710 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:15.853599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbc090-e61b-467c-b2bd-02845c7eb710 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:15.885478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fe343-88c6-4cc4-8cea-d509fb038f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:15.886127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fe343-88c6-4cc4-8cea-d509fb038f2e None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:15.886407 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fe343-88c6-4cc4-8cea-d509fb038f2e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:15.886679 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fe343-88c6-4cc4-8cea-d509fb038f2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:15.887405 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fe343-88c6-4cc4-8cea-d509fb038f2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:15.888793 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fe343-88c6-4cc4-8cea-d509fb038f2e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:15.961890 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 506/1010] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Mar 8 15:21:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:21:16.757748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f717b67-6d31-4685-86c7-b46d910db403 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:16.758305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f717b67-6d31-4685-86c7-b46d910db403 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:16.758305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f717b67-6d31-4685-86c7-b46d910db403 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:16.760083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 505/1011] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:16.766135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e399cf4-91de-4b89-bc8c-417923c368f8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:16.766557 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e399cf4-91de-4b89-bc8c-417923c368f8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:16.766676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e399cf4-91de-4b89-bc8c-417923c368f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:16.783898 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-8e399cf4-91de-4b89-bc8c-417923c368f8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:16.785139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8e399cf4-91de-4b89-bc8c-417923c368f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:16.855006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 507/1012] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:16 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:16.877273 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f717b67-6d31-4685-86c7-b46d910db403 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:16.973939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f717b67-6d31-4685-86c7-b46d910db403 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:17.005783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f6925-8088-46d1-89e1-57d76413f454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:17.006571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6925-8088-46d1-89e1-57d76413f454 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:17.006851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6925-8088-46d1-89e1-57d76413f454 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:17.007123 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6925-8088-46d1-89e1-57d76413f454 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:17.007819 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6925-8088-46d1-89e1-57d76413f454 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:17.009155 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6925-8088-46d1-89e1-57d76413f454 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:17.020292 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-220f6925-8088-46d1-89e1-57d76413f454 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 15:21:17.021642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 506/1013] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:21:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:17.027354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e399cf4-91de-4b89-bc8c-417923c368f8 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:17.073813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2de17-9e07-4682-abc0-2b58a3dfba7c None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:17.074093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2de17-9e07-4682-abc0-2b58a3dfba7c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:17.074524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2de17-9e07-4682-abc0-2b58a3dfba7c None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:17.076482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 507/1014] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:21:17.081970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da591c5-f08e-4574-8530-8e30258a947e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:17.082258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da591c5-f08e-4574-8530-8e30258a947e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:17.082537 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da591c5-f08e-4574-8530-8e30258a947e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:17.104006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7da591c5-f08e-4574-8530-8e30258a947e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:17.105248 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7da591c5-f08e-4574-8530-8e30258a947e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:17.125500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e399cf4-91de-4b89-bc8c-417923c368f8 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:17.160695 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ca820-e1e5-41d5-bc4e-11acc858ee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:17.161362 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca820-e1e5-41d5-bc4e-11acc858ee4a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:17.161651 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca820-e1e5-41d5-bc4e-11acc858ee4a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:17.161931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca820-e1e5-41d5-bc4e-11acc858ee4a None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:17.162632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ca820-e1e5-41d5-bc4e-11acc858ee4a None admin] RBAC: Adding query filter params (name=compute) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:17.162941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ca820-e1e5-41d5-bc4e-11acc858ee4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:17.164398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ca820-e1e5-41d5-bc4e-11acc858ee4a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:17.169355 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 508/1015] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:21:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:17.174751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ca820-e1e5-41d5-bc4e-11acc858ee4a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:17.180358 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 508/1016] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:17 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:17.203702 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da591c5-f08e-4574-8530-8e30258a947e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:17.270459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ca820-e1e5-41d5-bc4e-11acc858ee4a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:17.297713 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da591c5-f08e-4574-8530-8e30258a947e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:17.303494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7a44-23b3-4a11-ae31-e203641825d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:17.304171 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7a44-23b3-4a11-ae31-e203641825d4 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:17.304461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7a44-23b3-4a11-ae31-e203641825d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:17.304740 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb7a44-23b3-4a11-ae31-e203641825d4 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:17.305442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb7a44-23b3-4a11-ae31-e203641825d4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:17.305751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb7a44-23b3-4a11-ae31-e203641825d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:17.307121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb7a44-23b3-4a11-ae31-e203641825d4 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:17.311870 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 509/1017] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Mar 8 15:21:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:17.318184 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7a44-23b3-4a11-ae31-e203641825d4 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:17.333208 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90742857-0c41-469a-bb82-8122d05e027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:17.333999 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90742857-0c41-469a-bb82-8122d05e027f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:17.334283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90742857-0c41-469a-bb82-8122d05e027f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:17.334561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90742857-0c41-469a-bb82-8122d05e027f None admin] PATH_INFO: `/v3/services/image` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:17.335210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90742857-0c41-469a-bb82-8122d05e027f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:17.336598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90742857-0c41-469a-bb82-8122d05e027f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:17.347103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-90742857-0c41-469a-bb82-8122d05e027f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 15:21:17.351965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 509/1018] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Mar 8 15:21:17 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:17.354547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90742857-0c41-469a-bb82-8122d05e027f None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:17.420411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb7a44-23b3-4a11-ae31-e203641825d4 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:17.449622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90742857-0c41-469a-bb82-8122d05e027f None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:17.453786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5e956-7b9b-457f-ba76-e3efec7bf0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:17.454439 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5e956-7b9b-457f-ba76-e3efec7bf0ff None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:17.454724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5e956-7b9b-457f-ba76-e3efec7bf0ff None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:17.454999 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5e956-7b9b-457f-ba76-e3efec7bf0ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:17.455729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5e956-7b9b-457f-ba76-e3efec7bf0ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:17.457126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5e956-7b9b-457f-ba76-e3efec7bf0ff None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:17.482169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589855c-66e5-41dd-81b2-6e1a72f5f750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:17.485642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589855c-66e5-41dd-81b2-6e1a72f5f750 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:17.485642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589855c-66e5-41dd-81b2-6e1a72f5f750 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:17.485642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589855c-66e5-41dd-81b2-6e1a72f5f750 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:17.485642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589855c-66e5-41dd-81b2-6e1a72f5f750 None admin] RBAC: Adding query filter params (name=image) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:17.485642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589855c-66e5-41dd-81b2-6e1a72f5f750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:17.486525 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589855c-66e5-41dd-81b2-6e1a72f5f750 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:17.491389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 510/1019] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:17.497037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589855c-66e5-41dd-81b2-6e1a72f5f750 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:17.584625 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 510/1020] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Mar 8 15:21:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:21:17.596273 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589855c-66e5-41dd-81b2-6e1a72f5f750 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:17.642843 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03271725-b18d-4c76-add3-1f2a1942da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:17.643575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03271725-b18d-4c76-add3-1f2a1942da44 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:17.643919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03271725-b18d-4c76-add3-1f2a1942da44 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:17.644225 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03271725-b18d-4c76-add3-1f2a1942da44 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:17.644940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03271725-b18d-4c76-add3-1f2a1942da44 None admin] RBAC: Adding query filter params (type=image) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:17.645268 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03271725-b18d-4c76-add3-1f2a1942da44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:17.646668 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03271725-b18d-4c76-add3-1f2a1942da44 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:17.657153 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 511/1021] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:17.658187 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5e956-7b9b-457f-ba76-e3efec7bf0ff None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:17.762241 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5e956-7b9b-457f-ba76-e3efec7bf0ff None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:17.796124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4a5cc-30d5-4eb2-b22e-735b52f321ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:17.797424 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4a5cc-30d5-4eb2-b22e-735b52f321ca None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:17.797631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4a5cc-30d5-4eb2-b22e-735b52f321ca None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:17.797905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4a5cc-30d5-4eb2-b22e-735b52f321ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:17.799041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4a5cc-30d5-4eb2-b22e-735b52f321ca None admin] RBAC: Adding query filter params (interface=public, service_id=560bd5c1ad81456387d2ea3bfa860342, region_id=RegionOne) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:17.799041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4a5cc-30d5-4eb2-b22e-735b52f321ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:17.800427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4a5cc-30d5-4eb2-b22e-735b52f321ca None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:17.806116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 511/1022] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Mar 8 15:21:17 2022] GET /identity/v3/endpoints?service_id=560bd5c1ad81456387d2ea3bfa860342&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:17.811831 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03271725-b18d-4c76-add3-1f2a1942da44 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:17.913402 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03271725-b18d-4c76-add3-1f2a1942da44 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:17.948840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052ffba-7831-4991-9b85-d48f0c5e7f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:17.949517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052ffba-7831-4991-9b85-d48f0c5e7f8b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:17.949803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052ffba-7831-4991-9b85-d48f0c5e7f8b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:17.950082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052ffba-7831-4991-9b85-d48f0c5e7f8b None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:17.950770 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052ffba-7831-4991-9b85-d48f0c5e7f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:17.952174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052ffba-7831-4991-9b85-d48f0c5e7f8b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:17.959160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 512/1023] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Mar 8 15:21:17 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:21:18.287296 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd80146-6045-49f3-9efc-c0d102de2280 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:18.287613 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd80146-6045-49f3-9efc-c0d102de2280 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:18.287784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd80146-6045-49f3-9efc-c0d102de2280 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:18.289712 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 512/1024] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:18.294719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94404-60dd-4d5b-8583-15653149d850 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:18.295086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94404-60dd-4d5b-8583-15653149d850 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:18.295437 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94404-60dd-4d5b-8583-15653149d850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:18.311975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-20d94404-60dd-4d5b-8583-15653149d850 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:18.315301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-20d94404-60dd-4d5b-8583-15653149d850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:18.412191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 513/1025] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:18.431804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd80146-6045-49f3-9efc-c0d102de2280 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:18.529088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd80146-6045-49f3-9efc-c0d102de2280 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:18.560010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36c970-fba7-4d1b-a20c-d9a3062b35a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:18.560751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36c970-fba7-4d1b-a20c-d9a3062b35a1 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:18.561031 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36c970-fba7-4d1b-a20c-d9a3062b35a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:18.561297 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36c970-fba7-4d1b-a20c-d9a3062b35a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:18.562504 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36c970-fba7-4d1b-a20c-d9a3062b35a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:18.563914 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36c970-fba7-4d1b-a20c-d9a3062b35a1 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:18.565668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 513/1026] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:18.571135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d94404-60dd-4d5b-8583-15653149d850 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:18.665231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d94404-60dd-4d5b-8583-15653149d850 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:18.697169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a9cf1-f808-461a-b31a-ac132734021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:18.697821 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9cf1-f808-461a-b31a-ac132734021c None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:18.698100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9cf1-f808-461a-b31a-ac132734021c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:18.698369 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9cf1-f808-461a-b31a-ac132734021c None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:18.699076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a9cf1-f808-461a-b31a-ac132734021c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:18.700521 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a9cf1-f808-461a-b31a-ac132734021c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:18.775563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 514/1027] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:21:18 2022] POST /identity/v3/projects => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:21:20.012710 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5db5b-fdb1-4886-82c2-139d33c5fef2 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.013227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5db5b-fdb1-4886-82c2-139d33c5fef2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.013303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5db5b-fdb1-4886-82c2-139d33c5fef2 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.015016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 514/1028] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:20.020893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc5f6a-db83-4b8a-9c64-e63353594c1c None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.021648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc5f6a-db83-4b8a-9c64-e63353594c1c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.022075 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc5f6a-db83-4b8a-9c64-e63353594c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.039584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-92cc5f6a-db83-4b8a-9c64-e63353594c1c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:20.040985 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-92cc5f6a-db83-4b8a-9c64-e63353594c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:20.108535 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 515/1029] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:20.131877 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5db5b-fdb1-4886-82c2-139d33c5fef2 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:20.229455 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5db5b-fdb1-4886-82c2-139d33c5fef2 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:20.261327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8d042-2d3e-4daf-8703-8f23b13756e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:20.262135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8d042-2d3e-4daf-8703-8f23b13756e8 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.262418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8d042-2d3e-4daf-8703-8f23b13756e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.262688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8d042-2d3e-4daf-8703-8f23b13756e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.270279 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada702c1-2e7a-4929-8547-f92d8e3d2691 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.270522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada702c1-2e7a-4929-8547-f92d8e3d2691 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.270794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada702c1-2e7a-4929-8547-f92d8e3d2691 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.273083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 516/1030] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:20.277089 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8d042-2d3e-4daf-8703-8f23b13756e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:21:20.277673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a253f8-ed63-44c9-b46a-306332462b36 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.277960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a253f8-ed63-44c9-b46a-306332462b36 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.278236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a253f8-ed63-44c9-b46a-306332462b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.284425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-fbb8d042-2d3e-4daf-8703-8f23b13756e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 15:21:20.285616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 515/1031] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Mar 8 15:21:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:20.291320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8d042-2d3e-4daf-8703-8f23b13756e8 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:20.295366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-34a253f8-ed63-44c9-b46a-306332462b36 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:20.296561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-34a253f8-ed63-44c9-b46a-306332462b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:20.366763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 517/1032] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:20.389559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a253f8-ed63-44c9-b46a-306332462b36 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:20.397984 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8d042-2d3e-4daf-8703-8f23b13756e8 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:20.430324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53971a-4cac-4135-8ac2-fb34a400040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:20.430991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53971a-4cac-4135-8ac2-fb34a400040c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.431282 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53971a-4cac-4135-8ac2-fb34a400040c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.431562 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53971a-4cac-4135-8ac2-fb34a400040c None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.432334 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53971a-4cac-4135-8ac2-fb34a400040c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:20.432646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53971a-4cac-4135-8ac2-fb34a400040c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:20.434003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53971a-4cac-4135-8ac2-fb34a400040c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:20.442406 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 516/1033] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Mar 8 15:21:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:20.447764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53971a-4cac-4135-8ac2-fb34a400040c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:20.491261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a253f8-ed63-44c9-b46a-306332462b36 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:20.525211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f296afa-03c9-4750-8bb9-5d6764b0749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:20.525927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f296afa-03c9-4750-8bb9-5d6764b0749d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.526240 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f296afa-03c9-4750-8bb9-5d6764b0749d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.526491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f296afa-03c9-4750-8bb9-5d6764b0749d None admin] PATH_INFO: `/v3/services/image` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.527148 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f296afa-03c9-4750-8bb9-5d6764b0749d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:20.528635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f296afa-03c9-4750-8bb9-5d6764b0749d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:20.539505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-0f296afa-03c9-4750-8bb9-5d6764b0749d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 15:21:20.540700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 518/1034] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Mar 8 15:21:20 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:20.546399 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f296afa-03c9-4750-8bb9-5d6764b0749d None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:20.551398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53971a-4cac-4135-8ac2-fb34a400040c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:20.584171 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6aab2-2e70-4a1d-bd8b-0f8e2f8d1919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:20.590714 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6aab2-2e70-4a1d-bd8b-0f8e2f8d1919 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.590714 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6aab2-2e70-4a1d-bd8b-0f8e2f8d1919 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.590714 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6aab2-2e70-4a1d-bd8b-0f8e2f8d1919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.595842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6aab2-2e70-4a1d-bd8b-0f8e2f8d1919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:20.597458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6aab2-2e70-4a1d-bd8b-0f8e2f8d1919 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:20.614454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-9bb6aab2-2e70-4a1d-bd8b-0f8e2f8d1919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:21:20.616052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 517/1035] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:20.621364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6aab2-2e70-4a1d-bd8b-0f8e2f8d1919 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:20.645717 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f296afa-03c9-4750-8bb9-5d6764b0749d None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:20.681947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f91b38-e3ff-4c94-9e70-8585df733f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:20.682991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f91b38-e3ff-4c94-9e70-8585df733f6d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.683277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f91b38-e3ff-4c94-9e70-8585df733f6d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.683554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f91b38-e3ff-4c94-9e70-8585df733f6d None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.684291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f91b38-e3ff-4c94-9e70-8585df733f6d None admin] RBAC: Adding query filter params (name=image) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:20.684602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f91b38-e3ff-4c94-9e70-8585df733f6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:20.685979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f91b38-e3ff-4c94-9e70-8585df733f6d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:20.691644 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 519/1036] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:20.696860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f91b38-e3ff-4c94-9e70-8585df733f6d None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:20.719650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6aab2-2e70-4a1d-bd8b-0f8e2f8d1919 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:20.759328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba392f-a9d4-4167-8a11-ef140e9cf830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:20.760016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba392f-a9d4-4167-8a11-ef140e9cf830 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.760337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba392f-a9d4-4167-8a11-ef140e9cf830 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.760618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba392f-a9d4-4167-8a11-ef140e9cf830 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.761362 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba392f-a9d4-4167-8a11-ef140e9cf830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:20.761673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba392f-a9d4-4167-8a11-ef140e9cf830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:20.763103 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba392f-a9d4-4167-8a11-ef140e9cf830 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:20.777302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 518/1037] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:20.782676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba392f-a9d4-4167-8a11-ef140e9cf830 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:20.809233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f91b38-e3ff-4c94-9e70-8585df733f6d None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:20.842570 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7731dc-0f58-42e4-acce-8045a3c48dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:20.843227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7731dc-0f58-42e4-acce-8045a3c48dc7 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.844050 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7731dc-0f58-42e4-acce-8045a3c48dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.844362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7731dc-0f58-42e4-acce-8045a3c48dc7 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.845065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7731dc-0f58-42e4-acce-8045a3c48dc7 None admin] RBAC: Adding query filter params (type=image) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:20.845371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7731dc-0f58-42e4-acce-8045a3c48dc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:20.846729 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7731dc-0f58-42e4-acce-8045a3c48dc7 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:20.856050 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 520/1038] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:20.857015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7731dc-0f58-42e4-acce-8045a3c48dc7 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:20.878824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba392f-a9d4-4167-8a11-ef140e9cf830 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:20.914803 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d8d12-22df-4156-a1db-d22886750e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:20.915669 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d8d12-22df-4156-a1db-d22886750e96 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.915950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d8d12-22df-4156-a1db-d22886750e96 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.916249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d8d12-22df-4156-a1db-d22886750e96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.924208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d8d12-22df-4156-a1db-d22886750e96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:20.925661 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d8d12-22df-4156-a1db-d22886750e96 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:20.939043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-525d8d12-22df-4156-a1db-d22886750e96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 15:21:20.940416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 519/1039] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Mar 8 15:21:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:20.945777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d8d12-22df-4156-a1db-d22886750e96 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:20.956914 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7731dc-0f58-42e4-acce-8045a3c48dc7 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:20.990575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441999d-064e-41af-ac75-8e90ab00d963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:20.991229 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441999d-064e-41af-ac75-8e90ab00d963 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:20.991512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441999d-064e-41af-ac75-8e90ab00d963 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:20.991790 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441999d-064e-41af-ac75-8e90ab00d963 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:20.992563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441999d-064e-41af-ac75-8e90ab00d963 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:20.993926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441999d-064e-41af-ac75-8e90ab00d963 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:21.041365 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d8d12-22df-4156-a1db-d22886750e96 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:21.063419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 521/1040] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Mar 8 15:21:20 2022] POST /identity/v3/endpoints => generated 327 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:21:21.081275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76cf59-8b9e-48e2-917c-9addae11e55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:21.082031 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76cf59-8b9e-48e2-917c-9addae11e55e None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:21.082314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76cf59-8b9e-48e2-917c-9addae11e55e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:21.082595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76cf59-8b9e-48e2-917c-9addae11e55e None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:21.083467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76cf59-8b9e-48e2-917c-9addae11e55e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:21.083761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76cf59-8b9e-48e2-917c-9addae11e55e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:21.085323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76cf59-8b9e-48e2-917c-9addae11e55e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:21.111156 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 520/1041] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Mar 8 15:21:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:21.112732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441999d-064e-41af-ac75-8e90ab00d963 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:21.127566 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c0dec-b421-485c-a4aa-ce2734ae0550 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:21.127914 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c0dec-b421-485c-a4aa-ce2734ae0550 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:21.128241 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c0dec-b421-485c-a4aa-ce2734ae0550 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:21.130389 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 521/1042] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:21:21.136061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43697422-13cd-4870-b807-4d8205bbd47c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:21.136384 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43697422-13cd-4870-b807-4d8205bbd47c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:21.136650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43697422-13cd-4870-b807-4d8205bbd47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:21.155397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-43697422-13cd-4870-b807-4d8205bbd47c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:21.157208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-43697422-13cd-4870-b807-4d8205bbd47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:21.221955 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441999d-064e-41af-ac75-8e90ab00d963 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:21.225708 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 522/1043] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:21.251083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43697422-13cd-4870-b807-4d8205bbd47c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:21.262296 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ff115-0f1c-45e7-aaa2-5922642b8f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:21.262944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ff115-0f1c-45e7-aaa2-5922642b8f4b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:21.263231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ff115-0f1c-45e7-aaa2-5922642b8f4b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:21.263501 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ff115-0f1c-45e7-aaa2-5922642b8f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:21.329892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ff115-0f1c-45e7-aaa2-5922642b8f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:21.331262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ff115-0f1c-45e7-aaa2-5922642b8f4b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:21.351764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43697422-13cd-4870-b807-4d8205bbd47c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:21.383986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fb5c1-5bd6-4377-930b-d44864f3f0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:21.384814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb5c1-5bd6-4377-930b-d44864f3f0a0 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:21.385097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb5c1-5bd6-4377-930b-d44864f3f0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:21.385371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb5c1-5bd6-4377-930b-d44864f3f0a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:21.386632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fb5c1-5bd6-4377-930b-d44864f3f0a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:21.388045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fb5c1-5bd6-4377-930b-d44864f3f0a0 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:21.389598 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 523/1044] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:21.395506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fb5c1-5bd6-4377-930b-d44864f3f0a0 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:21.431673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 522/1045] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:21:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:21:21.437158 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ff115-0f1c-45e7-aaa2-5922642b8f4b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:21.490718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fb5c1-5bd6-4377-930b-d44864f3f0a0 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:21.524210 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d4a9f-e0c7-4da5-960c-ee41cd1ea0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:21.524867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d4a9f-e0c7-4da5-960c-ee41cd1ea0fe None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:21.525145 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d4a9f-e0c7-4da5-960c-ee41cd1ea0fe None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:21.525418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d4a9f-e0c7-4da5-960c-ee41cd1ea0fe None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:21.526116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d4a9f-e0c7-4da5-960c-ee41cd1ea0fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:21.527539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d4a9f-e0c7-4da5-960c-ee41cd1ea0fe None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:21.538610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ff115-0f1c-45e7-aaa2-5922642b8f4b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:21.571158 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae6e3-a899-467c-8e53-e49ac4f57329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:21.599572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae6e3-a899-467c-8e53-e49ac4f57329 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:21.599572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae6e3-a899-467c-8e53-e49ac4f57329 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:21.599572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ae6e3-a899-467c-8e53-e49ac4f57329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:21.599572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae6e3-a899-467c-8e53-e49ac4f57329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:21.599572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ae6e3-a899-467c-8e53-e49ac4f57329 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:21.600741 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-f38ae6e3-a899-467c-8e53-e49ac4f57329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:21:21.601879 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 523/1046] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:21.607208 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae6e3-a899-467c-8e53-e49ac4f57329 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:21.668176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 524/1047] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:21:21 2022] POST /identity/v3/users => generated 285 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:21:21.706272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ae6e3-a899-467c-8e53-e49ac4f57329 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:21.743524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d77f3a-31b5-4a6e-820a-ee1841018046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:21.744258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d77f3a-31b5-4a6e-820a-ee1841018046 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:21.744548 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d77f3a-31b5-4a6e-820a-ee1841018046 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:21.744822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d77f3a-31b5-4a6e-820a-ee1841018046 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:21.745553 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d77f3a-31b5-4a6e-820a-ee1841018046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:21.745858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d77f3a-31b5-4a6e-820a-ee1841018046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:21.747259 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d77f3a-31b5-4a6e-820a-ee1841018046 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:21.760602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 524/1048] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:21.766537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d4a9f-e0c7-4da5-960c-ee41cd1ea0fe None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:21.867243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d4a9f-e0c7-4da5-960c-ee41cd1ea0fe None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:21.900989 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072ee51-d242-470e-aa66-80b4441cceef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:21.902166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072ee51-d242-470e-aa66-80b4441cceef None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:21.902448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072ee51-d242-470e-aa66-80b4441cceef None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:21.902720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072ee51-d242-470e-aa66-80b4441cceef None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:21.911085 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072ee51-d242-470e-aa66-80b4441cceef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:21.912646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072ee51-d242-470e-aa66-80b4441cceef None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:21.926308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-4072ee51-d242-470e-aa66-80b4441cceef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:21:21.927659 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 525/1049] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:21:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:21.933383 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d77f3a-31b5-4a6e-820a-ee1841018046 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:22.029083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d77f3a-31b5-4a6e-820a-ee1841018046 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:22.060894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dc876-4aa3-4ec7-9ccf-137c33789738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:22.061872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc876-4aa3-4ec7-9ccf-137c33789738 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:22.063008 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc876-4aa3-4ec7-9ccf-137c33789738 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:22.063478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc876-4aa3-4ec7-9ccf-137c33789738 None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:22.064946 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dc876-4aa3-4ec7-9ccf-137c33789738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:22.065468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dc876-4aa3-4ec7-9ccf-137c33789738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:22.067096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dc876-4aa3-4ec7-9ccf-137c33789738 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:22.079404 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 525/1050] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:21:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:22.085292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072ee51-d242-470e-aa66-80b4441cceef None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:22.181085 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072ee51-d242-470e-aa66-80b4441cceef None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:22.212923 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d8f2d-cc79-4c0e-a7fb-aab5e9c8e405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:22.213587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8f2d-cc79-4c0e-a7fb-aab5e9c8e405 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:22.213867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8f2d-cc79-4c0e-a7fb-aab5e9c8e405 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:22.214136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d8f2d-cc79-4c0e-a7fb-aab5e9c8e405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:22.214974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d8f2d-cc79-4c0e-a7fb-aab5e9c8e405 None admin] RBAC: Adding query filter params (role.id=da838bc59061451a83ba92732ebec16f, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=c4fb404cc61d49d3aaec429f4f9f4f94) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:22.215283 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d8f2d-cc79-4c0e-a7fb-aab5e9c8e405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:22.216786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d8f2d-cc79-4c0e-a7fb-aab5e9c8e405 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:22.223122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 526/1051] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:21:22 2022] GET /identity/v3/role_assignments?user.id=c4fb404cc61d49d3aaec429f4f9f4f94&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=da838bc59061451a83ba92732ebec16f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:23.404967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e0ddd-b51d-484d-9f6a-731ed44517b1 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:23.405506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e0ddd-b51d-484d-9f6a-731ed44517b1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:23.405822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e0ddd-b51d-484d-9f6a-731ed44517b1 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:23.408757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 526/1052] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:23.414870 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fbdc2-3206-4ca3-a717-6a0315fba990 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:23.415306 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fbdc2-3206-4ca3-a717-6a0315fba990 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:23.415583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fbdc2-3206-4ca3-a717-6a0315fba990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:23.432293 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c47fbdc2-3206-4ca3-a717-6a0315fba990 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:23.433488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c47fbdc2-3206-4ca3-a717-6a0315fba990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:23.497043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 527/1053] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:23.519337 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e0ddd-b51d-484d-9f6a-731ed44517b1 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:23.615212 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e0ddd-b51d-484d-9f6a-731ed44517b1 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:23.648049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84283efa-bea0-4fa9-8ccd-993360178752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:23.648694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84283efa-bea0-4fa9-8ccd-993360178752 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:23.648980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84283efa-bea0-4fa9-8ccd-993360178752 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:23.649257 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84283efa-bea0-4fa9-8ccd-993360178752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:23.719993 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84283efa-bea0-4fa9-8ccd-993360178752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:23.721490 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84283efa-bea0-4fa9-8ccd-993360178752 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:23.819638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 527/1054] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:21:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:21:23.821692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fbdc2-3206-4ca3-a717-6a0315fba990 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:23.915441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fbdc2-3206-4ca3-a717-6a0315fba990 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:23.947900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a254c6e-63d7-413d-b91b-4d0d3c1f1bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:23.948717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a254c6e-63d7-413d-b91b-4d0d3c1f1bb3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:23.949001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a254c6e-63d7-413d-b91b-4d0d3c1f1bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:23.949278 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a254c6e-63d7-413d-b91b-4d0d3c1f1bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:23.958922 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a254c6e-63d7-413d-b91b-4d0d3c1f1bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:23.960408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a254c6e-63d7-413d-b91b-4d0d3c1f1bb3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:23.977146 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-2a254c6e-63d7-413d-b91b-4d0d3c1f1bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:21:23.978426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 528/1055] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:23.985177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84283efa-bea0-4fa9-8ccd-993360178752 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:24.021663 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab89d9-d4d3-44ae-8e88-2235932b1664 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:24.021972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab89d9-d4d3-44ae-8e88-2235932b1664 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:24.022220 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab89d9-d4d3-44ae-8e88-2235932b1664 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:24.024102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 529/1056] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:21:24.028861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c942de-c727-40c2-a6aa-9830ae270608 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:24.029149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c942de-c727-40c2-a6aa-9830ae270608 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:24.029428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c942de-c727-40c2-a6aa-9830ae270608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:24.045977 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-76c942de-c727-40c2-a6aa-9830ae270608 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:24.047728 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-76c942de-c727-40c2-a6aa-9830ae270608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:24.080027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84283efa-bea0-4fa9-8ccd-993360178752 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:24.116655 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa70ae-ce8a-40fe-a153-5f27598e9208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:24.117611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa70ae-ce8a-40fe-a153-5f27598e9208 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:24.117895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa70ae-ce8a-40fe-a153-5f27598e9208 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:24.118174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa70ae-ce8a-40fe-a153-5f27598e9208 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:24.118894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa70ae-ce8a-40fe-a153-5f27598e9208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:24.119284 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa70ae-ce8a-40fe-a153-5f27598e9208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:24.120693 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa70ae-ce8a-40fe-a153-5f27598e9208 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:24.128509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 530/1057] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:24.136200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 528/1058] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:24.143324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c942de-c727-40c2-a6aa-9830ae270608 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:24.250423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c942de-c727-40c2-a6aa-9830ae270608 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:24.286490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ae5d3-a794-4051-b1e7-7af247f623e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:24.287297 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ae5d3-a794-4051-b1e7-7af247f623e0 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:24.287580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ae5d3-a794-4051-b1e7-7af247f623e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:24.287856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ae5d3-a794-4051-b1e7-7af247f623e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:24.298872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ae5d3-a794-4051-b1e7-7af247f623e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:21:24.305915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-325ae5d3-a794-4051-b1e7-7af247f623e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:21:24.313587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 531/1059] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:21:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:24.313743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa70ae-ce8a-40fe-a153-5f27598e9208 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:24.420891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa70ae-ce8a-40fe-a153-5f27598e9208 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:24.454186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd39f0-a7b0-456b-8e9c-1ab58131382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:24.454864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd39f0-a7b0-456b-8e9c-1ab58131382d None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:24.455150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd39f0-a7b0-456b-8e9c-1ab58131382d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:24.455429 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd39f0-a7b0-456b-8e9c-1ab58131382d None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:24.456195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd39f0-a7b0-456b-8e9c-1ab58131382d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:24.456511 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd39f0-a7b0-456b-8e9c-1ab58131382d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:24.457885 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd39f0-a7b0-456b-8e9c-1ab58131382d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:24.465937 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 529/1060] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:21:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:24.472367 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ae5d3-a794-4051-b1e7-7af247f623e0 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:24.503194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2202d-2cf6-429f-ada8-0a5ceffccb55 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:24.503420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2202d-2cf6-429f-ada8-0a5ceffccb55 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:24.503698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2202d-2cf6-429f-ada8-0a5ceffccb55 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:24.505488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 530/1061] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:21:24.510164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47ab9e-385c-43a3-a968-559ff738d05c None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:24.510462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47ab9e-385c-43a3-a968-559ff738d05c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:24.510745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47ab9e-385c-43a3-a968-559ff738d05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:24.527354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7f47ab9e-385c-43a3-a968-559ff738d05c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:24.528800 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7f47ab9e-385c-43a3-a968-559ff738d05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:24.566527 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ae5d3-a794-4051-b1e7-7af247f623e0 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:24.592345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 531/1062] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:24.598649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319b56b-e2ec-417f-8d8f-3dfad77002ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:24.599511 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319b56b-e2ec-417f-8d8f-3dfad77002ac None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:24.599796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319b56b-e2ec-417f-8d8f-3dfad77002ac None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:24.600071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319b56b-e2ec-417f-8d8f-3dfad77002ac None admin] PATH_INFO: `/v3/users/90af55ec70a7495ca8ebc56bea1942db` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:24.613032 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319b56b-e2ec-417f-8d8f-3dfad77002ac None admin] RBAC: Authorizing `identity:get_user(user_id=90af55ec70a7495ca8ebc56bea1942db)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:24.614484 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319b56b-e2ec-417f-8d8f-3dfad77002ac None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:24.620712 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 532/1063] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:21:24 2022] GET /identity/v3/users/90af55ec70a7495ca8ebc56bea1942db => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:24.620839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47ab9e-385c-43a3-a968-559ff738d05c None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:24.621670 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319b56b-e2ec-417f-8d8f-3dfad77002ac None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:24.712247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47ab9e-385c-43a3-a968-559ff738d05c None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:24.718338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319b56b-e2ec-417f-8d8f-3dfad77002ac None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:24.744718 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40336610-46bb-47db-81db-711bd32f3639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:24.745530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40336610-46bb-47db-81db-711bd32f3639 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:24.745813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40336610-46bb-47db-81db-711bd32f3639 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:24.746089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40336610-46bb-47db-81db-711bd32f3639 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:24.752340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb998f-4b69-44a9-839a-72950cca960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:24.752986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb998f-4b69-44a9-839a-72950cca960f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:24.753323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb998f-4b69-44a9-839a-72950cca960f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:24.753554 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb998f-4b69-44a9-839a-72950cca960f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:24.756401 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40336610-46bb-47db-81db-711bd32f3639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:21:24.763724 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-40336610-46bb-47db-81db-711bd32f3639 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 15:21:24.764927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 532/1064] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Mar 8 15:21:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:24.771368 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40336610-46bb-47db-81db-711bd32f3639 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:24.818492 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb998f-4b69-44a9-839a-72950cca960f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:24.819945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb998f-4b69-44a9-839a-72950cca960f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:24.867774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40336610-46bb-47db-81db-711bd32f3639 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:24.899277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13020c-b940-477f-8ab8-425746c97fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:24.899926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13020c-b940-477f-8ab8-425746c97fce None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:24.900232 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13020c-b940-477f-8ab8-425746c97fce None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:24.900510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13020c-b940-477f-8ab8-425746c97fce None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:24.901243 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13020c-b940-477f-8ab8-425746c97fce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:24.901546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13020c-b940-477f-8ab8-425746c97fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:24.902896 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13020c-b940-477f-8ab8-425746c97fce None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:24.910393 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 533/1065] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Mar 8 15:21:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:24.912402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 533/1066] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:21:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:21:24.915930 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13020c-b940-477f-8ab8-425746c97fce None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:24.917817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb998f-4b69-44a9-839a-72950cca960f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:25.009688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb998f-4b69-44a9-839a-72950cca960f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:25.010063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13020c-b940-477f-8ab8-425746c97fce None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:25.040589 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b47da-2da7-47f6-b5ba-f97a97735e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:25.041178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa50c4-ddc3-434d-940e-9f1c48a0150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:25.041363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b47da-2da7-47f6-b5ba-f97a97735e0b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:25.041642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b47da-2da7-47f6-b5ba-f97a97735e0b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:25.041914 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b47da-2da7-47f6-b5ba-f97a97735e0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:25.042014 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa50c4-ddc3-434d-940e-9f1c48a0150a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:25.042276 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa50c4-ddc3-434d-940e-9f1c48a0150a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:25.042549 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa50c4-ddc3-434d-940e-9f1c48a0150a None admin] PATH_INFO: `/v3/projects/e8c81b1aae634ac9a24f9ecd30956749` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:25.043699 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa50c4-ddc3-434d-940e-9f1c48a0150a None admin] RBAC: Authorizing `identity:get_project(project_id=e8c81b1aae634ac9a24f9ecd30956749)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:25.045147 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa50c4-ddc3-434d-940e-9f1c48a0150a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:25.047461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 534/1067] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:21:24 2022] GET /identity/v3/projects/e8c81b1aae634ac9a24f9ecd30956749 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:25.053185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa50c4-ddc3-434d-940e-9f1c48a0150a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:25.053554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b47da-2da7-47f6-b5ba-f97a97735e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:25.055030 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b47da-2da7-47f6-b5ba-f97a97735e0b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:25.071296 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-aa8b47da-2da7-47f6-b5ba-f97a97735e0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:21:25.072471 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 534/1068] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:25.077854 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b47da-2da7-47f6-b5ba-f97a97735e0b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:25.146189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa50c4-ddc3-434d-940e-9f1c48a0150a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:25.173903 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b47da-2da7-47f6-b5ba-f97a97735e0b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:25.177984 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf2589-c3f3-4177-a36c-a0dfd7b46c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:25.178623 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf2589-c3f3-4177-a36c-a0dfd7b46c6c None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:25.178901 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf2589-c3f3-4177-a36c-a0dfd7b46c6c None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:25.179173 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf2589-c3f3-4177-a36c-a0dfd7b46c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:25.179975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf2589-c3f3-4177-a36c-a0dfd7b46c6c None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=e8c81b1aae634ac9a24f9ecd30956749, user.id=90af55ec70a7495ca8ebc56bea1942db) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:25.180328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf2589-c3f3-4177-a36c-a0dfd7b46c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:25.181741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf2589-c3f3-4177-a36c-a0dfd7b46c6c None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:25.197381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 535/1069] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:21:25 2022] GET /identity/v3/role_assignments?user.id=90af55ec70a7495ca8ebc56bea1942db&scope.project.id=e8c81b1aae634ac9a24f9ecd30956749&role.id=24a7898c863141f1911792647b5274e3 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:25.207329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aea4f-f495-4b73-9464-b3f460d933f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:25.208014 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aea4f-f495-4b73-9464-b3f460d933f8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:25.208336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aea4f-f495-4b73-9464-b3f460d933f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:25.208617 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aea4f-f495-4b73-9464-b3f460d933f8 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:25.209360 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aea4f-f495-4b73-9464-b3f460d933f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:25.209670 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aea4f-f495-4b73-9464-b3f460d933f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:25.211191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aea4f-f495-4b73-9464-b3f460d933f8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:25.224274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 535/1070] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:25.230046 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf2589-c3f3-4177-a36c-a0dfd7b46c6c None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:25.331410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf2589-c3f3-4177-a36c-a0dfd7b46c6c None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:25.366373 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd86f00-6486-480f-9049-c69fa4b62ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:25.367163 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd86f00-6486-480f-9049-c69fa4b62ba6 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:25.367440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd86f00-6486-480f-9049-c69fa4b62ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:25.367712 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd86f00-6486-480f-9049-c69fa4b62ba6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:25.374879 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd86f00-6486-480f-9049-c69fa4b62ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:25.376387 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd86f00-6486-480f-9049-c69fa4b62ba6 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:25.391938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-bbd86f00-6486-480f-9049-c69fa4b62ba6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 15:21:25.391938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 536/1071] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Mar 8 15:21:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:25.396595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aea4f-f495-4b73-9464-b3f460d933f8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:25.490919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aea4f-f495-4b73-9464-b3f460d933f8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:25.522561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431cc80-4a45-4e0b-b865-0cc66a075243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:25.523221 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431cc80-4a45-4e0b-b865-0cc66a075243 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:25.523503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431cc80-4a45-4e0b-b865-0cc66a075243 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:25.523779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431cc80-4a45-4e0b-b865-0cc66a075243 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:25.524628 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431cc80-4a45-4e0b-b865-0cc66a075243 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:25.524937 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431cc80-4a45-4e0b-b865-0cc66a075243 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:25.526357 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431cc80-4a45-4e0b-b865-0cc66a075243 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:25.543277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 536/1072] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Mar 8 15:21:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:25.549340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd86f00-6486-480f-9049-c69fa4b62ba6 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:25.641751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd86f00-6486-480f-9049-c69fa4b62ba6 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:25.673651 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6ebe3-d6ce-4aa8-83b6-2e4f9a96ca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:25.674416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6ebe3-d6ce-4aa8-83b6-2e4f9a96ca77 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:25.674695 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6ebe3-d6ce-4aa8-83b6-2e4f9a96ca77 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:25.674971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6ebe3-d6ce-4aa8-83b6-2e4f9a96ca77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:25.684314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6ebe3-d6ce-4aa8-83b6-2e4f9a96ca77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:25.685735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6ebe3-d6ce-4aa8-83b6-2e4f9a96ca77 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:25.701822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-87e6ebe3-d6ce-4aa8-83b6-2e4f9a96ca77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:21:25.702945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 537/1073] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:25.708550 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431cc80-4a45-4e0b-b865-0cc66a075243 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:25.803564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431cc80-4a45-4e0b-b865-0cc66a075243 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:25.835260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6a7ca-5699-48e0-adf5-f497c90947ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:25.835928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6a7ca-5699-48e0-adf5-f497c90947ed None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:25.836238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6a7ca-5699-48e0-adf5-f497c90947ed None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:25.836515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6a7ca-5699-48e0-adf5-f497c90947ed None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:25.837222 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6a7ca-5699-48e0-adf5-f497c90947ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:25.837526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6a7ca-5699-48e0-adf5-f497c90947ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:25.838884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6a7ca-5699-48e0-adf5-f497c90947ed None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:25.850095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 537/1074] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:25.855596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6ebe3-d6ce-4aa8-83b6-2e4f9a96ca77 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:25.948722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6ebe3-d6ce-4aa8-83b6-2e4f9a96ca77 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:25.981402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22d26a-4e36-4668-888a-bc30c4f926e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:25.982188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22d26a-4e36-4668-888a-bc30c4f926e7 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:25.982474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22d26a-4e36-4668-888a-bc30c4f926e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:25.982752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22d26a-4e36-4668-888a-bc30c4f926e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:25.989434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22d26a-4e36-4668-888a-bc30c4f926e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:25.990879 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22d26a-4e36-4668-888a-bc30c4f926e7 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:26.003489 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-6d22d26a-4e36-4668-888a-bc30c4f926e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:21:26.004676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 538/1075] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:21:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:26.010436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6a7ca-5699-48e0-adf5-f497c90947ed None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:26.104314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6a7ca-5699-48e0-adf5-f497c90947ed None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:26.136205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b418c-6ce7-4132-a4dd-1f46a26a678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:26.136874 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b418c-6ce7-4132-a4dd-1f46a26a678f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:26.137171 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b418c-6ce7-4132-a4dd-1f46a26a678f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:26.137435 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b418c-6ce7-4132-a4dd-1f46a26a678f None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:26.138245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b418c-6ce7-4132-a4dd-1f46a26a678f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:26.138528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b418c-6ce7-4132-a4dd-1f46a26a678f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:26.140622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b418c-6ce7-4132-a4dd-1f46a26a678f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:26.152801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 538/1076] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:21:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:26.158435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22d26a-4e36-4668-888a-bc30c4f926e7 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:26.252987 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22d26a-4e36-4668-888a-bc30c4f926e7 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:26.285058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404bc68-c2bd-44a3-b3e0-3d748e3af11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:26.285956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404bc68-c2bd-44a3-b3e0-3d748e3af11f None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:26.286236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404bc68-c2bd-44a3-b3e0-3d748e3af11f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:26.286510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404bc68-c2bd-44a3-b3e0-3d748e3af11f None admin] PATH_INFO: `/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/c4fb404cc61d49d3aaec429f4f9f4f94/roles/da838bc59061451a83ba92732ebec16f` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:26.288753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404bc68-c2bd-44a3-b3e0-3d748e3af11f None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdaa0405e224334ac42dc4cde1c01c5, user_id=c4fb404cc61d49d3aaec429f4f9f4f94, role_id=da838bc59061451a83ba92732ebec16f)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:26.290197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404bc68-c2bd-44a3-b3e0-3d748e3af11f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:26.378061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 539/1077] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:21:26 2022] PUT /identity/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/c4fb404cc61d49d3aaec429f4f9f4f94/roles/da838bc59061451a83ba92732ebec16f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:21:27.457783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5b2f3-b9f0-494c-b37f-3da454ae6af5 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:27.458298 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5b2f3-b9f0-494c-b37f-3da454ae6af5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:27.458298 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5b2f3-b9f0-494c-b37f-3da454ae6af5 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:27.460025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 539/1078] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:27.465604 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b3e00-25b6-411e-9889-fc35d83d5eca None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:27.466121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b3e00-25b6-411e-9889-fc35d83d5eca None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:27.466311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b3e00-25b6-411e-9889-fc35d83d5eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:27.483788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-350b3e00-25b6-411e-9889-fc35d83d5eca None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:27.485267 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-350b3e00-25b6-411e-9889-fc35d83d5eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:27.547633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 540/1079] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:27.570082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5b2f3-b9f0-494c-b37f-3da454ae6af5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:27.665932 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5b2f3-b9f0-494c-b37f-3da454ae6af5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:27.697205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea4f00-8888-4cf4-9bd6-e1b837f60050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:27.697975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea4f00-8888-4cf4-9bd6-e1b837f60050 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:27.698253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea4f00-8888-4cf4-9bd6-e1b837f60050 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:27.698525 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea4f00-8888-4cf4-9bd6-e1b837f60050 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:27.708643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea4f00-8888-4cf4-9bd6-e1b837f60050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:21:27.715718 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-41ea4f00-8888-4cf4-9bd6-e1b837f60050 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:21:27.716957 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 540/1080] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:21:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:27.723051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b3e00-25b6-411e-9889-fc35d83d5eca None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:27.814877 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b3e00-25b6-411e-9889-fc35d83d5eca None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:27.846282 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34287404-495f-4700-bed9-6406bcb160ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:27.846935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34287404-495f-4700-bed9-6406bcb160ab None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:27.847216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34287404-495f-4700-bed9-6406bcb160ab None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:27.847490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34287404-495f-4700-bed9-6406bcb160ab None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:27.848262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34287404-495f-4700-bed9-6406bcb160ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:27.848570 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34287404-495f-4700-bed9-6406bcb160ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:27.849925 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34287404-495f-4700-bed9-6406bcb160ab None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:27.857506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 541/1081] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:21:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:27.863484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea4f00-8888-4cf4-9bd6-e1b837f60050 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:27.957487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea4f00-8888-4cf4-9bd6-e1b837f60050 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:27.989129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895185d-e9d4-41cc-b1e9-4ee0eaedf4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:27.989925 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895185d-e9d4-41cc-b1e9-4ee0eaedf4da None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:27.990204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895185d-e9d4-41cc-b1e9-4ee0eaedf4da None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:27.990479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895185d-e9d4-41cc-b1e9-4ee0eaedf4da None admin] PATH_INFO: `/v3/users/90af55ec70a7495ca8ebc56bea1942db` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:27.991662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895185d-e9d4-41cc-b1e9-4ee0eaedf4da None admin] RBAC: Authorizing `identity:get_user(user_id=90af55ec70a7495ca8ebc56bea1942db)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:27.993140 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895185d-e9d4-41cc-b1e9-4ee0eaedf4da None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:27.994744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 541/1082] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:21:27 2022] GET /identity/v3/users/90af55ec70a7495ca8ebc56bea1942db => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:28.000958 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34287404-495f-4700-bed9-6406bcb160ab None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:28.093548 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34287404-495f-4700-bed9-6406bcb160ab None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:28.126364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a656ee3-053f-492a-89de-f5ef3d5d5789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:28.127206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a656ee3-053f-492a-89de-f5ef3d5d5789 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:28.127486 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a656ee3-053f-492a-89de-f5ef3d5d5789 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:28.127758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a656ee3-053f-492a-89de-f5ef3d5d5789 None admin] PATH_INFO: `/v3/projects/e8c81b1aae634ac9a24f9ecd30956749` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:28.128946 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a656ee3-053f-492a-89de-f5ef3d5d5789 None admin] RBAC: Authorizing `identity:get_project(project_id=e8c81b1aae634ac9a24f9ecd30956749)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:28.130363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a656ee3-053f-492a-89de-f5ef3d5d5789 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:28.132195 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 542/1083] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:21:27 2022] GET /identity/v3/projects/e8c81b1aae634ac9a24f9ecd30956749 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:28.137845 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895185d-e9d4-41cc-b1e9-4ee0eaedf4da None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:28.231706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895185d-e9d4-41cc-b1e9-4ee0eaedf4da None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:28.263926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e46a8-aa4d-4caf-80bc-9a0f2face69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:28.264817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e46a8-aa4d-4caf-80bc-9a0f2face69d None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:28.265103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e46a8-aa4d-4caf-80bc-9a0f2face69d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:28.265379 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e46a8-aa4d-4caf-80bc-9a0f2face69d None admin] PATH_INFO: `/v3/projects/e8c81b1aae634ac9a24f9ecd30956749/users/90af55ec70a7495ca8ebc56bea1942db/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:28.267441 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e46a8-aa4d-4caf-80bc-9a0f2face69d None admin] RBAC: Authorizing `identity:create_grant(project_id=e8c81b1aae634ac9a24f9ecd30956749, user_id=90af55ec70a7495ca8ebc56bea1942db, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:28.268941 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e46a8-aa4d-4caf-80bc-9a0f2face69d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:28.343503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 542/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:21:28 2022] PUT /identity/v3/projects/e8c81b1aae634ac9a24f9ecd30956749/users/90af55ec70a7495ca8ebc56bea1942db/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:21:28.638863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff3229-b3e3-43b0-a9a2-2280f935b4d2 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:28.639369 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff3229-b3e3-43b0-a9a2-2280f935b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:28.639476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff3229-b3e3-43b0-a9a2-2280f935b4d2 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:28.641764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 543/1085] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:28.646971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9849b76-4d7a-4970-8498-3c921b594b0f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:28.647418 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9849b76-4d7a-4970-8498-3c921b594b0f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:28.647518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9849b76-4d7a-4970-8498-3c921b594b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:28.663903 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-d9849b76-4d7a-4970-8498-3c921b594b0f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:28.665123 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d9849b76-4d7a-4970-8498-3c921b594b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:28.728094 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 543/1086] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:28.752183 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff3229-b3e3-43b0-a9a2-2280f935b4d2 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:28.847236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff3229-b3e3-43b0-a9a2-2280f935b4d2 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:28.879120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62724a-1bb8-455a-accf-3144c2fa7d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:28.879920 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62724a-1bb8-455a-accf-3144c2fa7d31 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:28.880231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62724a-1bb8-455a-accf-3144c2fa7d31 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:28.880512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62724a-1bb8-455a-accf-3144c2fa7d31 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:28.890489 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62724a-1bb8-455a-accf-3144c2fa7d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:21:28.897717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-fa62724a-1bb8-455a-accf-3144c2fa7d31 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 15:21:28.898870 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 544/1087] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Mar 8 15:21:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:28.905001 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9849b76-4d7a-4970-8498-3c921b594b0f None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:28.997025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9849b76-4d7a-4970-8498-3c921b594b0f None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:29.029338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cf523-b133-42f7-af9d-f8e1da5f70ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:29.030001 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cf523-b133-42f7-af9d-f8e1da5f70ac None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:29.030286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cf523-b133-42f7-af9d-f8e1da5f70ac None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:29.030563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cf523-b133-42f7-af9d-f8e1da5f70ac None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:29.031315 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cf523-b133-42f7-af9d-f8e1da5f70ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:29.031621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cf523-b133-42f7-af9d-f8e1da5f70ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:29.033029 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cf523-b133-42f7-af9d-f8e1da5f70ac None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:29.041032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 544/1088] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Mar 8 15:21:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:29.047136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62724a-1bb8-455a-accf-3144c2fa7d31 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:29.140306 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62724a-1bb8-455a-accf-3144c2fa7d31 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:29.172981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000e91e-e13c-4c80-8b39-c352707107b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:29.173761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000e91e-e13c-4c80-8b39-c352707107b4 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:29.174041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000e91e-e13c-4c80-8b39-c352707107b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:29.174311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000e91e-e13c-4c80-8b39-c352707107b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:29.183768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000e91e-e13c-4c80-8b39-c352707107b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:29.185227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000e91e-e13c-4c80-8b39-c352707107b4 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:29.201954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-d000e91e-e13c-4c80-8b39-c352707107b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:21:29.203119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 545/1089] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:29.208684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cf523-b133-42f7-af9d-f8e1da5f70ac None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:29.302645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cf523-b133-42f7-af9d-f8e1da5f70ac None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:29.334206 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9310691-6323-44ce-a3cd-860362ab8475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:29.334860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9310691-6323-44ce-a3cd-860362ab8475 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:29.335146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9310691-6323-44ce-a3cd-860362ab8475 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:29.335423 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9310691-6323-44ce-a3cd-860362ab8475 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:29.336139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9310691-6323-44ce-a3cd-860362ab8475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:29.336479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9310691-6323-44ce-a3cd-860362ab8475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:29.337847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9310691-6323-44ce-a3cd-860362ab8475 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:29.350363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 545/1090] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:29.355863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000e91e-e13c-4c80-8b39-c352707107b4 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:29.451223 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000e91e-e13c-4c80-8b39-c352707107b4 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:29.485189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde6b3a-0d55-45bb-ae1a-4efe685f5b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:29.485978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde6b3a-0d55-45bb-ae1a-4efe685f5b2f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:29.486260 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde6b3a-0d55-45bb-ae1a-4efe685f5b2f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:29.486537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde6b3a-0d55-45bb-ae1a-4efe685f5b2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:29.493590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde6b3a-0d55-45bb-ae1a-4efe685f5b2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:29.495025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde6b3a-0d55-45bb-ae1a-4efe685f5b2f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:29.508009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-8bde6b3a-0d55-45bb-ae1a-4efe685f5b2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 15:21:29.509180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 546/1091] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Mar 8 15:21:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:29.515531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9310691-6323-44ce-a3cd-860362ab8475 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:29.607501 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9310691-6323-44ce-a3cd-860362ab8475 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:29.651312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14fadc-e512-4162-aeab-c9b20150e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:29.651967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14fadc-e512-4162-aeab-c9b20150e195 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:29.652293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14fadc-e512-4162-aeab-c9b20150e195 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:29.652559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14fadc-e512-4162-aeab-c9b20150e195 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:29.653377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14fadc-e512-4162-aeab-c9b20150e195 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:29.653682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14fadc-e512-4162-aeab-c9b20150e195 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:29.655111 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14fadc-e512-4162-aeab-c9b20150e195 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:29.677049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 546/1092] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Mar 8 15:21:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:29.683370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde6b3a-0d55-45bb-ae1a-4efe685f5b2f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:29.777520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde6b3a-0d55-45bb-ae1a-4efe685f5b2f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:29.808767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d4a8b-ba23-4693-9daf-40f9549e8fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:29.809392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d4a8b-ba23-4693-9daf-40f9549e8fdb None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:29.809673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d4a8b-ba23-4693-9daf-40f9549e8fdb None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:29.809945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d4a8b-ba23-4693-9daf-40f9549e8fdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:29.871828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d4a8b-ba23-4693-9daf-40f9549e8fdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:29.873293 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d4a8b-ba23-4693-9daf-40f9549e8fdb None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:29.963985 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 547/1093] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:21:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:21:29.969639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14fadc-e512-4162-aeab-c9b20150e195 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:30.066555 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14fadc-e512-4162-aeab-c9b20150e195 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:30.098197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c09b1-25fb-499a-be62-80284ffe9989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:30.098999 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c09b1-25fb-499a-be62-80284ffe9989 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:30.099277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c09b1-25fb-499a-be62-80284ffe9989 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:30.099545 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c09b1-25fb-499a-be62-80284ffe9989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:30.109385 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c09b1-25fb-499a-be62-80284ffe9989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:30.110833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c09b1-25fb-499a-be62-80284ffe9989 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:30.127299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-2b8c09b1-25fb-499a-be62-80284ffe9989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:21:30.128483 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 547/1094] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:21:30.134175 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d4a8b-ba23-4693-9daf-40f9549e8fdb None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:30.226494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d4a8b-ba23-4693-9daf-40f9549e8fdb None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:30.258847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182f1e-5a76-4c1c-8183-e28d3acff527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:30.259501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182f1e-5a76-4c1c-8183-e28d3acff527 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:30.259787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182f1e-5a76-4c1c-8183-e28d3acff527 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:30.260061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182f1e-5a76-4c1c-8183-e28d3acff527 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:30.260802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182f1e-5a76-4c1c-8183-e28d3acff527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:30.261108 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182f1e-5a76-4c1c-8183-e28d3acff527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:30.262486 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182f1e-5a76-4c1c-8183-e28d3acff527 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:30.273096 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 548/1095] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:30.278552 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c09b1-25fb-499a-be62-80284ffe9989 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:30.382479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c09b1-25fb-499a-be62-80284ffe9989 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:30.414196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb475ad-b5ca-4d57-acc9-bd0acc37f8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:30.414970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb475ad-b5ca-4d57-acc9-bd0acc37f8d1 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:30.415247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb475ad-b5ca-4d57-acc9-bd0acc37f8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:30.415519 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb475ad-b5ca-4d57-acc9-bd0acc37f8d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:30.422512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb475ad-b5ca-4d57-acc9-bd0acc37f8d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:30.423938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb475ad-b5ca-4d57-acc9-bd0acc37f8d1 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:30.436354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-9fb475ad-b5ca-4d57-acc9-bd0acc37f8d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:21:30.438073 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 548/1096] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:21:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:30.443830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182f1e-5a76-4c1c-8183-e28d3acff527 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:30.538151 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182f1e-5a76-4c1c-8183-e28d3acff527 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:30.569724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786b061-2d30-4446-bea1-a24859359b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:30.570361 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786b061-2d30-4446-bea1-a24859359b52 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:30.570638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786b061-2d30-4446-bea1-a24859359b52 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:30.570906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786b061-2d30-4446-bea1-a24859359b52 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:30.571672 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786b061-2d30-4446-bea1-a24859359b52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:30.571975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786b061-2d30-4446-bea1-a24859359b52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:30.573430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786b061-2d30-4446-bea1-a24859359b52 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:30.584759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 549/1097] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:21:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:30.590629 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb475ad-b5ca-4d57-acc9-bd0acc37f8d1 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:30.675874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b89ea-340c-47f2-9134-bef719dcbf3b None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:30.676088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b89ea-340c-47f2-9134-bef719dcbf3b None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:30.676401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b89ea-340c-47f2-9134-bef719dcbf3b None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:30.678149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 550/1098] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:21:30.683047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f7242-01c7-4294-bb6f-c992cad15e1d None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:30.683334 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f7242-01c7-4294-bb6f-c992cad15e1d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:30.683608 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f7242-01c7-4294-bb6f-c992cad15e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:30.684125 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb475ad-b5ca-4d57-acc9-bd0acc37f8d1 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:30.699457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-ed2f7242-01c7-4294-bb6f-c992cad15e1d None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:30.700657 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ed2f7242-01c7-4294-bb6f-c992cad15e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:30.715449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1fe1f-c8ab-4797-81df-88eed0b7924e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:30.716089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1fe1f-c8ab-4797-81df-88eed0b7924e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:30.716399 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1fe1f-c8ab-4797-81df-88eed0b7924e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:30.716676 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1fe1f-c8ab-4797-81df-88eed0b7924e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:30.717487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1fe1f-c8ab-4797-81df-88eed0b7924e None admin] RBAC: Adding query filter params (role.id=da838bc59061451a83ba92732ebec16f, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=c4fb404cc61d49d3aaec429f4f9f4f94) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:30.718330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1fe1f-c8ab-4797-81df-88eed0b7924e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:30.719764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1fe1f-c8ab-4797-81df-88eed0b7924e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:30.725371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 549/1099] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:21:30 2022] GET /identity/v3/role_assignments?user.id=c4fb404cc61d49d3aaec429f4f9f4f94&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=da838bc59061451a83ba92732ebec16f => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:30.768783 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 551/1100] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:30.793124 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1fe1f-c8ab-4797-81df-88eed0b7924e None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:30.895322 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1fe1f-c8ab-4797-81df-88eed0b7924e None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:30.930430 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a903cb-0a8a-449c-b04c-6e91a923de4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:30.931152 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a903cb-0a8a-449c-b04c-6e91a923de4a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:30.932991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a903cb-0a8a-449c-b04c-6e91a923de4a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:30.932991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a903cb-0a8a-449c-b04c-6e91a923de4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:30.941492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a903cb-0a8a-449c-b04c-6e91a923de4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:21:30.948313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-e3a903cb-0a8a-449c-b04c-6e91a923de4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:21:30.949485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 550/1101] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:21:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:30.955637 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f7242-01c7-4294-bb6f-c992cad15e1d None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:31.052559 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f7242-01c7-4294-bb6f-c992cad15e1d None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:31.084803 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523dfd-c443-4dc9-ba32-c2149ae83ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:31.085460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523dfd-c443-4dc9-ba32-c2149ae83ecc None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:31.085742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523dfd-c443-4dc9-ba32-c2149ae83ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:31.086014 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9523dfd-c443-4dc9-ba32-c2149ae83ecc None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:31.086757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9523dfd-c443-4dc9-ba32-c2149ae83ecc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:31.087063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9523dfd-c443-4dc9-ba32-c2149ae83ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:31.088447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9523dfd-c443-4dc9-ba32-c2149ae83ecc None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:31.099438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 552/1102] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:21:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:31.104275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a903cb-0a8a-449c-b04c-6e91a923de4a None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:31.204992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a903cb-0a8a-449c-b04c-6e91a923de4a None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:31.237648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfdcf1-1f5e-4cd3-979d-3035632db64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:31.238509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfdcf1-1f5e-4cd3-979d-3035632db64f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:31.238794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfdcf1-1f5e-4cd3-979d-3035632db64f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:31.239072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfdcf1-1f5e-4cd3-979d-3035632db64f None admin] PATH_INFO: `/v3/users/90af55ec70a7495ca8ebc56bea1942db` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:31.240308 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfdcf1-1f5e-4cd3-979d-3035632db64f None admin] RBAC: Authorizing `identity:get_user(user_id=90af55ec70a7495ca8ebc56bea1942db)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:31.241741 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfdcf1-1f5e-4cd3-979d-3035632db64f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:31.243360 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 551/1103] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:21:31 2022] GET /identity/v3/users/90af55ec70a7495ca8ebc56bea1942db => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:31.249262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523dfd-c443-4dc9-ba32-c2149ae83ecc None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:31.347010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9523dfd-c443-4dc9-ba32-c2149ae83ecc None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:31.379673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493020d-aee1-41cc-a3f3-0eee4a7ba409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:31.380438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493020d-aee1-41cc-a3f3-0eee4a7ba409 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:31.380726 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493020d-aee1-41cc-a3f3-0eee4a7ba409 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:31.381003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493020d-aee1-41cc-a3f3-0eee4a7ba409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:31.445926 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493020d-aee1-41cc-a3f3-0eee4a7ba409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:31.447382 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493020d-aee1-41cc-a3f3-0eee4a7ba409 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:31.557757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 553/1104] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:21:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:21:31.557978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfdcf1-1f5e-4cd3-979d-3035632db64f None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:31.658892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfdcf1-1f5e-4cd3-979d-3035632db64f None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:31.730465 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7015a-2ddd-4425-aa1e-555f1cf0f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:31.731303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7015a-2ddd-4425-aa1e-555f1cf0f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:31.731584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7015a-2ddd-4425-aa1e-555f1cf0f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:31.731856 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7015a-2ddd-4425-aa1e-555f1cf0f5e9 None admin] PATH_INFO: `/v3/projects/e8c81b1aae634ac9a24f9ecd30956749` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:31.733043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7015a-2ddd-4425-aa1e-555f1cf0f5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=e8c81b1aae634ac9a24f9ecd30956749)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:31.735256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7015a-2ddd-4425-aa1e-555f1cf0f5e9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:31.736974 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 552/1105] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:21:31 2022] GET /identity/v3/projects/e8c81b1aae634ac9a24f9ecd30956749 => generated 311 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:31.743151 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493020d-aee1-41cc-a3f3-0eee4a7ba409 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:31.834594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493020d-aee1-41cc-a3f3-0eee4a7ba409 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:31.866538 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e0b34-3be7-4e5d-b961-7005395ae963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:31.867166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e0b34-3be7-4e5d-b961-7005395ae963 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:31.867446 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e0b34-3be7-4e5d-b961-7005395ae963 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:31.867719 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e0b34-3be7-4e5d-b961-7005395ae963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:31.868552 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e0b34-3be7-4e5d-b961-7005395ae963 None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=e8c81b1aae634ac9a24f9ecd30956749, user.id=90af55ec70a7495ca8ebc56bea1942db) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:31.868860 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e0b34-3be7-4e5d-b961-7005395ae963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:31.870275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e0b34-3be7-4e5d-b961-7005395ae963 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:31.876110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 554/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:21:31 2022] GET /identity/v3/role_assignments?user.id=90af55ec70a7495ca8ebc56bea1942db&scope.project.id=e8c81b1aae634ac9a24f9ecd30956749&role.id=24a7898c863141f1911792647b5274e3 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:34.145048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5fae7-37a3-44c5-a128-af2aa7660697 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:34.145430 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5fae7-37a3-44c5-a128-af2aa7660697 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:34.145606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5fae7-37a3-44c5-a128-af2aa7660697 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:34.147362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 553/1107] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:34.152478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5e87c-d078-4d20-a9e1-018e648099d6 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:34.152996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5e87c-d078-4d20-a9e1-018e648099d6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:34.153092 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5e87c-d078-4d20-a9e1-018e648099d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:34.168912 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-73c5e87c-d078-4d20-a9e1-018e648099d6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:34.170100 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-73c5e87c-d078-4d20-a9e1-018e648099d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:34.231940 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 555/1108] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:34.256990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5fae7-37a3-44c5-a128-af2aa7660697 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:34.352924 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5fae7-37a3-44c5-a128-af2aa7660697 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:34.384311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cb86b-79cb-4e7d-9cdd-b2809368a24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:34.385086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cb86b-79cb-4e7d-9cdd-b2809368a24e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:34.385371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cb86b-79cb-4e7d-9cdd-b2809368a24e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:34.385648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cb86b-79cb-4e7d-9cdd-b2809368a24e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:34.386807 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cb86b-79cb-4e7d-9cdd-b2809368a24e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:34.388261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cb86b-79cb-4e7d-9cdd-b2809368a24e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:34.389841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 554/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:34.395772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5e87c-d078-4d20-a9e1-018e648099d6 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:34.489374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5e87c-d078-4d20-a9e1-018e648099d6 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:34.519871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8fab7-4e0f-4678-bcfd-c78ca7216b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:34.520558 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8fab7-4e0f-4678-bcfd-c78ca7216b1e None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:34.520848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8fab7-4e0f-4678-bcfd-c78ca7216b1e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:34.521127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8fab7-4e0f-4678-bcfd-c78ca7216b1e None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:34.521839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8fab7-4e0f-4678-bcfd-c78ca7216b1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:34.523274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8fab7-4e0f-4678-bcfd-c78ca7216b1e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:34.611515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 556/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:21:34 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:21:36.937261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ca92d-9093-4e1c-a3ec-b7f0cdd0cd63 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:36.937790 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ca92d-9093-4e1c-a3ec-b7f0cdd0cd63 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:36.937876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ca92d-9093-4e1c-a3ec-b7f0cdd0cd63 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:36.939585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 555/1111] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:36.944770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9cf60-5943-4c8e-a3da-3d4f8500d0bc None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:36.945143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9cf60-5943-4c8e-a3da-3d4f8500d0bc None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:36.945336 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9cf60-5943-4c8e-a3da-3d4f8500d0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:36.962158 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-ccf9cf60-5943-4c8e-a3da-3d4f8500d0bc None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:36.963322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ccf9cf60-5943-4c8e-a3da-3d4f8500d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:37.025404 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 557/1112] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:37.049005 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ca92d-9093-4e1c-a3ec-b7f0cdd0cd63 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:37.145642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ca92d-9093-4e1c-a3ec-b7f0cdd0cd63 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:37.177437 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f07ce2-dc22-425b-b8ae-f9932574a0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:37.178274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f07ce2-dc22-425b-b8ae-f9932574a0c0 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:37.178558 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f07ce2-dc22-425b-b8ae-f9932574a0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:37.178836 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f07ce2-dc22-425b-b8ae-f9932574a0c0 None admin] PATH_INFO: `/v3/roles/21dc73c091ba46889022763efb51de4e` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:37.180322 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f07ce2-dc22-425b-b8ae-f9932574a0c0 None admin] RBAC: Authorizing `identity:get_role(role_id=21dc73c091ba46889022763efb51de4e)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:37.181688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f07ce2-dc22-425b-b8ae-f9932574a0c0 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:37.183024 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 556/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:21:37 2022] GET /identity/v3/roles/21dc73c091ba46889022763efb51de4e => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:37.189381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9cf60-5943-4c8e-a3da-3d4f8500d0bc None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:37.280076 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9cf60-5943-4c8e-a3da-3d4f8500d0bc None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:37.311976 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df28f27-9054-4af4-8a52-ceb1a75ab980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:37.312855 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df28f27-9054-4af4-8a52-ceb1a75ab980 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:37.313137 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df28f27-9054-4af4-8a52-ceb1a75ab980 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:37.313412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df28f27-9054-4af4-8a52-ceb1a75ab980 None admin] PATH_INFO: `/v3/users/5f5d5b9460414a73a861269f33d4404b` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:37.325460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df28f27-9054-4af4-8a52-ceb1a75ab980 None admin] RBAC: Authorizing `identity:get_user(user_id=5f5d5b9460414a73a861269f33d4404b)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:37.326891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df28f27-9054-4af4-8a52-ceb1a75ab980 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:37.328506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 558/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:21:37 2022] GET /identity/v3/users/5f5d5b9460414a73a861269f33d4404b => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:37.334037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f07ce2-dc22-425b-b8ae-f9932574a0c0 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:37.427718 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f07ce2-dc22-425b-b8ae-f9932574a0c0 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:37.458290 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f317717-2733-4e9e-9bf8-1496f7ac3286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:37.458859 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f317717-2733-4e9e-9bf8-1496f7ac3286 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:37.459145 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f317717-2733-4e9e-9bf8-1496f7ac3286 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:37.459423 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f317717-2733-4e9e-9bf8-1496f7ac3286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:37.521816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f317717-2733-4e9e-9bf8-1496f7ac3286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:37.523231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f317717-2733-4e9e-9bf8-1496f7ac3286 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:37.615551 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 557/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:21:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:21:37.621297 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df28f27-9054-4af4-8a52-ceb1a75ab980 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:37.712329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df28f27-9054-4af4-8a52-ceb1a75ab980 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:37.744351 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae0aa3-25b8-4eb2-9811-89ffd2ca52c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:37.745182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae0aa3-25b8-4eb2-9811-89ffd2ca52c2 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:37.745460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae0aa3-25b8-4eb2-9811-89ffd2ca52c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:37.745729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae0aa3-25b8-4eb2-9811-89ffd2ca52c2 None admin] PATH_INFO: `/v3/projects/e8c81b1aae634ac9a24f9ecd30956749` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:37.746884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae0aa3-25b8-4eb2-9811-89ffd2ca52c2 None admin] RBAC: Authorizing `identity:get_project(project_id=e8c81b1aae634ac9a24f9ecd30956749)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:37.748322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae0aa3-25b8-4eb2-9811-89ffd2ca52c2 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:37.749974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 559/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:21:37 2022] GET /identity/v3/projects/e8c81b1aae634ac9a24f9ecd30956749 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:37.755973 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f317717-2733-4e9e-9bf8-1496f7ac3286 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:37.846992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f317717-2733-4e9e-9bf8-1496f7ac3286 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:37.878059 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d061ef-1ec8-4c32-b4c3-bc4c88650e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:37.878685 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d061ef-1ec8-4c32-b4c3-bc4c88650e7b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:37.878961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d061ef-1ec8-4c32-b4c3-bc4c88650e7b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:37.879230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d061ef-1ec8-4c32-b4c3-bc4c88650e7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:37.880045 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d061ef-1ec8-4c32-b4c3-bc4c88650e7b None admin] RBAC: Adding query filter params (role.id=21dc73c091ba46889022763efb51de4e, scope.project.id=e8c81b1aae634ac9a24f9ecd30956749, user.id=5f5d5b9460414a73a861269f33d4404b) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:37.880380 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d061ef-1ec8-4c32-b4c3-bc4c88650e7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:37.881782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d061ef-1ec8-4c32-b4c3-bc4c88650e7b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:37.886817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 558/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:21:37 2022] GET /identity/v3/role_assignments?user.id=5f5d5b9460414a73a861269f33d4404b&scope.project.id=e8c81b1aae634ac9a24f9ecd30956749&role.id=21dc73c091ba46889022763efb51de4e => generated 259 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:40.119836 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aa31a-d986-4c77-b240-69275be470bb None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:40.120405 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aa31a-d986-4c77-b240-69275be470bb None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:40.120405 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aa31a-d986-4c77-b240-69275be470bb None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:40.122147 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 560/1118] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:40.127315 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979288c-fed1-4092-b671-87ba8dba079f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:40.127688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979288c-fed1-4092-b671-87ba8dba079f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:40.127871 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979288c-fed1-4092-b671-87ba8dba079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:40.144810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-6979288c-fed1-4092-b671-87ba8dba079f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:40.145975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6979288c-fed1-4092-b671-87ba8dba079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:40.208007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 559/1119] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:40.230822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aa31a-d986-4c77-b240-69275be470bb None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:40.324581 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aa31a-d986-4c77-b240-69275be470bb None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:40.356726 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f90bf-82b2-495e-a83f-a8f22bd09972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:40.357561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f90bf-82b2-495e-a83f-a8f22bd09972 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:40.357851 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f90bf-82b2-495e-a83f-a8f22bd09972 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:40.358122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f90bf-82b2-495e-a83f-a8f22bd09972 None admin] PATH_INFO: `/v3/roles/21dc73c091ba46889022763efb51de4e` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:40.359795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f90bf-82b2-495e-a83f-a8f22bd09972 None admin] RBAC: Authorizing `identity:get_role(role_id=21dc73c091ba46889022763efb51de4e)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:40.361176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f90bf-82b2-495e-a83f-a8f22bd09972 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:40.362489 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 561/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:21:40 2022] GET /identity/v3/roles/21dc73c091ba46889022763efb51de4e => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:40.368117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979288c-fed1-4092-b671-87ba8dba079f None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:40.463499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979288c-fed1-4092-b671-87ba8dba079f None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:40.494421 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb5535-31dd-48aa-bca6-7328244b5c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:40.495267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb5535-31dd-48aa-bca6-7328244b5c9b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:40.495542 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb5535-31dd-48aa-bca6-7328244b5c9b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:40.495808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb5535-31dd-48aa-bca6-7328244b5c9b None admin] PATH_INFO: `/v3/users/5f5d5b9460414a73a861269f33d4404b` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:40.497010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb5535-31dd-48aa-bca6-7328244b5c9b None admin] RBAC: Authorizing `identity:get_user(user_id=5f5d5b9460414a73a861269f33d4404b)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:40.498953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb5535-31dd-48aa-bca6-7328244b5c9b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:40.500570 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 560/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:21:40 2022] GET /identity/v3/users/5f5d5b9460414a73a861269f33d4404b => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:40.506190 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f90bf-82b2-495e-a83f-a8f22bd09972 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:40.598049 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f90bf-82b2-495e-a83f-a8f22bd09972 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:40.629874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6c0f8-5f8f-442e-a573-9b9bd9b1b952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:40.630708 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c0f8-5f8f-442e-a573-9b9bd9b1b952 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:40.630992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c0f8-5f8f-442e-a573-9b9bd9b1b952 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:40.631267 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c0f8-5f8f-442e-a573-9b9bd9b1b952 None admin] PATH_INFO: `/v3/projects/e8c81b1aae634ac9a24f9ecd30956749` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:40.632468 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6c0f8-5f8f-442e-a573-9b9bd9b1b952 None admin] RBAC: Authorizing `identity:get_project(project_id=e8c81b1aae634ac9a24f9ecd30956749)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:40.633883 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6c0f8-5f8f-442e-a573-9b9bd9b1b952 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:40.635516 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 562/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:21:40 2022] GET /identity/v3/projects/e8c81b1aae634ac9a24f9ecd30956749 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:40.641810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb5535-31dd-48aa-bca6-7328244b5c9b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:40.734075 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb5535-31dd-48aa-bca6-7328244b5c9b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:40.765410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d84f01-c84a-4948-85be-b0d2573b670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:40.766271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d84f01-c84a-4948-85be-b0d2573b670c None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:40.766551 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d84f01-c84a-4948-85be-b0d2573b670c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:40.766824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d84f01-c84a-4948-85be-b0d2573b670c None admin] PATH_INFO: `/v3/projects/e8c81b1aae634ac9a24f9ecd30956749/users/5f5d5b9460414a73a861269f33d4404b/roles/21dc73c091ba46889022763efb51de4e` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:40.769008 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d84f01-c84a-4948-85be-b0d2573b670c None admin] RBAC: Authorizing `identity:create_grant(project_id=e8c81b1aae634ac9a24f9ecd30956749, user_id=5f5d5b9460414a73a861269f33d4404b, role_id=21dc73c091ba46889022763efb51de4e)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:40.770423 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d84f01-c84a-4948-85be-b0d2573b670c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:40.849990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 561/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:21:40 2022] PUT /identity/v3/projects/e8c81b1aae634ac9a24f9ecd30956749/users/5f5d5b9460414a73a861269f33d4404b/roles/21dc73c091ba46889022763efb51de4e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:21:43.084768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e40dc8-2bdf-493b-ab9b-b9c6672123c3 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:43.085295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e40dc8-2bdf-493b-ab9b-b9c6672123c3 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:43.085295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e40dc8-2bdf-493b-ab9b-b9c6672123c3 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:43.087068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 563/1124] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:43.092874 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ec6ee-7d6e-4c5b-bb2e-4d3b58e8d9f7 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:43.093293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ec6ee-7d6e-4c5b-bb2e-4d3b58e8d9f7 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:43.093422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ec6ee-7d6e-4c5b-bb2e-4d3b58e8d9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:43.109837 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-6c4ec6ee-7d6e-4c5b-bb2e-4d3b58e8d9f7 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:43.110996 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6c4ec6ee-7d6e-4c5b-bb2e-4d3b58e8d9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:43.173349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 562/1125] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:43.195965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e40dc8-2bdf-493b-ab9b-b9c6672123c3 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:43.291337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e40dc8-2bdf-493b-ab9b-b9c6672123c3 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:43.322394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8429df-808e-448f-b518-d0ce89621692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:43.323221 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8429df-808e-448f-b518-d0ce89621692 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:43.323499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8429df-808e-448f-b518-d0ce89621692 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:43.323769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8429df-808e-448f-b518-d0ce89621692 None admin] PATH_INFO: `/v3/roles/21dc73c091ba46889022763efb51de4e` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:43.325236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8429df-808e-448f-b518-d0ce89621692 None admin] RBAC: Authorizing `identity:get_role(role_id=21dc73c091ba46889022763efb51de4e)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:43.327099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8429df-808e-448f-b518-d0ce89621692 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:43.328452 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 564/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:21:43 2022] GET /identity/v3/roles/21dc73c091ba46889022763efb51de4e => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:43.334164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ec6ee-7d6e-4c5b-bb2e-4d3b58e8d9f7 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:43.426812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ec6ee-7d6e-4c5b-bb2e-4d3b58e8d9f7 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:43.459180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb4171-253f-4c60-9fa3-7d39071e1908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:43.460038 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb4171-253f-4c60-9fa3-7d39071e1908 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:43.460381 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb4171-253f-4c60-9fa3-7d39071e1908 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:43.460686 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb4171-253f-4c60-9fa3-7d39071e1908 None admin] PATH_INFO: `/v3/users/5f5d5b9460414a73a861269f33d4404b` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:43.461868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb4171-253f-4c60-9fa3-7d39071e1908 None admin] RBAC: Authorizing `identity:get_user(user_id=5f5d5b9460414a73a861269f33d4404b)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:43.463306 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb4171-253f-4c60-9fa3-7d39071e1908 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:43.464928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 563/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:21:43 2022] GET /identity/v3/users/5f5d5b9460414a73a861269f33d4404b => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:43.470639 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8429df-808e-448f-b518-d0ce89621692 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:43.562189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8429df-808e-448f-b518-d0ce89621692 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:43.593869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04669174-bce0-4e5f-b67a-f9f3a88a13f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:43.594489 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04669174-bce0-4e5f-b67a-f9f3a88a13f1 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:43.594770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04669174-bce0-4e5f-b67a-f9f3a88a13f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:43.595043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04669174-bce0-4e5f-b67a-f9f3a88a13f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:43.657515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04669174-bce0-4e5f-b67a-f9f3a88a13f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:43.658934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04669174-bce0-4e5f-b67a-f9f3a88a13f1 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:43.749580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 565/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:21:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:21:43.755128 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb4171-253f-4c60-9fa3-7d39071e1908 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:43.851165 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb4171-253f-4c60-9fa3-7d39071e1908 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:43.883580 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6102f7f-20f3-46b0-af98-56ba3dcf24d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:43.884443 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6102f7f-20f3-46b0-af98-56ba3dcf24d8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:43.884725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6102f7f-20f3-46b0-af98-56ba3dcf24d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:43.885000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6102f7f-20f3-46b0-af98-56ba3dcf24d8 None admin] PATH_INFO: `/v3/projects/e8c81b1aae634ac9a24f9ecd30956749` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:43.886158 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6102f7f-20f3-46b0-af98-56ba3dcf24d8 None admin] RBAC: Authorizing `identity:get_project(project_id=e8c81b1aae634ac9a24f9ecd30956749)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:43.887569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6102f7f-20f3-46b0-af98-56ba3dcf24d8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:43.889262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 564/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:21:43 2022] GET /identity/v3/projects/e8c81b1aae634ac9a24f9ecd30956749 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:43.895065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04669174-bce0-4e5f-b67a-f9f3a88a13f1 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:43.986404 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04669174-bce0-4e5f-b67a-f9f3a88a13f1 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:44.018235 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8d64b-18f5-4ea7-bb44-24a8d23cb2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:44.018814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8d64b-18f5-4ea7-bb44-24a8d23cb2af None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:44.019097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8d64b-18f5-4ea7-bb44-24a8d23cb2af None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:44.019370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8d64b-18f5-4ea7-bb44-24a8d23cb2af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:44.020207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8d64b-18f5-4ea7-bb44-24a8d23cb2af None admin] RBAC: Adding query filter params (role.id=21dc73c091ba46889022763efb51de4e, scope.project.id=e8c81b1aae634ac9a24f9ecd30956749, user.id=5f5d5b9460414a73a861269f33d4404b) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:44.020518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8d64b-18f5-4ea7-bb44-24a8d23cb2af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:44.021936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8d64b-18f5-4ea7-bb44-24a8d23cb2af None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:44.027409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 566/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:21:43 2022] GET /identity/v3/role_assignments?user.id=5f5d5b9460414a73a861269f33d4404b&scope.project.id=e8c81b1aae634ac9a24f9ecd30956749&role.id=21dc73c091ba46889022763efb51de4e => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:46.299119 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e2854-6eeb-44ab-b931-412311061162 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:46.299660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e2854-6eeb-44ab-b931-412311061162 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:46.299660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e2854-6eeb-44ab-b931-412311061162 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:46.301494 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 565/1131] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:46.306706 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b2fe4-878d-4576-9d4b-0c45e064eea8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:46.307119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b2fe4-878d-4576-9d4b-0c45e064eea8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:46.307264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b2fe4-878d-4576-9d4b-0c45e064eea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:46.327947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-167b2fe4-878d-4576-9d4b-0c45e064eea8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:46.329160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-167b2fe4-878d-4576-9d4b-0c45e064eea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:46.391343 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 567/1132] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:46.414787 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e2854-6eeb-44ab-b931-412311061162 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:46.512065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e2854-6eeb-44ab-b931-412311061162 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:46.543400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a1ccc-712a-47e3-89e9-a0be39c1d6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:46.544193 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1ccc-712a-47e3-89e9-a0be39c1d6a7 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:46.544478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1ccc-712a-47e3-89e9-a0be39c1d6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:46.544751 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a1ccc-712a-47e3-89e9-a0be39c1d6a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:46.545906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a1ccc-712a-47e3-89e9-a0be39c1d6a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:46.547334 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a1ccc-712a-47e3-89e9-a0be39c1d6a7 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:46.548941 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 566/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:46.554663 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b2fe4-878d-4576-9d4b-0c45e064eea8 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:46.652232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b2fe4-878d-4576-9d4b-0c45e064eea8 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:46.683382 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7e556-7bb2-4fa0-a173-a8f9cd2c2e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:46.683974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7e556-7bb2-4fa0-a173-a8f9cd2c2e41 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:46.684299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7e556-7bb2-4fa0-a173-a8f9cd2c2e41 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:46.684585 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7e556-7bb2-4fa0-a173-a8f9cd2c2e41 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:46.685801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7e556-7bb2-4fa0-a173-a8f9cd2c2e41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:46.687234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7e556-7bb2-4fa0-a173-a8f9cd2c2e41 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:46.828399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 568/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:21:46 2022] POST /identity/v3/projects => generated 311 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:21:49.130149 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e0182-8e00-43bd-ac44-ae0d08ef94a1 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:49.130652 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e0182-8e00-43bd-ac44-ae0d08ef94a1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:49.130757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e0182-8e00-43bd-ac44-ae0d08ef94a1 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:49.132499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 567/1135] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:49.140125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cbf0b-1c65-4731-9543-0486f0f5983f None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:49.140125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cbf0b-1c65-4731-9543-0486f0f5983f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:49.140125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cbf0b-1c65-4731-9543-0486f0f5983f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:49.156325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-3f3cbf0b-1c65-4731-9543-0486f0f5983f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:49.157493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3f3cbf0b-1c65-4731-9543-0486f0f5983f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:49.219570 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 569/1136] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:49.244137 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e0182-8e00-43bd-ac44-ae0d08ef94a1 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:49.338045 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e0182-8e00-43bd-ac44-ae0d08ef94a1 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:49.369438 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c6632-53ae-4f46-9bad-90fa6524d4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:49.370190 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c6632-53ae-4f46-9bad-90fa6524d4e0 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:49.370468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c6632-53ae-4f46-9bad-90fa6524d4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:49.370735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c6632-53ae-4f46-9bad-90fa6524d4e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:49.371883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c6632-53ae-4f46-9bad-90fa6524d4e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:49.373861 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c6632-53ae-4f46-9bad-90fa6524d4e0 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:49.375409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 568/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:21:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:49.380809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cbf0b-1c65-4731-9543-0486f0f5983f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:49.471936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cbf0b-1c65-4731-9543-0486f0f5983f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:49.503562 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfbf4c-0583-4eca-9f1e-384aca7afb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:49.504239 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfbf4c-0583-4eca-9f1e-384aca7afb5b None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:49.504529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfbf4c-0583-4eca-9f1e-384aca7afb5b None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:49.504809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfbf4c-0583-4eca-9f1e-384aca7afb5b None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:49.505510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfbf4c-0583-4eca-9f1e-384aca7afb5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:49.506927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfbf4c-0583-4eca-9f1e-384aca7afb5b None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:49.620175 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 570/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:21:49 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:21:51.926212 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2268-b6fc-4e46-8333-5899f094250d None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:51.926733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2268-b6fc-4e46-8333-5899f094250d None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:51.926733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2268-b6fc-4e46-8333-5899f094250d None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:51.928552 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 569/1139] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:51.933648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afdd4-d7a1-4a3c-95ba-5d110e9b0cf4 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:51.934027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afdd4-d7a1-4a3c-95ba-5d110e9b0cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:51.934203 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afdd4-d7a1-4a3c-95ba-5d110e9b0cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:51.951778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a17afdd4-d7a1-4a3c-95ba-5d110e9b0cf4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:51.952966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a17afdd4-d7a1-4a3c-95ba-5d110e9b0cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:52.014500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 571/1140] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:52.036751 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d2268-b6fc-4e46-8333-5899f094250d None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:52.132129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d2268-b6fc-4e46-8333-5899f094250d None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:52.163301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0e853-e103-4b45-811d-382098c893ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:52.164078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0e853-e103-4b45-811d-382098c893ac None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:52.164387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0e853-e103-4b45-811d-382098c893ac None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:52.164660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0e853-e103-4b45-811d-382098c893ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:52.174694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0e853-e103-4b45-811d-382098c893ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:21:52.181509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-27d0e853-e103-4b45-811d-382098c893ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:21:52.182621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 570/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:21:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:52.189459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17afdd4-d7a1-4a3c-95ba-5d110e9b0cf4 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:52.280897 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17afdd4-d7a1-4a3c-95ba-5d110e9b0cf4 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:52.320993 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3617168-1070-447e-9e1b-9f488a3044e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:52.322106 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617168-1070-447e-9e1b-9f488a3044e5 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:52.322597 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617168-1070-447e-9e1b-9f488a3044e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:52.323088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3617168-1070-447e-9e1b-9f488a3044e5 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:52.324455 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3617168-1070-447e-9e1b-9f488a3044e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:52.324993 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3617168-1070-447e-9e1b-9f488a3044e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:52.326829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3617168-1070-447e-9e1b-9f488a3044e5 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:52.336706 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 572/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:21:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:52.343488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0e853-e103-4b45-811d-382098c893ac None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:52.447207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0e853-e103-4b45-811d-382098c893ac None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:52.479257 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6277e-94f4-49fa-96df-2ff1fb7de3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:52.480115 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6277e-94f4-49fa-96df-2ff1fb7de3cf None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:52.480559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6277e-94f4-49fa-96df-2ff1fb7de3cf None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:52.480879 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6277e-94f4-49fa-96df-2ff1fb7de3cf None admin] PATH_INFO: `/v3/users/4905fb8dde4e439194baafd932b55bc5` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:52.497866 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6277e-94f4-49fa-96df-2ff1fb7de3cf None admin] RBAC: Authorizing `identity:get_user(user_id=4905fb8dde4e439194baafd932b55bc5)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:52.499324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6277e-94f4-49fa-96df-2ff1fb7de3cf None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:52.501038 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 571/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:21:52 2022] GET /identity/v3/users/4905fb8dde4e439194baafd932b55bc5 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:52.506729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3617168-1070-447e-9e1b-9f488a3044e5 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:52.603896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3617168-1070-447e-9e1b-9f488a3044e5 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:52.637643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae1c3c-1553-4b3d-aee8-3114e51270d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:52.638318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae1c3c-1553-4b3d-aee8-3114e51270d3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:52.638602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae1c3c-1553-4b3d-aee8-3114e51270d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:52.638887 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae1c3c-1553-4b3d-aee8-3114e51270d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:52.702204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae1c3c-1553-4b3d-aee8-3114e51270d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:52.703624 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae1c3c-1553-4b3d-aee8-3114e51270d3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:52.796238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 573/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:21:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:21:52.802315 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6277e-94f4-49fa-96df-2ff1fb7de3cf None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:52.902063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6277e-94f4-49fa-96df-2ff1fb7de3cf None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:52.935090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5512797-bc81-46b9-8430-4afa88462783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:52.935973 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5512797-bc81-46b9-8430-4afa88462783 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:52.936281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5512797-bc81-46b9-8430-4afa88462783 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:52.936553 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5512797-bc81-46b9-8430-4afa88462783 None admin] PATH_INFO: `/v3/projects/b365849c4d264d058ab062e567a932e8` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:52.937724 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5512797-bc81-46b9-8430-4afa88462783 None admin] RBAC: Authorizing `identity:get_project(project_id=b365849c4d264d058ab062e567a932e8)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:52.939139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5512797-bc81-46b9-8430-4afa88462783 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:52.940847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 572/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:21:52 2022] GET /identity/v3/projects/b365849c4d264d058ab062e567a932e8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:52.946909 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae1c3c-1553-4b3d-aee8-3114e51270d3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:53.041918 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae1c3c-1553-4b3d-aee8-3114e51270d3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:53.073899 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1f38c-1762-48ff-a809-ba86d27de4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:53.074553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1f38c-1762-48ff-a809-ba86d27de4c5 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:53.074836 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1f38c-1762-48ff-a809-ba86d27de4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:53.075112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1f38c-1762-48ff-a809-ba86d27de4c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:53.076515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1f38c-1762-48ff-a809-ba86d27de4c5 None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=b365849c4d264d058ab062e567a932e8, user.id=4905fb8dde4e439194baafd932b55bc5) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:53.076829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1f38c-1762-48ff-a809-ba86d27de4c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:53.078256 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1f38c-1762-48ff-a809-ba86d27de4c5 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:53.083435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 574/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:21:52 2022] GET /identity/v3/role_assignments?user.id=4905fb8dde4e439194baafd932b55bc5&scope.project.id=b365849c4d264d058ab062e567a932e8&role.id=24a7898c863141f1911792647b5274e3 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:55.327542 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b88c-1a94-4a84-a00b-750ad9685dee None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:55.328106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b88c-1a94-4a84-a00b-750ad9685dee None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:55.328106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460b88c-1a94-4a84-a00b-750ad9685dee None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:55.329898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 573/1147] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:55.334904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39b73c-74ed-446a-81cb-4383efc365b2 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:55.335327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39b73c-74ed-446a-81cb-4383efc365b2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:55.335466 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39b73c-74ed-446a-81cb-4383efc365b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:55.354280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-0c39b73c-74ed-446a-81cb-4383efc365b2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:55.355474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0c39b73c-74ed-446a-81cb-4383efc365b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:55.423285 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 575/1148] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:21:55.445790 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460b88c-1a94-4a84-a00b-750ad9685dee None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:55.539737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460b88c-1a94-4a84-a00b-750ad9685dee None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:55.571022 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf29152-ab0a-4905-af9f-c31c513ee0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:55.571794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf29152-ab0a-4905-af9f-c31c513ee0bb None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:55.572076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf29152-ab0a-4905-af9f-c31c513ee0bb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:55.572385 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf29152-ab0a-4905-af9f-c31c513ee0bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:55.581792 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf29152-ab0a-4905-af9f-c31c513ee0bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:21:55.588839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-ebf29152-ab0a-4905-af9f-c31c513ee0bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:21:55.589963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 574/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:21:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:55.596209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39b73c-74ed-446a-81cb-4383efc365b2 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:55.692883 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39b73c-74ed-446a-81cb-4383efc365b2 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:55.724443 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e8dd7-f8b2-4dfb-8694-fea74a2281e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:55.725091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e8dd7-f8b2-4dfb-8694-fea74a2281e1 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:55.725371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e8dd7-f8b2-4dfb-8694-fea74a2281e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:55.725645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e8dd7-f8b2-4dfb-8694-fea74a2281e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:55.726377 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e8dd7-f8b2-4dfb-8694-fea74a2281e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:55.726680 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e8dd7-f8b2-4dfb-8694-fea74a2281e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:55.728031 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e8dd7-f8b2-4dfb-8694-fea74a2281e1 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:55.736398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 576/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:21:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:55.742047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf29152-ab0a-4905-af9f-c31c513ee0bb None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:55.833943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf29152-ab0a-4905-af9f-c31c513ee0bb None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:55.865034 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369fbab-dd44-4a18-acbf-9f8c3e537345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:55.865862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369fbab-dd44-4a18-acbf-9f8c3e537345 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:55.866142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369fbab-dd44-4a18-acbf-9f8c3e537345 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:55.866414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369fbab-dd44-4a18-acbf-9f8c3e537345 None admin] PATH_INFO: `/v3/users/4905fb8dde4e439194baafd932b55bc5` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:55.867566 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369fbab-dd44-4a18-acbf-9f8c3e537345 None admin] RBAC: Authorizing `identity:get_user(user_id=4905fb8dde4e439194baafd932b55bc5)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:55.869005 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369fbab-dd44-4a18-acbf-9f8c3e537345 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:55.870554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 575/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:21:55 2022] GET /identity/v3/users/4905fb8dde4e439194baafd932b55bc5 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:55.875918 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e8dd7-f8b2-4dfb-8694-fea74a2281e1 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:55.969017 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e8dd7-f8b2-4dfb-8694-fea74a2281e1 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:55.999638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f365c-7183-43fc-a4d9-13dcc4510f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:56.000491 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f365c-7183-43fc-a4d9-13dcc4510f50 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:56.000767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f365c-7183-43fc-a4d9-13dcc4510f50 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:56.001036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f365c-7183-43fc-a4d9-13dcc4510f50 None admin] PATH_INFO: `/v3/projects/b365849c4d264d058ab062e567a932e8` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:56.002186 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f365c-7183-43fc-a4d9-13dcc4510f50 None admin] RBAC: Authorizing `identity:get_project(project_id=b365849c4d264d058ab062e567a932e8)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:56.003598 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f365c-7183-43fc-a4d9-13dcc4510f50 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:56.005241 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 577/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:21:55 2022] GET /identity/v3/projects/b365849c4d264d058ab062e567a932e8 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:56.010849 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369fbab-dd44-4a18-acbf-9f8c3e537345 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:56.103108 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369fbab-dd44-4a18-acbf-9f8c3e537345 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:56.134294 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d98b44-41e6-4eb4-84dc-cef0948313f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:56.135156 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d98b44-41e6-4eb4-84dc-cef0948313f1 None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:56.135437 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d98b44-41e6-4eb4-84dc-cef0948313f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:56.135711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d98b44-41e6-4eb4-84dc-cef0948313f1 None admin] PATH_INFO: `/v3/projects/b365849c4d264d058ab062e567a932e8/users/4905fb8dde4e439194baafd932b55bc5/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:56.138250 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d98b44-41e6-4eb4-84dc-cef0948313f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b365849c4d264d058ab062e567a932e8, user_id=4905fb8dde4e439194baafd932b55bc5, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:56.139675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d98b44-41e6-4eb4-84dc-cef0948313f1 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:56.231033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 576/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:21:56 2022] PUT /identity/v3/projects/b365849c4d264d058ab062e567a932e8/users/4905fb8dde4e439194baafd932b55bc5/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:21:58.497473 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33062992-764d-4882-b75d-694e450be0b0 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:58.497982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33062992-764d-4882-b75d-694e450be0b0 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:58.497982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33062992-764d-4882-b75d-694e450be0b0 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:58.499753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 578/1154] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:21:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:21:58.504860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d82f-3da4-49fb-965b-6183630f6fe1 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:58.505238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d82f-3da4-49fb-965b-6183630f6fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:58.505417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d82f-3da4-49fb-965b-6183630f6fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:58.522712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-dfb9d82f-3da4-49fb-965b-6183630f6fe1 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:21:58.523892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-dfb9d82f-3da4-49fb-965b-6183630f6fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:21:58.588822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 577/1155] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:21:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:21:58.611880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33062992-764d-4882-b75d-694e450be0b0 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:58.829617 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33062992-764d-4882-b75d-694e450be0b0 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:58.860534 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a9deb-998e-44f4-8747-da57b53bc27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:58.861288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a9deb-998e-44f4-8747-da57b53bc27f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:58.861564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a9deb-998e-44f4-8747-da57b53bc27f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:58.861835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a9deb-998e-44f4-8747-da57b53bc27f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:58.871142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a9deb-998e-44f4-8747-da57b53bc27f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:21:58.878249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-879a9deb-998e-44f4-8747-da57b53bc27f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:21:58.879380 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 579/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:21:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:21:58.885486 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d82f-3da4-49fb-965b-6183630f6fe1 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:58.976770 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d82f-3da4-49fb-965b-6183630f6fe1 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:59.009437 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6872c-a360-41d1-b7f8-98249a92a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:59.010083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6872c-a360-41d1-b7f8-98249a92a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:59.010363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6872c-a360-41d1-b7f8-98249a92a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:59.010637 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6872c-a360-41d1-b7f8-98249a92a1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:59.011370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6872c-a360-41d1-b7f8-98249a92a1d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:59.011673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6872c-a360-41d1-b7f8-98249a92a1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:59.013083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6872c-a360-41d1-b7f8-98249a92a1d8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:59.020599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 578/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:21:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:59.026439 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a9deb-998e-44f4-8747-da57b53bc27f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:59.121430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a9deb-998e-44f4-8747-da57b53bc27f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:59.152519 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089fc69-826e-40bc-90bb-c08f08be6042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:59.154126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089fc69-826e-40bc-90bb-c08f08be6042 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:59.154406 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089fc69-826e-40bc-90bb-c08f08be6042 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:59.154675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089fc69-826e-40bc-90bb-c08f08be6042 None admin] PATH_INFO: `/v3/users/4905fb8dde4e439194baafd932b55bc5` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:59.155833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089fc69-826e-40bc-90bb-c08f08be6042 None admin] RBAC: Authorizing `identity:get_user(user_id=4905fb8dde4e439194baafd932b55bc5)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:59.157273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089fc69-826e-40bc-90bb-c08f08be6042 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:59.158873 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 580/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:21:59 2022] GET /identity/v3/users/4905fb8dde4e439194baafd932b55bc5 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:21:59.164411 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6872c-a360-41d1-b7f8-98249a92a1d8 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:59.257390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6872c-a360-41d1-b7f8-98249a92a1d8 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:59.288492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177b4f3-83d7-4a06-ae1e-150013282e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:59.289118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177b4f3-83d7-4a06-ae1e-150013282e83 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:59.289400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177b4f3-83d7-4a06-ae1e-150013282e83 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:59.289671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177b4f3-83d7-4a06-ae1e-150013282e83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:59.350997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177b4f3-83d7-4a06-ae1e-150013282e83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:59.352433 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177b4f3-83d7-4a06-ae1e-150013282e83 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:59.441954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 579/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:21:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:21:59.447584 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089fc69-826e-40bc-90bb-c08f08be6042 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:59.538432 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089fc69-826e-40bc-90bb-c08f08be6042 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:59.568640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81184688-1b4e-4c05-8083-b9afb1fbcb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:59.569461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81184688-1b4e-4c05-8083-b9afb1fbcb42 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:59.569740 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81184688-1b4e-4c05-8083-b9afb1fbcb42 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:59.570013 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81184688-1b4e-4c05-8083-b9afb1fbcb42 None admin] PATH_INFO: `/v3/projects/b365849c4d264d058ab062e567a932e8` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:59.571164 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81184688-1b4e-4c05-8083-b9afb1fbcb42 None admin] RBAC: Authorizing `identity:get_project(project_id=b365849c4d264d058ab062e567a932e8)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:59.572595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81184688-1b4e-4c05-8083-b9afb1fbcb42 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:59.574189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 581/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:21:59 2022] GET /identity/v3/projects/b365849c4d264d058ab062e567a932e8 => generated 311 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:21:59.580376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177b4f3-83d7-4a06-ae1e-150013282e83 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:21:59.670688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177b4f3-83d7-4a06-ae1e-150013282e83 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:21:59.701757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faf910-c161-4b9f-a279-0e3a5fa0477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:21:59.702330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faf910-c161-4b9f-a279-0e3a5fa0477f None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:21:59.702610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faf910-c161-4b9f-a279-0e3a5fa0477f None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:21:59.702884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faf910-c161-4b9f-a279-0e3a5fa0477f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:21:59.703693 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faf910-c161-4b9f-a279-0e3a5fa0477f None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=b365849c4d264d058ab062e567a932e8, user.id=4905fb8dde4e439194baafd932b55bc5) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:21:59.704026 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faf910-c161-4b9f-a279-0e3a5fa0477f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:21:59.705770 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faf910-c161-4b9f-a279-0e3a5fa0477f None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:21:59.711350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 580/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:21:59 2022] GET /identity/v3/role_assignments?user.id=4905fb8dde4e439194baafd932b55bc5&scope.project.id=b365849c4d264d058ab062e567a932e8&role.id=24a7898c863141f1911792647b5274e3 => generated 608 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:01.997839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242fdfb-7562-4fe0-a820-789d4c345ff0 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:01.998388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242fdfb-7562-4fe0-a820-789d4c345ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:01.998602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242fdfb-7562-4fe0-a820-789d4c345ff0 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:02.000392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 582/1162] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:22:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:22:02.005709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec66f4a-79b5-41d0-a9d6-6d8f61aab9c7 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:02.006115 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec66f4a-79b5-41d0-a9d6-6d8f61aab9c7 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:02.006280 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec66f4a-79b5-41d0-a9d6-6d8f61aab9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:02.022868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-0ec66f4a-79b5-41d0-a9d6-6d8f61aab9c7 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:22:02.024058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0ec66f4a-79b5-41d0-a9d6-6d8f61aab9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:22:02.087681 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 581/1163] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:22:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:22:02.111168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242fdfb-7562-4fe0-a820-789d4c345ff0 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:02.205423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242fdfb-7562-4fe0-a820-789d4c345ff0 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:02.237520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e6a98-29ef-4578-a8cd-0d7192e9fb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:02.238146 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6a98-29ef-4578-a8cd-0d7192e9fb1d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:02.238430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6a98-29ef-4578-a8cd-0d7192e9fb1d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:02.238706 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6a98-29ef-4578-a8cd-0d7192e9fb1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:02.302469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e6a98-29ef-4578-a8cd-0d7192e9fb1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:02.304507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e6a98-29ef-4578-a8cd-0d7192e9fb1d None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:02.401062 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 583/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:22:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:22:02.407425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec66f4a-79b5-41d0-a9d6-6d8f61aab9c7 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:02.499745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec66f4a-79b5-41d0-a9d6-6d8f61aab9c7 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:02.531972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac74e2e-efc4-4f3c-8ca7-b5204df5e953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:02.532779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74e2e-efc4-4f3c-8ca7-b5204df5e953 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:02.533063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74e2e-efc4-4f3c-8ca7-b5204df5e953 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:02.533339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74e2e-efc4-4f3c-8ca7-b5204df5e953 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:02.539700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac74e2e-efc4-4f3c-8ca7-b5204df5e953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:02.541171 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac74e2e-efc4-4f3c-8ca7-b5204df5e953 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:02.553915 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-cac74e2e-efc4-4f3c-8ca7-b5204df5e953 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 08 15:22:02.554996 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 582/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Mar 8 15:22:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:22:02.561017 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e6a98-29ef-4578-a8cd-0d7192e9fb1d None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:02.652388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e6a98-29ef-4578-a8cd-0d7192e9fb1d None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:02.683914 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293348d-d81c-47f3-9243-86a4b15e23d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:02.684586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293348d-d81c-47f3-9243-86a4b15e23d2 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:02.684873 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293348d-d81c-47f3-9243-86a4b15e23d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:02.685152 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293348d-d81c-47f3-9243-86a4b15e23d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:02.685863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293348d-d81c-47f3-9243-86a4b15e23d2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:22:02.686168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293348d-d81c-47f3-9243-86a4b15e23d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:02.687543 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293348d-d81c-47f3-9243-86a4b15e23d2 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:02.694331 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 584/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Mar 8 15:22:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:04.945653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0634d76-f627-42aa-81d4-4c9c49350b35 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:04.946226 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0634d76-f627-42aa-81d4-4c9c49350b35 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:04.946226 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0634d76-f627-42aa-81d4-4c9c49350b35 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:04.947979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 583/1167] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:22:04.955786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cb6a8-1a14-4e7a-9c36-ab15c0315ac9 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:04.956222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cb6a8-1a14-4e7a-9c36-ab15c0315ac9 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:04.956354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cb6a8-1a14-4e7a-9c36-ab15c0315ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:04.972983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-0b8cb6a8-1a14-4e7a-9c36-ab15c0315ac9 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:22:04.974139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0b8cb6a8-1a14-4e7a-9c36-ab15c0315ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:22:05.036056 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 585/1168] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:22:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:22:05.058810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0634d76-f627-42aa-81d4-4c9c49350b35 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:05.156333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0634d76-f627-42aa-81d4-4c9c49350b35 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:05.187444 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345f455-fc7f-4052-b749-f7a154ba8279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:05.188085 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345f455-fc7f-4052-b749-f7a154ba8279 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:05.188397 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345f455-fc7f-4052-b749-f7a154ba8279 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:05.188671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345f455-fc7f-4052-b749-f7a154ba8279 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:05.189412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345f455-fc7f-4052-b749-f7a154ba8279 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:05.190768 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345f455-fc7f-4052-b749-f7a154ba8279 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:05.266606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 584/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Tue Mar 8 15:22:05 2022] POST /identity/v3/domains => generated 267 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:22:07.552330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762067d-0aec-49d7-b8aa-7aca7feeebd0 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:07.552837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762067d-0aec-49d7-b8aa-7aca7feeebd0 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:07.552837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762067d-0aec-49d7-b8aa-7aca7feeebd0 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:07.554547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 586/1170] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:22:07.560258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2eead-c6b9-470c-a581-66b6e14eccc0 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:07.560634 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2eead-c6b9-470c-a581-66b6e14eccc0 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:07.560815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2eead-c6b9-470c-a581-66b6e14eccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:07.577632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ffe2eead-c6b9-470c-a581-66b6e14eccc0 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:22:07.578794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ffe2eead-c6b9-470c-a581-66b6e14eccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:22:07.640618 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 585/1171] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:22:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:22:07.663327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762067d-0aec-49d7-b8aa-7aca7feeebd0 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:07.756930 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762067d-0aec-49d7-b8aa-7aca7feeebd0 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:07.787455 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcd3a2-a1b2-40b9-b33b-575be6dde283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:07.788314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcd3a2-a1b2-40b9-b33b-575be6dde283 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:07.788596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcd3a2-a1b2-40b9-b33b-575be6dde283 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:07.788868 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcd3a2-a1b2-40b9-b33b-575be6dde283 None admin] PATH_INFO: `/v3/domains/a0d0d29f738e49cbbb02c41cafd3bdf9` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:07.799120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adcd3a2-a1b2-40b9-b33b-575be6dde283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a0d0d29f738e49cbbb02c41cafd3bdf9)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:07.800584 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adcd3a2-a1b2-40b9-b33b-575be6dde283 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:07.802148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 587/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Mar 8 15:22:07 2022] GET /identity/v3/domains/a0d0d29f738e49cbbb02c41cafd3bdf9 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:07.807737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2eead-c6b9-470c-a581-66b6e14eccc0 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:07.898552 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2eead-c6b9-470c-a581-66b6e14eccc0 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:07.929675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a570ab9-fab3-4de9-9d92-eb6cb0445a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:07.930305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a570ab9-fab3-4de9-9d92-eb6cb0445a93 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:07.930585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a570ab9-fab3-4de9-9d92-eb6cb0445a93 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:07.930858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a570ab9-fab3-4de9-9d92-eb6cb0445a93 None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:07.931556 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a570ab9-fab3-4de9-9d92-eb6cb0445a93 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:07.932992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a570ab9-fab3-4de9-9d92-eb6cb0445a93 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:08.088204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 586/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:22:07 2022] POST /identity/v3/projects => generated 361 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:22:10.376583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ebf09-cdb9-4c7d-a7a7-85c941707910 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:10.377094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ebf09-cdb9-4c7d-a7a7-85c941707910 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:10.377206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ebf09-cdb9-4c7d-a7a7-85c941707910 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:10.378885 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 588/1174] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:22:10.384172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249620e-23cf-4d3c-a26d-0c05e826dbf4 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:10.384585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249620e-23cf-4d3c-a26d-0c05e826dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:10.384737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249620e-23cf-4d3c-a26d-0c05e826dbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:10.401677 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-3249620e-23cf-4d3c-a26d-0c05e826dbf4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:22:10.402833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3249620e-23cf-4d3c-a26d-0c05e826dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:22:10.464528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 587/1175] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:22:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:22:10.489059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ebf09-cdb9-4c7d-a7a7-85c941707910 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:10.589674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ebf09-cdb9-4c7d-a7a7-85c941707910 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:10.620092 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3baad-0e67-4217-b832-bc202fbf0641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:10.621491 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3baad-0e67-4217-b832-bc202fbf0641 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:10.621774 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3baad-0e67-4217-b832-bc202fbf0641 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:10.622046 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3baad-0e67-4217-b832-bc202fbf0641 None admin] PATH_INFO: `/v3/domains/a0d0d29f738e49cbbb02c41cafd3bdf9` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:10.623213 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3baad-0e67-4217-b832-bc202fbf0641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a0d0d29f738e49cbbb02c41cafd3bdf9)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:10.624670 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3baad-0e67-4217-b832-bc202fbf0641 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:10.626222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 589/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Mar 8 15:22:10 2022] GET /identity/v3/domains/a0d0d29f738e49cbbb02c41cafd3bdf9 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:10.631881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249620e-23cf-4d3c-a26d-0c05e826dbf4 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:10.723133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249620e-23cf-4d3c-a26d-0c05e826dbf4 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:10.755000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea667a5-85d3-493c-8149-be699d3a5139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:10.755647 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea667a5-85d3-493c-8149-be699d3a5139 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:10.755926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea667a5-85d3-493c-8149-be699d3a5139 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:10.756229 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea667a5-85d3-493c-8149-be699d3a5139 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:10.756937 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea667a5-85d3-493c-8149-be699d3a5139 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:10.758356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea667a5-85d3-493c-8149-be699d3a5139 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:10.865393 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 588/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:22:10 2022] POST /identity/v3/users => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:22:13.144161 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461b786-91f3-4cef-bd82-b76535eab239 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:13.144569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461b786-91f3-4cef-bd82-b76535eab239 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:13.144724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461b786-91f3-4cef-bd82-b76535eab239 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:13.146485 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 590/1178] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:22:13.151719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af045006-6354-476a-9c38-80c412ec99c5 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:13.152746 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af045006-6354-476a-9c38-80c412ec99c5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:13.152927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af045006-6354-476a-9c38-80c412ec99c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:13.169401 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-af045006-6354-476a-9c38-80c412ec99c5 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:22:13.170550 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-af045006-6354-476a-9c38-80c412ec99c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:22:13.233006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 589/1179] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:22:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:22:13.255782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461b786-91f3-4cef-bd82-b76535eab239 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:13.350596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461b786-91f3-4cef-bd82-b76535eab239 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:13.381676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8d7fb-3991-42b8-a86a-f0f95d2e58d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:13.382440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8d7fb-3991-42b8-a86a-f0f95d2e58d8 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:13.382720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8d7fb-3991-42b8-a86a-f0f95d2e58d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:13.382991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8d7fb-3991-42b8-a86a-f0f95d2e58d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:13.393499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8d7fb-3991-42b8-a86a-f0f95d2e58d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:22:13.400042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-bde8d7fb-3991-42b8-a86a-f0f95d2e58d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:22:13.401186 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 591/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:22:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:22:13.407087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af045006-6354-476a-9c38-80c412ec99c5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:13.498834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af045006-6354-476a-9c38-80c412ec99c5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:13.530100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca9be9-6146-4f04-bfcf-db5684a38ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:13.530736 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca9be9-6146-4f04-bfcf-db5684a38ecc None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:13.531015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca9be9-6146-4f04-bfcf-db5684a38ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:13.531287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca9be9-6146-4f04-bfcf-db5684a38ecc None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:13.532016 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca9be9-6146-4f04-bfcf-db5684a38ecc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:22:13.532347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca9be9-6146-4f04-bfcf-db5684a38ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:13.533704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca9be9-6146-4f04-bfcf-db5684a38ecc None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:13.541172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 590/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:22:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:13.546698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8d7fb-3991-42b8-a86a-f0f95d2e58d8 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:13.641884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8d7fb-3991-42b8-a86a-f0f95d2e58d8 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:13.673117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258e05d-3598-4cc9-94cc-dba400fcc211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:13.673903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e05d-3598-4cc9-94cc-dba400fcc211 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:13.674185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e05d-3598-4cc9-94cc-dba400fcc211 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:13.674563 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e05d-3598-4cc9-94cc-dba400fcc211 None admin] PATH_INFO: `/v3/users/f7b76e668ee24c9fbe4f5fd88e567d60` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:13.687138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258e05d-3598-4cc9-94cc-dba400fcc211 None admin] RBAC: Authorizing `identity:get_user(user_id=f7b76e668ee24c9fbe4f5fd88e567d60)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:13.692310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258e05d-3598-4cc9-94cc-dba400fcc211 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:13.692310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 592/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:22:13 2022] GET /identity/v3/users/f7b76e668ee24c9fbe4f5fd88e567d60 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:13.695807 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca9be9-6146-4f04-bfcf-db5684a38ecc None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:13.790297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca9be9-6146-4f04-bfcf-db5684a38ecc None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:13.822968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb90c2-8ff6-4505-882b-a0b18ef8dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:13.823602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb90c2-8ff6-4505-882b-a0b18ef8dd5c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:13.823887 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb90c2-8ff6-4505-882b-a0b18ef8dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:13.824180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb90c2-8ff6-4505-882b-a0b18ef8dd5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:13.888602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb90c2-8ff6-4505-882b-a0b18ef8dd5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:13.890052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb90c2-8ff6-4505-882b-a0b18ef8dd5c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:13.981210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 591/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:22:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:22:13.987104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258e05d-3598-4cc9-94cc-dba400fcc211 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:14.078228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258e05d-3598-4cc9-94cc-dba400fcc211 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:14.110308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39dc2d3-3079-4926-b6a5-c5c47c7cceaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:14.111142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dc2d3-3079-4926-b6a5-c5c47c7cceaa None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:14.111419 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dc2d3-3079-4926-b6a5-c5c47c7cceaa None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:14.111686 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39dc2d3-3079-4926-b6a5-c5c47c7cceaa None admin] PATH_INFO: `/v3/projects/0b41fd7fbc0e47219b3bfe55e883e818` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:14.112912 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39dc2d3-3079-4926-b6a5-c5c47c7cceaa None admin] RBAC: Authorizing `identity:get_project(project_id=0b41fd7fbc0e47219b3bfe55e883e818)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:14.114284 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39dc2d3-3079-4926-b6a5-c5c47c7cceaa None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:14.115926 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 593/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:22:13 2022] GET /identity/v3/projects/0b41fd7fbc0e47219b3bfe55e883e818 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:14.122022 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb90c2-8ff6-4505-882b-a0b18ef8dd5c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:14.216022 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb90c2-8ff6-4505-882b-a0b18ef8dd5c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:14.247975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b021c-88fa-4b5d-bccf-8ffbbf7ffb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:14.248649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b021c-88fa-4b5d-bccf-8ffbbf7ffb05 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:14.249010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b021c-88fa-4b5d-bccf-8ffbbf7ffb05 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:14.249287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b021c-88fa-4b5d-bccf-8ffbbf7ffb05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:14.250098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b021c-88fa-4b5d-bccf-8ffbbf7ffb05 None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=0b41fd7fbc0e47219b3bfe55e883e818, user.id=f7b76e668ee24c9fbe4f5fd88e567d60) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:22:14.250404 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b021c-88fa-4b5d-bccf-8ffbbf7ffb05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:14.251817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b021c-88fa-4b5d-bccf-8ffbbf7ffb05 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:14.256930 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 592/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:22:14 2022] GET /identity/v3/role_assignments?user.id=f7b76e668ee24c9fbe4f5fd88e567d60&scope.project.id=0b41fd7fbc0e47219b3bfe55e883e818&role.id=24a7898c863141f1911792647b5274e3 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:16.534445 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07754c43-5be5-44c6-aabf-a659afd61a04 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:16.534949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07754c43-5be5-44c6-aabf-a659afd61a04 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:16.534949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07754c43-5be5-44c6-aabf-a659afd61a04 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:16.536677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 594/1186] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:22:16.542263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27920545-bcfc-4112-b2a9-e82548ce19bb None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:16.542684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27920545-bcfc-4112-b2a9-e82548ce19bb None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:16.542825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27920545-bcfc-4112-b2a9-e82548ce19bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:16.559670 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-27920545-bcfc-4112-b2a9-e82548ce19bb None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:22:16.560873 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-27920545-bcfc-4112-b2a9-e82548ce19bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:22:16.623270 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 593/1187] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:22:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:22:16.646177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07754c43-5be5-44c6-aabf-a659afd61a04 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:16.740613 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07754c43-5be5-44c6-aabf-a659afd61a04 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:16.771701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2210e-5b04-4e17-948b-e6fd26424ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:16.772490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2210e-5b04-4e17-948b-e6fd26424ae0 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:16.772770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2210e-5b04-4e17-948b-e6fd26424ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:16.773039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2210e-5b04-4e17-948b-e6fd26424ae0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:16.782394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2210e-5b04-4e17-948b-e6fd26424ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:22:16.789065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-39c2210e-5b04-4e17-948b-e6fd26424ae0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:22:16.790141 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 595/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:22:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:22:16.796648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27920545-bcfc-4112-b2a9-e82548ce19bb None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:16.887887 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27920545-bcfc-4112-b2a9-e82548ce19bb None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:16.920282 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d6eef-ab90-4283-8692-c8ed71b53944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:16.920930 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d6eef-ab90-4283-8692-c8ed71b53944 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:16.921212 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d6eef-ab90-4283-8692-c8ed71b53944 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:16.921488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d6eef-ab90-4283-8692-c8ed71b53944 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:16.922226 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d6eef-ab90-4283-8692-c8ed71b53944 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:22:16.922534 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d6eef-ab90-4283-8692-c8ed71b53944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:16.923908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d6eef-ab90-4283-8692-c8ed71b53944 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:16.931456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 594/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:22:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:16.937603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2210e-5b04-4e17-948b-e6fd26424ae0 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:17.036114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2210e-5b04-4e17-948b-e6fd26424ae0 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:17.068105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897c951-0e73-499c-8d20-cf9a74749f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:17.068928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897c951-0e73-499c-8d20-cf9a74749f0d None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:17.069208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897c951-0e73-499c-8d20-cf9a74749f0d None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:17.069478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897c951-0e73-499c-8d20-cf9a74749f0d None admin] PATH_INFO: `/v3/users/f7b76e668ee24c9fbe4f5fd88e567d60` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:17.070631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897c951-0e73-499c-8d20-cf9a74749f0d None admin] RBAC: Authorizing `identity:get_user(user_id=f7b76e668ee24c9fbe4f5fd88e567d60)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:17.072043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897c951-0e73-499c-8d20-cf9a74749f0d None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:17.073665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 596/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:22:16 2022] GET /identity/v3/users/f7b76e668ee24c9fbe4f5fd88e567d60 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:17.079439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d6eef-ab90-4283-8692-c8ed71b53944 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:17.173540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d6eef-ab90-4283-8692-c8ed71b53944 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:17.204312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf5178-83c2-44af-ba91-6c460cf9c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:17.205162 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf5178-83c2-44af-ba91-6c460cf9c754 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:17.205442 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf5178-83c2-44af-ba91-6c460cf9c754 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:17.205714 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf5178-83c2-44af-ba91-6c460cf9c754 None admin] PATH_INFO: `/v3/projects/0b41fd7fbc0e47219b3bfe55e883e818` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:17.206878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf5178-83c2-44af-ba91-6c460cf9c754 None admin] RBAC: Authorizing `identity:get_project(project_id=0b41fd7fbc0e47219b3bfe55e883e818)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:17.208332 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf5178-83c2-44af-ba91-6c460cf9c754 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:17.210024 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 595/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:22:17 2022] GET /identity/v3/projects/0b41fd7fbc0e47219b3bfe55e883e818 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:17.216357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897c951-0e73-499c-8d20-cf9a74749f0d None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:17.310803 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897c951-0e73-499c-8d20-cf9a74749f0d None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:17.349299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f697332-3bad-4121-875b-af03e3f6140e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:17.350112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f697332-3bad-4121-875b-af03e3f6140e None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:17.350399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f697332-3bad-4121-875b-af03e3f6140e None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:17.350678 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f697332-3bad-4121-875b-af03e3f6140e None admin] PATH_INFO: `/v3/projects/0b41fd7fbc0e47219b3bfe55e883e818/users/f7b76e668ee24c9fbe4f5fd88e567d60/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:17.352879 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f697332-3bad-4121-875b-af03e3f6140e None admin] RBAC: Authorizing `identity:create_grant(project_id=0b41fd7fbc0e47219b3bfe55e883e818, user_id=f7b76e668ee24c9fbe4f5fd88e567d60, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:17.356948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f697332-3bad-4121-875b-af03e3f6140e None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:17.436568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 597/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:22:17 2022] PUT /identity/v3/projects/0b41fd7fbc0e47219b3bfe55e883e818/users/f7b76e668ee24c9fbe4f5fd88e567d60/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:22:19.658692 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d67887-d7b8-4a6b-8648-d8c53605f57a None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:19.659206 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d67887-d7b8-4a6b-8648-d8c53605f57a None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:19.659297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d67887-d7b8-4a6b-8648-d8c53605f57a None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:19.661033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 596/1193] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:22:19.666166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a39fb7-384d-41d8-b7b8-8d6dfedaa0d2 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:19.666542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a39fb7-384d-41d8-b7b8-8d6dfedaa0d2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:19.666720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a39fb7-384d-41d8-b7b8-8d6dfedaa0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:19.683377 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-36a39fb7-384d-41d8-b7b8-8d6dfedaa0d2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:22:19.684588 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-36a39fb7-384d-41d8-b7b8-8d6dfedaa0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:22:19.747461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 598/1194] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:22:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:22:19.769826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d67887-d7b8-4a6b-8648-d8c53605f57a None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:19.864614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d67887-d7b8-4a6b-8648-d8c53605f57a None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:19.895490 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0a139-755e-4603-a13e-929534fc7480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:19.896287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0a139-755e-4603-a13e-929534fc7480 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:19.896573 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0a139-755e-4603-a13e-929534fc7480 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:19.896845 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0a139-755e-4603-a13e-929534fc7480 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:19.906712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0a139-755e-4603-a13e-929534fc7480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:22:19.913549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-9ef0a139-755e-4603-a13e-929534fc7480 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:22:19.914629 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 597/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:22:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:22:19.921073 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a39fb7-384d-41d8-b7b8-8d6dfedaa0d2 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:20.012394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a39fb7-384d-41d8-b7b8-8d6dfedaa0d2 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:20.043972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3f548-5398-4601-a3d4-09c14eb0d0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:20.044646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f548-5398-4601-a3d4-09c14eb0d0e3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:20.044930 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f548-5398-4601-a3d4-09c14eb0d0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:20.045203 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f548-5398-4601-a3d4-09c14eb0d0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:20.045934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3f548-5398-4601-a3d4-09c14eb0d0e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:22:20.046237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3f548-5398-4601-a3d4-09c14eb0d0e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:20.047598 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3f548-5398-4601-a3d4-09c14eb0d0e3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:20.055045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 599/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:22:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:20.061014 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0a139-755e-4603-a13e-929534fc7480 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:20.153867 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0a139-755e-4603-a13e-929534fc7480 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:20.185072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a03d8-4400-45af-8fdd-ff847b972d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:20.185862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a03d8-4400-45af-8fdd-ff847b972d87 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:20.186140 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a03d8-4400-45af-8fdd-ff847b972d87 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:20.186412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a03d8-4400-45af-8fdd-ff847b972d87 None admin] PATH_INFO: `/v3/users/f7b76e668ee24c9fbe4f5fd88e567d60` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:20.187573 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a03d8-4400-45af-8fdd-ff847b972d87 None admin] RBAC: Authorizing `identity:get_user(user_id=f7b76e668ee24c9fbe4f5fd88e567d60)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:20.189019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a03d8-4400-45af-8fdd-ff847b972d87 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:20.190603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 598/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Mar 8 15:22:20 2022] GET /identity/v3/users/f7b76e668ee24c9fbe4f5fd88e567d60 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:20.196220 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3f548-5398-4601-a3d4-09c14eb0d0e3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:20.288637 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3f548-5398-4601-a3d4-09c14eb0d0e3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:20.319086 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704ad9a-e493-4843-8390-a6415f4d113f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:20.319708 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704ad9a-e493-4843-8390-a6415f4d113f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:20.319986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704ad9a-e493-4843-8390-a6415f4d113f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:20.320289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704ad9a-e493-4843-8390-a6415f4d113f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:20.381636 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704ad9a-e493-4843-8390-a6415f4d113f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:20.383045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704ad9a-e493-4843-8390-a6415f4d113f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:20.471895 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 600/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:22:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:22:20.477484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a03d8-4400-45af-8fdd-ff847b972d87 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:20.574064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a03d8-4400-45af-8fdd-ff847b972d87 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:20.605285 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b02e0d-9a2b-4ed4-ab0e-e85ace94bdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:20.606380 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b02e0d-9a2b-4ed4-ab0e-e85ace94bdb8 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:20.606655 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b02e0d-9a2b-4ed4-ab0e-e85ace94bdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:20.606925 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b02e0d-9a2b-4ed4-ab0e-e85ace94bdb8 None admin] PATH_INFO: `/v3/projects/0b41fd7fbc0e47219b3bfe55e883e818` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:20.608095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b02e0d-9a2b-4ed4-ab0e-e85ace94bdb8 None admin] RBAC: Authorizing `identity:get_project(project_id=0b41fd7fbc0e47219b3bfe55e883e818)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:20.609535 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b02e0d-9a2b-4ed4-ab0e-e85ace94bdb8 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:20.611183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 599/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Mar 8 15:22:20 2022] GET /identity/v3/projects/0b41fd7fbc0e47219b3bfe55e883e818 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:22:20.617119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704ad9a-e493-4843-8390-a6415f4d113f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:22:20.711823 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704ad9a-e493-4843-8390-a6415f4d113f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:22:20.743899 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7a393-e3bc-45e0-acbb-016678ea56c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:22:20.744514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7a393-e3bc-45e0-acbb-016678ea56c8 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:22:20.744793 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7a393-e3bc-45e0-acbb-016678ea56c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:22:20.745080 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7a393-e3bc-45e0-acbb-016678ea56c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:22:20.745892 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7a393-e3bc-45e0-acbb-016678ea56c8 None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=0b41fd7fbc0e47219b3bfe55e883e818, user.id=f7b76e668ee24c9fbe4f5fd88e567d60) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:22:20.746201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7a393-e3bc-45e0-acbb-016678ea56c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:22:20.747613 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7a393-e3bc-45e0-acbb-016678ea56c8 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:22:20.753056 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 601/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:22:20 2022] GET /identity/v3/role_assignments?user.id=f7b76e668ee24c9fbe4f5fd88e567d60&scope.project.id=0b41fd7fbc0e47219b3bfe55e883e818&role.id=24a7898c863141f1911792647b5274e3 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:39.165178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cc921-c20c-4682-b062-49843588655c None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:39.165651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cc921-c20c-4682-b062-49843588655c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:39.165769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cc921-c20c-4682-b062-49843588655c None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:39.167508 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 600/1201] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:23:39.172760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243d7f-4d5a-46c0-87bb-eb0b4c0567a2 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:39.175292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243d7f-4d5a-46c0-87bb-eb0b4c0567a2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:39.175292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243d7f-4d5a-46c0-87bb-eb0b4c0567a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:39.190179 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-9b243d7f-4d5a-46c0-87bb-eb0b4c0567a2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:23:39.191356 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9b243d7f-4d5a-46c0-87bb-eb0b4c0567a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:39.254748 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 602/1202] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:23:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:23:39.278664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cc921-c20c-4682-b062-49843588655c None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:39.377299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cc921-c20c-4682-b062-49843588655c None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:39.408870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c828e-60a7-4b44-8bba-bd0bbcc920a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:39.409593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c828e-60a7-4b44-8bba-bd0bbcc920a9 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:39.409874 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c828e-60a7-4b44-8bba-bd0bbcc920a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:39.410148 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c828e-60a7-4b44-8bba-bd0bbcc920a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:39.420615 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c828e-60a7-4b44-8bba-bd0bbcc920a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:39.422082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c828e-60a7-4b44-8bba-bd0bbcc920a9 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:39.440077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-7d5c828e-60a7-4b44-8bba-bd0bbcc920a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:23:39.441296 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 601/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:39.447251 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b243d7f-4d5a-46c0-87bb-eb0b4c0567a2 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:39.543367 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b243d7f-4d5a-46c0-87bb-eb0b4c0567a2 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:39.574671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733176e-a7d2-4f7f-8367-e6e17e837ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:39.575318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733176e-a7d2-4f7f-8367-e6e17e837ff9 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:39.575599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733176e-a7d2-4f7f-8367-e6e17e837ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:39.575872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733176e-a7d2-4f7f-8367-e6e17e837ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:39.576615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733176e-a7d2-4f7f-8367-e6e17e837ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:39.576918 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733176e-a7d2-4f7f-8367-e6e17e837ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:39.578376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733176e-a7d2-4f7f-8367-e6e17e837ff9 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:39.593132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 603/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:39.601871 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c828e-60a7-4b44-8bba-bd0bbcc920a9 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:39.821317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c828e-60a7-4b44-8bba-bd0bbcc920a9 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:39.854032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47d67e-ac14-4632-82dc-7b9983f47f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:39.854892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47d67e-ac14-4632-82dc-7b9983f47f8d None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:39.855172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47d67e-ac14-4632-82dc-7b9983f47f8d None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:39.855444 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47d67e-ac14-4632-82dc-7b9983f47f8d None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:39.856175 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47d67e-ac14-4632-82dc-7b9983f47f8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:39.857575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47d67e-ac14-4632-82dc-7b9983f47f8d None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:39.999305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 602/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Mar 8 15:23:39 2022] POST /identity/v3/users => generated 251 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:23:42.314744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce2384-40e5-4ff0-89e6-19c711ed8377 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:42.315315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce2384-40e5-4ff0-89e6-19c711ed8377 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:42.315315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce2384-40e5-4ff0-89e6-19c711ed8377 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:42.317195 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 604/1206] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:23:42.322841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e089a-8e95-485e-8830-b5792907ed9e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:42.323254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e089a-8e95-485e-8830-b5792907ed9e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:42.323422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e089a-8e95-485e-8830-b5792907ed9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:42.340304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-e26e089a-8e95-485e-8830-b5792907ed9e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:23:42.341480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-e26e089a-8e95-485e-8830-b5792907ed9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:42.404206 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 603/1207] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:23:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 15:23:42.426750 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce2384-40e5-4ff0-89e6-19c711ed8377 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:42.522435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce2384-40e5-4ff0-89e6-19c711ed8377 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:42.553802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4309f4-de3f-47f6-b758-2a7c7e3bbf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:42.554580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4309f4-de3f-47f6-b758-2a7c7e3bbf0a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:42.554862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4309f4-de3f-47f6-b758-2a7c7e3bbf0a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:42.555135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4309f4-de3f-47f6-b758-2a7c7e3bbf0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:42.565815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4309f4-de3f-47f6-b758-2a7c7e3bbf0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:23:42.573143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-7a4309f4-de3f-47f6-b758-2a7c7e3bbf0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:23:42.581627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 605/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:23:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:42.581785 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e089a-8e95-485e-8830-b5792907ed9e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:42.673787 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e089a-8e95-485e-8830-b5792907ed9e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:42.705851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b056453-a270-4a9d-817a-fabe39f05239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:42.706502 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b056453-a270-4a9d-817a-fabe39f05239 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:42.706784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b056453-a270-4a9d-817a-fabe39f05239 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:42.707058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b056453-a270-4a9d-817a-fabe39f05239 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:42.707794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b056453-a270-4a9d-817a-fabe39f05239 None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:42.708097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b056453-a270-4a9d-817a-fabe39f05239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:42.709477 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b056453-a270-4a9d-817a-fabe39f05239 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:42.716955 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 604/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:23:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:42.722690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4309f4-de3f-47f6-b758-2a7c7e3bbf0a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:42.816866 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4309f4-de3f-47f6-b758-2a7c7e3bbf0a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:42.852270 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33a09a-0e42-4b1c-b7d3-b93f96dece54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:42.853003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33a09a-0e42-4b1c-b7d3-b93f96dece54 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:42.853289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33a09a-0e42-4b1c-b7d3-b93f96dece54 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:42.853564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33a09a-0e42-4b1c-b7d3-b93f96dece54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:42.866330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33a09a-0e42-4b1c-b7d3-b93f96dece54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:42.868397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33a09a-0e42-4b1c-b7d3-b93f96dece54 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:42.885141 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-3b33a09a-0e42-4b1c-b7d3-b93f96dece54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:23:42.886290 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 606/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:42.892040 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b056453-a270-4a9d-817a-fabe39f05239 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:42.986675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b056453-a270-4a9d-817a-fabe39f05239 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:43.018254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d5ad0-8cd0-49ff-9d76-04f94cb2b26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:43.018897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d5ad0-8cd0-49ff-9d76-04f94cb2b26e None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:43.019178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d5ad0-8cd0-49ff-9d76-04f94cb2b26e None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:43.019452 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d5ad0-8cd0-49ff-9d76-04f94cb2b26e None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:43.020174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d5ad0-8cd0-49ff-9d76-04f94cb2b26e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:43.020486 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d5ad0-8cd0-49ff-9d76-04f94cb2b26e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:43.021880 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d5ad0-8cd0-49ff-9d76-04f94cb2b26e None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:43.032991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 605/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:43.038930 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33a09a-0e42-4b1c-b7d3-b93f96dece54 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:43.135467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33a09a-0e42-4b1c-b7d3-b93f96dece54 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:43.168284 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55037a-2e66-4eb1-a835-7729e4e9a7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:43.169129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55037a-2e66-4eb1-a835-7729e4e9a7ee None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:43.169449 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55037a-2e66-4eb1-a835-7729e4e9a7ee None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:43.169717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55037a-2e66-4eb1-a835-7729e4e9a7ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:43.176900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55037a-2e66-4eb1-a835-7729e4e9a7ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:43.178319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55037a-2e66-4eb1-a835-7729e4e9a7ee None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:43.191944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-8c55037a-2e66-4eb1-a835-7729e4e9a7ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 15:23:43.193126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 607/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:43.198909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d5ad0-8cd0-49ff-9d76-04f94cb2b26e None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:43.292871 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d5ad0-8cd0-49ff-9d76-04f94cb2b26e None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:43.324344 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c2396-3902-4057-8278-af7dec7bd701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:43.324992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c2396-3902-4057-8278-af7dec7bd701 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:43.325274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c2396-3902-4057-8278-af7dec7bd701 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:43.325550 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c2396-3902-4057-8278-af7dec7bd701 None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:43.326371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c2396-3902-4057-8278-af7dec7bd701 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:43.326679 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c2396-3902-4057-8278-af7dec7bd701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:43.328117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c2396-3902-4057-8278-af7dec7bd701 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:43.345775 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 606/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Mar 8 15:23:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:43.351837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55037a-2e66-4eb1-a835-7729e4e9a7ee None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:43.446739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55037a-2e66-4eb1-a835-7729e4e9a7ee None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:43.479090 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef31147-5413-4f6a-8f7b-66ebe636161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:43.479709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef31147-5413-4f6a-8f7b-66ebe636161a None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:43.479997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef31147-5413-4f6a-8f7b-66ebe636161a None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:43.480311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef31147-5413-4f6a-8f7b-66ebe636161a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:43.552058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef31147-5413-4f6a-8f7b-66ebe636161a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:43.553442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef31147-5413-4f6a-8f7b-66ebe636161a None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:43.645003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 608/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:23:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:23:43.651341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c2396-3902-4057-8278-af7dec7bd701 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:43.743566 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c2396-3902-4057-8278-af7dec7bd701 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:43.779265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557835da-392b-4bc4-8fd5-3a2f6a54e372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:43.780041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557835da-392b-4bc4-8fd5-3a2f6a54e372 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:43.780349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557835da-392b-4bc4-8fd5-3a2f6a54e372 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:43.780623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557835da-392b-4bc4-8fd5-3a2f6a54e372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:43.790076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557835da-392b-4bc4-8fd5-3a2f6a54e372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:43.791500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557835da-392b-4bc4-8fd5-3a2f6a54e372 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:43.807160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-557835da-392b-4bc4-8fd5-3a2f6a54e372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:23:43.808261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 607/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:43.814005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef31147-5413-4f6a-8f7b-66ebe636161a None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:43.907340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef31147-5413-4f6a-8f7b-66ebe636161a None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:43.938706 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528426f-742d-43f5-8b69-3cedbf325dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:43.939344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528426f-742d-43f5-8b69-3cedbf325dfd None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:43.939644 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528426f-742d-43f5-8b69-3cedbf325dfd None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:43.939917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528426f-742d-43f5-8b69-3cedbf325dfd None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:43.940687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528426f-742d-43f5-8b69-3cedbf325dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:43.946490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528426f-742d-43f5-8b69-3cedbf325dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:43.946490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528426f-742d-43f5-8b69-3cedbf325dfd None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:43.953461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 609/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:43.959028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557835da-392b-4bc4-8fd5-3a2f6a54e372 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:44.053443 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557835da-392b-4bc4-8fd5-3a2f6a54e372 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:44.085506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b72e53-8fde-4c93-8bf5-0b1ad8c55353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:44.086220 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b72e53-8fde-4c93-8bf5-0b1ad8c55353 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:44.086528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b72e53-8fde-4c93-8bf5-0b1ad8c55353 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:44.086806 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b72e53-8fde-4c93-8bf5-0b1ad8c55353 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:44.093182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b72e53-8fde-4c93-8bf5-0b1ad8c55353 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:44.094633 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b72e53-8fde-4c93-8bf5-0b1ad8c55353 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:44.107785 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-e2b72e53-8fde-4c93-8bf5-0b1ad8c55353 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:23:44.111890 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 608/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:23:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:23:44.114762 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528426f-742d-43f5-8b69-3cedbf325dfd None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:44.209641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528426f-742d-43f5-8b69-3cedbf325dfd None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:44.240596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c89da-647d-4b4e-920c-f96b43d97660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:44.241257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c89da-647d-4b4e-920c-f96b43d97660 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:44.241536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c89da-647d-4b4e-920c-f96b43d97660 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:44.241806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c89da-647d-4b4e-920c-f96b43d97660 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:44.242571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c89da-647d-4b4e-920c-f96b43d97660 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:44.243381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c89da-647d-4b4e-920c-f96b43d97660 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:44.244830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c89da-647d-4b4e-920c-f96b43d97660 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:44.256169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 610/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:44.262979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b72e53-8fde-4c93-8bf5-0b1ad8c55353 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:44.357479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b72e53-8fde-4c93-8bf5-0b1ad8c55353 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:44.391552 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024633af-b599-443e-929d-9557ae8dd055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:44.392210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024633af-b599-443e-929d-9557ae8dd055 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:44.392492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024633af-b599-443e-929d-9557ae8dd055 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:44.392764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024633af-b599-443e-929d-9557ae8dd055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:44.393570 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024633af-b599-443e-929d-9557ae8dd055 None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=13471dce9430484ab46b355d1303f504) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:44.393878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024633af-b599-443e-929d-9557ae8dd055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:44.395331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024633af-b599-443e-929d-9557ae8dd055 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:44.400524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 609/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:23:44 2022] GET /identity/v3/role_assignments?user.id=13471dce9430484ab46b355d1303f504&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:46.644579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855d9ec-acaa-4c12-a3c9-88d08ee9be92 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:46.645082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855d9ec-acaa-4c12-a3c9-88d08ee9be92 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:46.645188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855d9ec-acaa-4c12-a3c9-88d08ee9be92 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:46.646892 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 611/1220] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:23:46.651944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f357c-bffc-4843-8eba-ff7ded13c007 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:46.652402 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f357c-bffc-4843-8eba-ff7ded13c007 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:46.652530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f357c-bffc-4843-8eba-ff7ded13c007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:46.669600 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-da5f357c-bffc-4843-8eba-ff7ded13c007 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:23:46.670778 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-da5f357c-bffc-4843-8eba-ff7ded13c007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:46.735137 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 610/1221] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:23:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:23:46.758027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855d9ec-acaa-4c12-a3c9-88d08ee9be92 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:46.856839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855d9ec-acaa-4c12-a3c9-88d08ee9be92 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:46.890237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26287910-240b-4778-82ff-ca5e65289090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:46.891015 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287910-240b-4778-82ff-ca5e65289090 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:46.891300 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287910-240b-4778-82ff-ca5e65289090 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:46.891665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287910-240b-4778-82ff-ca5e65289090 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:46.904139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26287910-240b-4778-82ff-ca5e65289090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:23:46.908820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-26287910-240b-4778-82ff-ca5e65289090 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:23:46.909981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 612/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:23:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:23:46.916013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f357c-bffc-4843-8eba-ff7ded13c007 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:47.009774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f357c-bffc-4843-8eba-ff7ded13c007 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:47.041782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff124f-ed1f-4bee-966b-427bc580f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:47.042419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff124f-ed1f-4bee-966b-427bc580f562 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:47.042699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff124f-ed1f-4bee-966b-427bc580f562 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:47.042973 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff124f-ed1f-4bee-966b-427bc580f562 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:47.043707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff124f-ed1f-4bee-966b-427bc580f562 None admin] RBAC: Adding query filter params (name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:47.044006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff124f-ed1f-4bee-966b-427bc580f562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:47.045376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff124f-ed1f-4bee-966b-427bc580f562 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:47.052744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 611/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:23:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:47.058988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26287910-240b-4778-82ff-ca5e65289090 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:47.155620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26287910-240b-4778-82ff-ca5e65289090 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:47.188120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4a0ab-0229-452a-9d1c-75a8811305e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:47.188928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4a0ab-0229-452a-9d1c-75a8811305e6 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:47.189207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4a0ab-0229-452a-9d1c-75a8811305e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:47.189481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4a0ab-0229-452a-9d1c-75a8811305e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:47.199338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4a0ab-0229-452a-9d1c-75a8811305e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:47.200796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4a0ab-0229-452a-9d1c-75a8811305e6 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:47.216366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-a0e4a0ab-0229-452a-9d1c-75a8811305e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:23:47.217490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 613/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:23:47.223393 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff124f-ed1f-4bee-966b-427bc580f562 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:47.316840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff124f-ed1f-4bee-966b-427bc580f562 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:47.348067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3759c2-2771-4eba-b11d-c2283a3fee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:47.348746 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3759c2-2771-4eba-b11d-c2283a3fee1a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:47.349031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3759c2-2771-4eba-b11d-c2283a3fee1a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:47.349306 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3759c2-2771-4eba-b11d-c2283a3fee1a None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:47.350018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3759c2-2771-4eba-b11d-c2283a3fee1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:47.350325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3759c2-2771-4eba-b11d-c2283a3fee1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:47.351956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3759c2-2771-4eba-b11d-c2283a3fee1a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:47.363616 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 612/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:47.369768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4a0ab-0229-452a-9d1c-75a8811305e6 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:47.462774 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4a0ab-0229-452a-9d1c-75a8811305e6 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:47.494458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c07ad-757d-485e-96fd-93053f03ab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:47.495252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c07ad-757d-485e-96fd-93053f03ab5f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:47.495512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c07ad-757d-485e-96fd-93053f03ab5f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:47.495783 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c07ad-757d-485e-96fd-93053f03ab5f None admin] PATH_INFO: `/v3/users/placement` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:47.503133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c07ad-757d-485e-96fd-93053f03ab5f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:47.504721 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c07ad-757d-485e-96fd-93053f03ab5f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:47.517620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-f82c07ad-757d-485e-96fd-93053f03ab5f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 15:23:47.518743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 614/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:47.525021 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3759c2-2771-4eba-b11d-c2283a3fee1a None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:47.623040 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3759c2-2771-4eba-b11d-c2283a3fee1a None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:47.654895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def750f-e112-43b9-8ec7-7382e688323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:47.655622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def750f-e112-43b9-8ec7-7382e688323c None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:47.655816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def750f-e112-43b9-8ec7-7382e688323c None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:47.656090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def750f-e112-43b9-8ec7-7382e688323c None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:47.656937 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def750f-e112-43b9-8ec7-7382e688323c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:47.657241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def750f-e112-43b9-8ec7-7382e688323c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:47.658660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def750f-e112-43b9-8ec7-7382e688323c None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:47.675383 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 613/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Mar 8 15:23:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:47.680992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c07ad-757d-485e-96fd-93053f03ab5f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:47.776820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c07ad-757d-485e-96fd-93053f03ab5f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:47.808846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65ba42-e494-45c6-9402-83e6728101ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:47.809622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65ba42-e494-45c6-9402-83e6728101ed None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:47.809897 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65ba42-e494-45c6-9402-83e6728101ed None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:47.810174 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65ba42-e494-45c6-9402-83e6728101ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:47.820243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65ba42-e494-45c6-9402-83e6728101ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:47.822194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65ba42-e494-45c6-9402-83e6728101ed None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:47.838472 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-af65ba42-e494-45c6-9402-83e6728101ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:23:47.839601 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 615/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:47.845442 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def750f-e112-43b9-8ec7-7382e688323c None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:47.940001 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def750f-e112-43b9-8ec7-7382e688323c None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:47.973253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82804008-396e-411d-8dcb-cc41d7496dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:47.973909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82804008-396e-411d-8dcb-cc41d7496dec None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:47.974194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82804008-396e-411d-8dcb-cc41d7496dec None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:47.974474 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82804008-396e-411d-8dcb-cc41d7496dec None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:47.975190 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82804008-396e-411d-8dcb-cc41d7496dec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:47.975497 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82804008-396e-411d-8dcb-cc41d7496dec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:47.977174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82804008-396e-411d-8dcb-cc41d7496dec None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:47.987992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 614/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:47.993662 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65ba42-e494-45c6-9402-83e6728101ed None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:48.087787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65ba42-e494-45c6-9402-83e6728101ed None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:48.118554 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea70da-ff0f-4d2b-b24e-68aa1cfee18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:48.119352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea70da-ff0f-4d2b-b24e-68aa1cfee18b None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:48.119632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea70da-ff0f-4d2b-b24e-68aa1cfee18b None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:48.119905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea70da-ff0f-4d2b-b24e-68aa1cfee18b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:48.126188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea70da-ff0f-4d2b-b24e-68aa1cfee18b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:48.127608 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea70da-ff0f-4d2b-b24e-68aa1cfee18b None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:48.140948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-90ea70da-ff0f-4d2b-b24e-68aa1cfee18b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:23:48.142129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 616/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:23:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:23:48.147934 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82804008-396e-411d-8dcb-cc41d7496dec None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:48.244443 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82804008-396e-411d-8dcb-cc41d7496dec None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:48.277350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520336b-8340-4a52-8d18-7c87df892899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:48.278011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520336b-8340-4a52-8d18-7c87df892899 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:48.278293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520336b-8340-4a52-8d18-7c87df892899 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:48.278634 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520336b-8340-4a52-8d18-7c87df892899 None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:48.279417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520336b-8340-4a52-8d18-7c87df892899 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:48.279725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520336b-8340-4a52-8d18-7c87df892899 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:48.281191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520336b-8340-4a52-8d18-7c87df892899 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:48.294590 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 615/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:23:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:48.300451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea70da-ff0f-4d2b-b24e-68aa1cfee18b None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:48.396005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea70da-ff0f-4d2b-b24e-68aa1cfee18b None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:48.428687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555b358-7ee7-4254-9157-46109b92efda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:48.429574 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555b358-7ee7-4254-9157-46109b92efda None admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:48.429837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555b358-7ee7-4254-9157-46109b92efda None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:48.430108 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555b358-7ee7-4254-9157-46109b92efda None admin] PATH_INFO: `/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/13471dce9430484ab46b355d1303f504/roles/40ab2eed29104ad783efc00ea49ea5d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:48.444295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555b358-7ee7-4254-9157-46109b92efda None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdaa0405e224334ac42dc4cde1c01c5, user_id=13471dce9430484ab46b355d1303f504, role_id=40ab2eed29104ad783efc00ea49ea5d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:48.445796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555b358-7ee7-4254-9157-46109b92efda None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:48.589718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 617/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:23:48 2022] PUT /identity/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/13471dce9430484ab46b355d1303f504/roles/40ab2eed29104ad783efc00ea49ea5d0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:23:50.864219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8bd68-853e-4dd0-8cb3-32c93bb6b141 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:50.864774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8bd68-853e-4dd0-8cb3-32c93bb6b141 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:50.864774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8bd68-853e-4dd0-8cb3-32c93bb6b141 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:50.866627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 616/1233] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:23:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:23:50.872479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42100d9c-5b5c-476a-b76d-104ac895594e None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:50.872928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42100d9c-5b5c-476a-b76d-104ac895594e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:50.873034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42100d9c-5b5c-476a-b76d-104ac895594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:50.888979 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-42100d9c-5b5c-476a-b76d-104ac895594e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:23:50.890144 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-42100d9c-5b5c-476a-b76d-104ac895594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:50.953462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 618/1234] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:23:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:23:50.977213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8bd68-853e-4dd0-8cb3-32c93bb6b141 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:51.073826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8bd68-853e-4dd0-8cb3-32c93bb6b141 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:51.106623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a18ce8-ff24-41e8-93d4-6c1b5cef710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:51.107411 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a18ce8-ff24-41e8-93d4-6c1b5cef710a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:51.107694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a18ce8-ff24-41e8-93d4-6c1b5cef710a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:51.107972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a18ce8-ff24-41e8-93d4-6c1b5cef710a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:51.117975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a18ce8-ff24-41e8-93d4-6c1b5cef710a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:23:51.124991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-23a18ce8-ff24-41e8-93d4-6c1b5cef710a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 15:23:51.126205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 617/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Mar 8 15:23:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:51.132426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42100d9c-5b5c-476a-b76d-104ac895594e None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:51.224543 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42100d9c-5b5c-476a-b76d-104ac895594e None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:51.256119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66dffc-f7e2-4272-bb4a-609ebfb27ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:51.256797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66dffc-f7e2-4272-bb4a-609ebfb27ee3 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:51.262441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66dffc-f7e2-4272-bb4a-609ebfb27ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:51.262441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66dffc-f7e2-4272-bb4a-609ebfb27ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:51.262441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66dffc-f7e2-4272-bb4a-609ebfb27ee3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:51.262441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66dffc-f7e2-4272-bb4a-609ebfb27ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:51.262441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66dffc-f7e2-4272-bb4a-609ebfb27ee3 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:51.268138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 619/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Mar 8 15:23:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:51.274060 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a18ce8-ff24-41e8-93d4-6c1b5cef710a None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:51.369935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a18ce8-ff24-41e8-93d4-6c1b5cef710a None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:51.400773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258eddf-1c6f-4dc8-85c2-cda7a9a290be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:51.401536 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258eddf-1c6f-4dc8-85c2-cda7a9a290be None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:51.401814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258eddf-1c6f-4dc8-85c2-cda7a9a290be None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:51.402083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258eddf-1c6f-4dc8-85c2-cda7a9a290be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:51.412005 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258eddf-1c6f-4dc8-85c2-cda7a9a290be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:51.413464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258eddf-1c6f-4dc8-85c2-cda7a9a290be None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:51.428781 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-d258eddf-1c6f-4dc8-85c2-cda7a9a290be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:23:51.429893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 618/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:51.436318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66dffc-f7e2-4272-bb4a-609ebfb27ee3 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:51.530093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66dffc-f7e2-4272-bb4a-609ebfb27ee3 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:51.569866 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cb7d8-36d8-4287-b144-ec7332e501ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:51.570520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cb7d8-36d8-4287-b144-ec7332e501ea None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:51.570806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cb7d8-36d8-4287-b144-ec7332e501ea None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:51.571087 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cb7d8-36d8-4287-b144-ec7332e501ea None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:51.571803 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cb7d8-36d8-4287-b144-ec7332e501ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:51.572108 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cb7d8-36d8-4287-b144-ec7332e501ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:51.573505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cb7d8-36d8-4287-b144-ec7332e501ea None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:51.584123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 620/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:51.589721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258eddf-1c6f-4dc8-85c2-cda7a9a290be None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:51.685417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258eddf-1c6f-4dc8-85c2-cda7a9a290be None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:51.716542 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c8e5e-6510-4b05-9653-6bf0671b8ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:51.717330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8e5e-6510-4b05-9653-6bf0671b8ab4 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:51.717610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8e5e-6510-4b05-9653-6bf0671b8ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:51.717883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8e5e-6510-4b05-9653-6bf0671b8ab4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:51.725057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c8e5e-6510-4b05-9653-6bf0671b8ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:51.726793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c8e5e-6510-4b05-9653-6bf0671b8ab4 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:51.740576 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-6b6c8e5e-6510-4b05-9653-6bf0671b8ab4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 15:23:51.741738 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 619/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:51.748164 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cb7d8-36d8-4287-b144-ec7332e501ea None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:51.841931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cb7d8-36d8-4287-b144-ec7332e501ea None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:51.874414 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b587cbe-5e74-4234-a859-cd015cb9a675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:51.875060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b587cbe-5e74-4234-a859-cd015cb9a675 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:51.875343 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b587cbe-5e74-4234-a859-cd015cb9a675 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:51.875619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b587cbe-5e74-4234-a859-cd015cb9a675 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:51.876474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b587cbe-5e74-4234-a859-cd015cb9a675 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:51.876782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b587cbe-5e74-4234-a859-cd015cb9a675 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:51.878204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b587cbe-5e74-4234-a859-cd015cb9a675 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:51.894395 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 621/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Mar 8 15:23:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:51.900774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c8e5e-6510-4b05-9653-6bf0671b8ab4 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:51.997096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c8e5e-6510-4b05-9653-6bf0671b8ab4 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:52.028885 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc034e-8144-4460-aa77-5e5262b7a72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:52.029515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc034e-8144-4460-aa77-5e5262b7a72a None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:52.029797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc034e-8144-4460-aa77-5e5262b7a72a None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:52.030067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc034e-8144-4460-aa77-5e5262b7a72a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:52.092709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc034e-8144-4460-aa77-5e5262b7a72a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:52.094168 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc034e-8144-4460-aa77-5e5262b7a72a None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:52.188235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 620/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:23:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 15:23:52.194134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b587cbe-5e74-4234-a859-cd015cb9a675 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:52.289696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b587cbe-5e74-4234-a859-cd015cb9a675 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:52.321450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938e0d4-42a0-4b4e-bed4-88d395a29b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:52.322806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938e0d4-42a0-4b4e-bed4-88d395a29b35 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:52.323087 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938e0d4-42a0-4b4e-bed4-88d395a29b35 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:52.323418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938e0d4-42a0-4b4e-bed4-88d395a29b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:52.333069 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938e0d4-42a0-4b4e-bed4-88d395a29b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:52.334509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938e0d4-42a0-4b4e-bed4-88d395a29b35 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:52.351395 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-9938e0d4-42a0-4b4e-bed4-88d395a29b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:23:52.352586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 622/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:52.358382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc034e-8144-4460-aa77-5e5262b7a72a None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:52.450949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc034e-8144-4460-aa77-5e5262b7a72a None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:52.483364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa6fd7-e38b-4d40-a96d-18db64abe6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:52.484039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6fd7-e38b-4d40-a96d-18db64abe6af None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:52.484349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6fd7-e38b-4d40-a96d-18db64abe6af None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:52.484626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa6fd7-e38b-4d40-a96d-18db64abe6af None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:52.485331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa6fd7-e38b-4d40-a96d-18db64abe6af None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:52.485633 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa6fd7-e38b-4d40-a96d-18db64abe6af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:52.486988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa6fd7-e38b-4d40-a96d-18db64abe6af None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:52.497590 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 621/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:52.503129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938e0d4-42a0-4b4e-bed4-88d395a29b35 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:52.597051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938e0d4-42a0-4b4e-bed4-88d395a29b35 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:52.630493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef092420-49c3-412e-b0a9-1b1870d3bdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:52.631258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef092420-49c3-412e-b0a9-1b1870d3bdc2 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:52.631537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef092420-49c3-412e-b0a9-1b1870d3bdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:52.631807 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef092420-49c3-412e-b0a9-1b1870d3bdc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:52.638933 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef092420-49c3-412e-b0a9-1b1870d3bdc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:52.640430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef092420-49c3-412e-b0a9-1b1870d3bdc2 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:52.653457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-ef092420-49c3-412e-b0a9-1b1870d3bdc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:23:52.654582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 623/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:23:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:52.660521 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa6fd7-e38b-4d40-a96d-18db64abe6af None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:52.754812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa6fd7-e38b-4d40-a96d-18db64abe6af None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:52.786934 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49620d2-df4e-4472-b255-eac816343858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:52.787581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49620d2-df4e-4472-b255-eac816343858 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:52.787864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49620d2-df4e-4472-b255-eac816343858 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:52.788138 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49620d2-df4e-4472-b255-eac816343858 None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:52.788944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49620d2-df4e-4472-b255-eac816343858 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:52.789249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49620d2-df4e-4472-b255-eac816343858 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:52.790680 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49620d2-df4e-4472-b255-eac816343858 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:52.802198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 622/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:23:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:52.808840 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef092420-49c3-412e-b0a9-1b1870d3bdc2 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:52.904451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef092420-49c3-412e-b0a9-1b1870d3bdc2 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:52.937850 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5f05b-ab3a-44e3-bcc1-2b26f1ff10c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:52.938577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5f05b-ab3a-44e3-bcc1-2b26f1ff10c2 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:52.938861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5f05b-ab3a-44e3-bcc1-2b26f1ff10c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:52.939133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5f05b-ab3a-44e3-bcc1-2b26f1ff10c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:52.939990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5f05b-ab3a-44e3-bcc1-2b26f1ff10c2 None admin] RBAC: Adding query filter params (role.id=40ab2eed29104ad783efc00ea49ea5d0, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=13471dce9430484ab46b355d1303f504) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:52.940388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5f05b-ab3a-44e3-bcc1-2b26f1ff10c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:52.941821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5f05b-ab3a-44e3-bcc1-2b26f1ff10c2 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:52.948160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 624/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:23:52 2022] GET /identity/v3/role_assignments?user.id=13471dce9430484ab46b355d1303f504&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=40ab2eed29104ad783efc00ea49ea5d0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:55.391869 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0925100-b0e4-42be-9cc8-6376426d633c None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:55.392409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0925100-b0e4-42be-9cc8-6376426d633c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:55.392519 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0925100-b0e4-42be-9cc8-6376426d633c None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:55.394327 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 623/1247] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:23:55.400034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7402-be91-4491-bc21-0018d7cea342 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:55.400543 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7402-be91-4491-bc21-0018d7cea342 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:55.400669 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7402-be91-4491-bc21-0018d7cea342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:55.417687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-d39b7402-be91-4491-bc21-0018d7cea342 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:23:55.418869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d39b7402-be91-4491-bc21-0018d7cea342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:55.481972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 625/1248] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:23:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:23:55.505602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0925100-b0e4-42be-9cc8-6376426d633c None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:55.607347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0925100-b0e4-42be-9cc8-6376426d633c None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:55.639422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd42f2-f8a4-44eb-a58b-bd920d484611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:55.640232 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd42f2-f8a4-44eb-a58b-bd920d484611 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:55.640518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd42f2-f8a4-44eb-a58b-bd920d484611 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:55.640796 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd42f2-f8a4-44eb-a58b-bd920d484611 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:55.651163 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd42f2-f8a4-44eb-a58b-bd920d484611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:23:55.657976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-d9cd42f2-f8a4-44eb-a58b-bd920d484611 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:23:55.659817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 624/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:23:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:55.665180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7402-be91-4491-bc21-0018d7cea342 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:55.758621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7402-be91-4491-bc21-0018d7cea342 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:55.791242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e83b5e-d30b-4dc1-aaae-f4b7011d2b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:55.791895 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e83b5e-d30b-4dc1-aaae-f4b7011d2b94 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:55.792200 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e83b5e-d30b-4dc1-aaae-f4b7011d2b94 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:55.792479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e83b5e-d30b-4dc1-aaae-f4b7011d2b94 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:55.793222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e83b5e-d30b-4dc1-aaae-f4b7011d2b94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:55.793715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e83b5e-d30b-4dc1-aaae-f4b7011d2b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:55.795115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e83b5e-d30b-4dc1-aaae-f4b7011d2b94 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:55.802775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 626/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:23:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:55.809025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd42f2-f8a4-44eb-a58b-bd920d484611 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:55.904563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd42f2-f8a4-44eb-a58b-bd920d484611 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:55.936464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813553b1-ebf6-4d5e-a023-49d647406e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:55.937241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813553b1-ebf6-4d5e-a023-49d647406e94 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:55.937528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813553b1-ebf6-4d5e-a023-49d647406e94 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:55.937808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813553b1-ebf6-4d5e-a023-49d647406e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:55.948623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813553b1-ebf6-4d5e-a023-49d647406e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:55.950055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813553b1-ebf6-4d5e-a023-49d647406e94 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:55.965742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-813553b1-ebf6-4d5e-a023-49d647406e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:23:55.966919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 625/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:55.972787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e83b5e-d30b-4dc1-aaae-f4b7011d2b94 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:56.068615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e83b5e-d30b-4dc1-aaae-f4b7011d2b94 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:56.099771 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374906f-200f-407a-a4bd-e171279d0583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:56.100452 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374906f-200f-407a-a4bd-e171279d0583 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:56.100734 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374906f-200f-407a-a4bd-e171279d0583 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:56.101007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374906f-200f-407a-a4bd-e171279d0583 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:56.101981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374906f-200f-407a-a4bd-e171279d0583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:56.102283 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374906f-200f-407a-a4bd-e171279d0583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:56.104290 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374906f-200f-407a-a4bd-e171279d0583 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:56.116185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 627/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:56.122432 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813553b1-ebf6-4d5e-a023-49d647406e94 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:56.217603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813553b1-ebf6-4d5e-a023-49d647406e94 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:56.251674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd532c-b15a-4821-972a-a8acec9d4971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:56.252514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd532c-b15a-4821-972a-a8acec9d4971 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:56.252803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd532c-b15a-4821-972a-a8acec9d4971 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:56.253112 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd532c-b15a-4821-972a-a8acec9d4971 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:56.260595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd532c-b15a-4821-972a-a8acec9d4971 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:56.262065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd532c-b15a-4821-972a-a8acec9d4971 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:56.274997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-aedd532c-b15a-4821-972a-a8acec9d4971 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 15:23:56.276133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 626/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:56.282050 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374906f-200f-407a-a4bd-e171279d0583 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:56.377660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374906f-200f-407a-a4bd-e171279d0583 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:56.409168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ecfca-cf96-42c3-80db-6f68dc91d194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:56.409819 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ecfca-cf96-42c3-80db-6f68dc91d194 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:56.410096 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ecfca-cf96-42c3-80db-6f68dc91d194 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:56.410366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ecfca-cf96-42c3-80db-6f68dc91d194 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:56.411178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ecfca-cf96-42c3-80db-6f68dc91d194 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:56.411481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ecfca-cf96-42c3-80db-6f68dc91d194 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:56.413001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ecfca-cf96-42c3-80db-6f68dc91d194 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:56.429457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 628/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Mar 8 15:23:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:56.435194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd532c-b15a-4821-972a-a8acec9d4971 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:56.528542 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd532c-b15a-4821-972a-a8acec9d4971 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:56.559753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086d377-8886-47ee-b2bf-5fab3892b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:56.562971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086d377-8886-47ee-b2bf-5fab3892b71b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:56.562971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086d377-8886-47ee-b2bf-5fab3892b71b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:56.562971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086d377-8886-47ee-b2bf-5fab3892b71b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:56.623124 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086d377-8886-47ee-b2bf-5fab3892b71b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:56.624651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086d377-8886-47ee-b2bf-5fab3892b71b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:56.716369 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 627/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:23:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:23:56.722208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ecfca-cf96-42c3-80db-6f68dc91d194 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:56.815137 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ecfca-cf96-42c3-80db-6f68dc91d194 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:56.847438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9ce69-691a-4294-92bf-1d04139525c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:56.848238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9ce69-691a-4294-92bf-1d04139525c6 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:56.848522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9ce69-691a-4294-92bf-1d04139525c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:56.848798 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9ce69-691a-4294-92bf-1d04139525c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:56.858606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9ce69-691a-4294-92bf-1d04139525c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:56.860043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9ce69-691a-4294-92bf-1d04139525c6 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:56.876346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-1ba9ce69-691a-4294-92bf-1d04139525c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:23:56.877496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 629/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 15:23:56.883287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086d377-8886-47ee-b2bf-5fab3892b71b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:56.977135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086d377-8886-47ee-b2bf-5fab3892b71b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:57.008467 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e6b64-4a96-49a5-93d8-8243b72c7ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:57.009113 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6b64-4a96-49a5-93d8-8243b72c7ee4 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:57.009938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6b64-4a96-49a5-93d8-8243b72c7ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:57.010212 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6b64-4a96-49a5-93d8-8243b72c7ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:57.010938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e6b64-4a96-49a5-93d8-8243b72c7ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:57.011234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e6b64-4a96-49a5-93d8-8243b72c7ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:57.012673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e6b64-4a96-49a5-93d8-8243b72c7ee4 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:57.025008 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 628/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:57.031402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9ce69-691a-4294-92bf-1d04139525c6 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:57.124658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9ce69-691a-4294-92bf-1d04139525c6 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:57.157306 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c235557-905a-4f36-97ef-aeac4663850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:57.158096 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c235557-905a-4f36-97ef-aeac4663850f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:57.158376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c235557-905a-4f36-97ef-aeac4663850f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:57.158646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c235557-905a-4f36-97ef-aeac4663850f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:57.165034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c235557-905a-4f36-97ef-aeac4663850f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:57.166487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c235557-905a-4f36-97ef-aeac4663850f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:57.178905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-6c235557-905a-4f36-97ef-aeac4663850f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:23:57.180029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 630/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:57.186609 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e6b64-4a96-49a5-93d8-8243b72c7ee4 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:57.280860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e6b64-4a96-49a5-93d8-8243b72c7ee4 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:57.317077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df8b00-3181-42c9-980e-daf0cbee7cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:57.317731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df8b00-3181-42c9-980e-daf0cbee7cdb None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:57.318013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df8b00-3181-42c9-980e-daf0cbee7cdb None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:57.318289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df8b00-3181-42c9-980e-daf0cbee7cdb None admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:57.319068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df8b00-3181-42c9-980e-daf0cbee7cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:57.319371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df8b00-3181-42c9-980e-daf0cbee7cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:57.320836 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df8b00-3181-42c9-980e-daf0cbee7cdb None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:57.333027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 629/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:57.339235 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c235557-905a-4f36-97ef-aeac4663850f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:57.433200 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c235557-905a-4f36-97ef-aeac4663850f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:57.465039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfcb5b-1d50-4840-a846-b67012131079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:57.465682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfcb5b-1d50-4840-a846-b67012131079 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:57.465966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfcb5b-1d50-4840-a846-b67012131079 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:57.466242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfcb5b-1d50-4840-a846-b67012131079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:57.467063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfcb5b-1d50-4840-a846-b67012131079 None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=13471dce9430484ab46b355d1303f504) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:23:57.467374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfcb5b-1d50-4840-a846-b67012131079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:23:57.468828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfcb5b-1d50-4840-a846-b67012131079 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:23:57.473934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 631/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:23:57 2022] GET /identity/v3/role_assignments?user.id=13471dce9430484ab46b355d1303f504&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=24a7898c863141f1911792647b5274e3 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:23:59.710635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f54536-5b43-45d5-909f-c53ef55d1ca5 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:59.711192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f54536-5b43-45d5-909f-c53ef55d1ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:59.711192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f54536-5b43-45d5-909f-c53ef55d1ca5 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:59.712975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 630/1261] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:23:59.718264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba7a90-f39f-4bad-b928-15efda964237 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:59.718684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba7a90-f39f-4bad-b928-15efda964237 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:59.718938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba7a90-f39f-4bad-b928-15efda964237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:59.735932 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b4ba7a90-f39f-4bad-b928-15efda964237 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:23:59.737159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b4ba7a90-f39f-4bad-b928-15efda964237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:23:59.802396 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 632/1262] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:23:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:23:59.825844 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f54536-5b43-45d5-909f-c53ef55d1ca5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:23:59.922153 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f54536-5b43-45d5-909f-c53ef55d1ca5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:23:59.954018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d2e07-0bc4-4e9b-87ef-622674161898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:23:59.954783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d2e07-0bc4-4e9b-87ef-622674161898 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:23:59.955059 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d2e07-0bc4-4e9b-87ef-622674161898 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:23:59.955328 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d2e07-0bc4-4e9b-87ef-622674161898 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:23:59.966260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d2e07-0bc4-4e9b-87ef-622674161898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:23:59.972219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-c71d2e07-0bc4-4e9b-87ef-622674161898 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:23:59.973377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 631/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:23:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:23:59.979763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba7a90-f39f-4bad-b928-15efda964237 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:00.074005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba7a90-f39f-4bad-b928-15efda964237 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:00.105894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3556f-930f-4bbb-a0fc-d5ab9c556a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:00.106542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3556f-930f-4bbb-a0fc-d5ab9c556a51 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:00.106825 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3556f-930f-4bbb-a0fc-d5ab9c556a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:00.107097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3556f-930f-4bbb-a0fc-d5ab9c556a51 None admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:00.107829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3556f-930f-4bbb-a0fc-d5ab9c556a51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:00.108129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3556f-930f-4bbb-a0fc-d5ab9c556a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:00.109500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3556f-930f-4bbb-a0fc-d5ab9c556a51 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:00.117178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 633/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:23:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:24:00.122845 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d2e07-0bc4-4e9b-87ef-622674161898 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:00.218148 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d2e07-0bc4-4e9b-87ef-622674161898 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:00.250647 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f238e-31b9-4b46-8fe8-1dd3e99da702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:00.251434 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f238e-31b9-4b46-8fe8-1dd3e99da702 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:00.251734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f238e-31b9-4b46-8fe8-1dd3e99da702 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:00.251982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f238e-31b9-4b46-8fe8-1dd3e99da702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:00.262768 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f238e-31b9-4b46-8fe8-1dd3e99da702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:00.264231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f238e-31b9-4b46-8fe8-1dd3e99da702 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:00.279569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-378f238e-31b9-4b46-8fe8-1dd3e99da702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:24:00.281480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 632/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:24:00.286576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3556f-930f-4bbb-a0fc-d5ab9c556a51 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:00.380791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3556f-930f-4bbb-a0fc-d5ab9c556a51 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:00.413015 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2674ce-a35f-4799-a236-2f2e97de5861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:00.413670 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2674ce-a35f-4799-a236-2f2e97de5861 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:00.413954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2674ce-a35f-4799-a236-2f2e97de5861 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:00.414229 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2674ce-a35f-4799-a236-2f2e97de5861 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:00.414938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2674ce-a35f-4799-a236-2f2e97de5861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:00.415243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2674ce-a35f-4799-a236-2f2e97de5861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:00.416631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2674ce-a35f-4799-a236-2f2e97de5861 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:00.427865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 634/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:00.434129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f238e-31b9-4b46-8fe8-1dd3e99da702 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:00.527851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f238e-31b9-4b46-8fe8-1dd3e99da702 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:00.559958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956618d8-3d56-4443-ba4f-890b242c8d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:00.560776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956618d8-3d56-4443-ba4f-890b242c8d5b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:00.561055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956618d8-3d56-4443-ba4f-890b242c8d5b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:00.561323 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956618d8-3d56-4443-ba4f-890b242c8d5b None admin] PATH_INFO: `/v3/users/placement` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:00.568556 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956618d8-3d56-4443-ba4f-890b242c8d5b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:00.569986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956618d8-3d56-4443-ba4f-890b242c8d5b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:00.582699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-956618d8-3d56-4443-ba4f-890b242c8d5b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 15:24:00.583824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 633/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:24:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:24:00.589670 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2674ce-a35f-4799-a236-2f2e97de5861 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:00.682384 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2674ce-a35f-4799-a236-2f2e97de5861 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:00.713169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5feb9-07d9-4368-8dda-f1df92ae2837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:00.713813 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5feb9-07d9-4368-8dda-f1df92ae2837 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:00.714090 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5feb9-07d9-4368-8dda-f1df92ae2837 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:00.714362 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e5feb9-07d9-4368-8dda-f1df92ae2837 None admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:00.715173 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5feb9-07d9-4368-8dda-f1df92ae2837 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:00.715475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5feb9-07d9-4368-8dda-f1df92ae2837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:00.716907 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e5feb9-07d9-4368-8dda-f1df92ae2837 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:00.733664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 635/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Mar 8 15:24:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:00.739266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956618d8-3d56-4443-ba4f-890b242c8d5b None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:00.834335 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956618d8-3d56-4443-ba4f-890b242c8d5b None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:00.866080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0757029-d1e6-41cf-bb29-17b1ba4f37de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:00.866850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0757029-d1e6-41cf-bb29-17b1ba4f37de None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:00.867127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0757029-d1e6-41cf-bb29-17b1ba4f37de None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:00.867399 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0757029-d1e6-41cf-bb29-17b1ba4f37de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:00.877980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0757029-d1e6-41cf-bb29-17b1ba4f37de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:00.881242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0757029-d1e6-41cf-bb29-17b1ba4f37de None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:00.894759 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-a0757029-d1e6-41cf-bb29-17b1ba4f37de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:24:00.895890 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 634/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:24:00.902432 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5feb9-07d9-4368-8dda-f1df92ae2837 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:00.998662 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e5feb9-07d9-4368-8dda-f1df92ae2837 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:01.031191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356cc86-a610-4490-9a71-01f087f465f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:01.031842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356cc86-a610-4490-9a71-01f087f465f5 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:01.032129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356cc86-a610-4490-9a71-01f087f465f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:01.032440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356cc86-a610-4490-9a71-01f087f465f5 None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:01.033159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356cc86-a610-4490-9a71-01f087f465f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:01.033469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356cc86-a610-4490-9a71-01f087f465f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:01.034828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356cc86-a610-4490-9a71-01f087f465f5 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:01.048447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 636/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:01.052309 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0757029-d1e6-41cf-bb29-17b1ba4f37de None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:01.148604 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0757029-d1e6-41cf-bb29-17b1ba4f37de None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:01.181161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe885b8-bbce-44d6-9ed6-81a32c842ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:01.181980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe885b8-bbce-44d6-9ed6-81a32c842ab1 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:01.182258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe885b8-bbce-44d6-9ed6-81a32c842ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:01.182534 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe885b8-bbce-44d6-9ed6-81a32c842ab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:01.188920 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe885b8-bbce-44d6-9ed6-81a32c842ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:01.190389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe885b8-bbce-44d6-9ed6-81a32c842ab1 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:01.203379 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-bfe885b8-bbce-44d6-9ed6-81a32c842ab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:24:01.204538 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 635/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:24:01.210422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356cc86-a610-4490-9a71-01f087f465f5 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:01.307623 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356cc86-a610-4490-9a71-01f087f465f5 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:01.340322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c55bc1-6058-436a-a90b-b466ca22e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:01.340957 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c55bc1-6058-436a-a90b-b466ca22e874 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:01.341241 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c55bc1-6058-436a-a90b-b466ca22e874 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:01.341518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c55bc1-6058-436a-a90b-b466ca22e874 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:01.342292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c55bc1-6058-436a-a90b-b466ca22e874 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:01.342614 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c55bc1-6058-436a-a90b-b466ca22e874 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:01.344040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c55bc1-6058-436a-a90b-b466ca22e874 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:01.356119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 637/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:24:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:01.362172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe885b8-bbce-44d6-9ed6-81a32c842ab1 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:01.457632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe885b8-bbce-44d6-9ed6-81a32c842ab1 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:01.490710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c9187-da70-4c11-9210-b3c6a4bb4edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:01.491599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c9187-da70-4c11-9210-b3c6a4bb4edc None admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:01.491889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c9187-da70-4c11-9210-b3c6a4bb4edc None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:01.492194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c9187-da70-4c11-9210-b3c6a4bb4edc None admin] PATH_INFO: `/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/13471dce9430484ab46b355d1303f504/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:01.494223 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c9187-da70-4c11-9210-b3c6a4bb4edc None admin] RBAC: Authorizing `identity:create_grant(project_id=8bdaa0405e224334ac42dc4cde1c01c5, user_id=13471dce9430484ab46b355d1303f504, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:01.495658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c9187-da70-4c11-9210-b3c6a4bb4edc None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:01.550320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 636/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Mar 8 15:24:01 2022] PUT /identity/v3/projects/8bdaa0405e224334ac42dc4cde1c01c5/users/13471dce9430484ab46b355d1303f504/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:24:03.816397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c04c8-3d39-4cf6-8493-ab3d27fa1f81 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:03.816944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c04c8-3d39-4cf6-8493-ab3d27fa1f81 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:03.816944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c04c8-3d39-4cf6-8493-ab3d27fa1f81 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:03.818718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 638/1274] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:24:03.823929 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf527b-a2e0-416d-a154-25cce936a89a None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:03.824400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf527b-a2e0-416d-a154-25cce936a89a None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:03.824531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf527b-a2e0-416d-a154-25cce936a89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:03.841068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-8daf527b-a2e0-416d-a154-25cce936a89a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:24:03.842297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8daf527b-a2e0-416d-a154-25cce936a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:24:03.906164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 637/1275] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:24:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:24:03.929733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c04c8-3d39-4cf6-8493-ab3d27fa1f81 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:04.026592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c04c8-3d39-4cf6-8493-ab3d27fa1f81 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:04.058745 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe13de-e49c-4f30-b880-d96f990a4e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:04.059520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe13de-e49c-4f30-b880-d96f990a4e2f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:04.059804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe13de-e49c-4f30-b880-d96f990a4e2f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:04.060079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe13de-e49c-4f30-b880-d96f990a4e2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:04.070095 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe13de-e49c-4f30-b880-d96f990a4e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 15:24:04.077025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-6bbe13de-e49c-4f30-b880-d96f990a4e2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 15:24:04.078180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 639/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Mar 8 15:24:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:24:04.084448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf527b-a2e0-416d-a154-25cce936a89a None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:04.182877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf527b-a2e0-416d-a154-25cce936a89a None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:04.214613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfb9c1-4a58-44ec-bf6b-8f931577f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:04.215266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfb9c1-4a58-44ec-bf6b-8f931577f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:04.215548 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfb9c1-4a58-44ec-bf6b-8f931577f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:04.215861 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfb9c1-4a58-44ec-bf6b-8f931577f6b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:04.216635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfb9c1-4a58-44ec-bf6b-8f931577f6b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:04.216941 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfb9c1-4a58-44ec-bf6b-8f931577f6b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:04.218300 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfb9c1-4a58-44ec-bf6b-8f931577f6b3 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:04.226043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 638/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Mar 8 15:24:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:04.232720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe13de-e49c-4f30-b880-d96f990a4e2f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:04.326682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe13de-e49c-4f30-b880-d96f990a4e2f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:04.358094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fade34b-2f35-48c5-9f45-2cb5d3ff8422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:04.358872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fade34b-2f35-48c5-9f45-2cb5d3ff8422 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:04.359149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fade34b-2f35-48c5-9f45-2cb5d3ff8422 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:04.359419 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fade34b-2f35-48c5-9f45-2cb5d3ff8422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:04.369264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fade34b-2f35-48c5-9f45-2cb5d3ff8422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:04.370690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fade34b-2f35-48c5-9f45-2cb5d3ff8422 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:04.386510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-3fade34b-2f35-48c5-9f45-2cb5d3ff8422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:24:04.387658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 640/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:24:04.393764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfb9c1-4a58-44ec-bf6b-8f931577f6b3 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:04.488982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfb9c1-4a58-44ec-bf6b-8f931577f6b3 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:04.520427 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad32f81-7d89-45e9-ad07-f4c520683196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:04.521075 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad32f81-7d89-45e9-ad07-f4c520683196 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:04.521357 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad32f81-7d89-45e9-ad07-f4c520683196 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:04.521633 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad32f81-7d89-45e9-ad07-f4c520683196 None admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:04.522346 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad32f81-7d89-45e9-ad07-f4c520683196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:04.522653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad32f81-7d89-45e9-ad07-f4c520683196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:04.524012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad32f81-7d89-45e9-ad07-f4c520683196 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:04.535715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 639/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:24:04.541516 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fade34b-2f35-48c5-9f45-2cb5d3ff8422 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:04.634064 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fade34b-2f35-48c5-9f45-2cb5d3ff8422 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:04.665846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560b91-b4b6-409a-90af-9084502912ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:04.666621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560b91-b4b6-409a-90af-9084502912ca None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:04.666903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560b91-b4b6-409a-90af-9084502912ca None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:04.667178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560b91-b4b6-409a-90af-9084502912ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:04.674245 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7560b91-b4b6-409a-90af-9084502912ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:04.675664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7560b91-b4b6-409a-90af-9084502912ca None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:04.688984 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-a7560b91-b4b6-409a-90af-9084502912ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 15:24:04.690095 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 641/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:24:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:24:04.695908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad32f81-7d89-45e9-ad07-f4c520683196 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:04.794230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad32f81-7d89-45e9-ad07-f4c520683196 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:04.827946 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2d834-b470-4808-ab45-1b31fcb785bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:04.828642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2d834-b470-4808-ab45-1b31fcb785bc None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:04.829039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2d834-b470-4808-ab45-1b31fcb785bc None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:04.829196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2d834-b470-4808-ab45-1b31fcb785bc None admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:04.830027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2d834-b470-4808-ab45-1b31fcb785bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:04.830329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2d834-b470-4808-ab45-1b31fcb785bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:04.831766 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2d834-b470-4808-ab45-1b31fcb785bc None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:04.848739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 640/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Mar 8 15:24:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:04.854754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560b91-b4b6-409a-90af-9084502912ca None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:04.949325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560b91-b4b6-409a-90af-9084502912ca None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:04.983794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b63a2e-a77a-4a0f-9f70-a95b1295dadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:04.985891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b63a2e-a77a-4a0f-9f70-a95b1295dadd None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:04.985891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b63a2e-a77a-4a0f-9f70-a95b1295dadd None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:04.985891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b63a2e-a77a-4a0f-9f70-a95b1295dadd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:05.050323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b63a2e-a77a-4a0f-9f70-a95b1295dadd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:05.051807 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b63a2e-a77a-4a0f-9f70-a95b1295dadd None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:05.146626 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 642/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Mar 8 15:24:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 15:24:05.152409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2d834-b470-4808-ab45-1b31fcb785bc None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:05.247145 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2d834-b470-4808-ab45-1b31fcb785bc None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:05.278480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b6fa6-7ba1-4be0-987e-052fb5a576f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:05.279263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b6fa6-7ba1-4be0-987e-052fb5a576f0 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:05.279546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b6fa6-7ba1-4be0-987e-052fb5a576f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:05.279819 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b6fa6-7ba1-4be0-987e-052fb5a576f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:05.289355 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b6fa6-7ba1-4be0-987e-052fb5a576f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:05.291317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b6fa6-7ba1-4be0-987e-052fb5a576f0 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:05.307991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-cb4b6fa6-7ba1-4be0-987e-052fb5a576f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 15:24:05.309157 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 641/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:24:05.314824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b63a2e-a77a-4a0f-9f70-a95b1295dadd None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:05.409573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b63a2e-a77a-4a0f-9f70-a95b1295dadd None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:05.441722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410ae5e-b50d-44de-bcba-750768439a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:05.442370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410ae5e-b50d-44de-bcba-750768439a3f None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:05.442695 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410ae5e-b50d-44de-bcba-750768439a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:05.442970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410ae5e-b50d-44de-bcba-750768439a3f None admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:05.443681 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410ae5e-b50d-44de-bcba-750768439a3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:05.443992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410ae5e-b50d-44de-bcba-750768439a3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:05.445379 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410ae5e-b50d-44de-bcba-750768439a3f None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:05.456045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 643/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Mar 8 15:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:05.461747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b6fa6-7ba1-4be0-987e-052fb5a576f0 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:05.556918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b6fa6-7ba1-4be0-987e-052fb5a576f0 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:05.589094 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3b3e3-c82f-40f7-97e3-e488489a2ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:05.589916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3b3e3-c82f-40f7-97e3-e488489a2ba4 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:05.590196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3b3e3-c82f-40f7-97e3-e488489a2ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:05.590470 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3b3e3-c82f-40f7-97e3-e488489a2ba4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:05.596854 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3b3e3-c82f-40f7-97e3-e488489a2ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:05.598279 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3b3e3-c82f-40f7-97e3-e488489a2ba4 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:05.614588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING keystone.server.flask.application [None req-a3d3b3e3-c82f-40f7-97e3-e488489a2ba4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 15:24:05.615794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 642/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Mar 8 15:24:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:24:05.622167 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410ae5e-b50d-44de-bcba-750768439a3f None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:05.721036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410ae5e-b50d-44de-bcba-750768439a3f None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:05.752848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41539966-d114-4ddc-86c6-519ffb61d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:05.753496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41539966-d114-4ddc-86c6-519ffb61d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:05.753779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41539966-d114-4ddc-86c6-519ffb61d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:05.754054 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41539966-d114-4ddc-86c6-519ffb61d8d6 None admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:05.754828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41539966-d114-4ddc-86c6-519ffb61d8d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:05.755136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41539966-d114-4ddc-86c6-519ffb61d8d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:05.756607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41539966-d114-4ddc-86c6-519ffb61d8d6 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:05.769301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 644/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Mar 8 15:24:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:05.776379 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3b3e3-c82f-40f7-97e3-e488489a2ba4 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:05.879684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3b3e3-c82f-40f7-97e3-e488489a2ba4 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:05.915248 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a72585-c11c-4fc4-bb7d-632e07e6325b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:05.915950 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72585-c11c-4fc4-bb7d-632e07e6325b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:05.916255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72585-c11c-4fc4-bb7d-632e07e6325b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:05.916533 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72585-c11c-4fc4-bb7d-632e07e6325b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:05.917377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72585-c11c-4fc4-bb7d-632e07e6325b None admin] RBAC: Adding query filter params (role.id=24a7898c863141f1911792647b5274e3, scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5, user.id=13471dce9430484ab46b355d1303f504) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:05.917688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72585-c11c-4fc4-bb7d-632e07e6325b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:05.919160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72585-c11c-4fc4-bb7d-632e07e6325b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:05.925683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 643/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Mar 8 15:24:05 2022] GET /identity/v3/role_assignments?user.id=13471dce9430484ab46b355d1303f504&scope.project.id=8bdaa0405e224334ac42dc4cde1c01c5&role.id=24a7898c863141f1911792647b5274e3 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:08.262460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eb2ab-2133-42dd-8752-173aa4aea392 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:08.263019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eb2ab-2133-42dd-8752-173aa4aea392 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:08.263110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6eb2ab-2133-42dd-8752-173aa4aea392 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:08.264838 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 645/1288] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:24:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:24:08.270003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927daba5-cf83-4877-9c75-6348211ed0aa None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:08.270387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927daba5-cf83-4877-9c75-6348211ed0aa None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:08.270560 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927daba5-cf83-4877-9c75-6348211ed0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:08.287076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-927daba5-cf83-4877-9c75-6348211ed0aa None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:24:08.289389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-927daba5-cf83-4877-9c75-6348211ed0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:24:08.352269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 644/1289] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:24:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:24:08.375412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eb2ab-2133-42dd-8752-173aa4aea392 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:08.471752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6eb2ab-2133-42dd-8752-173aa4aea392 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:08.503644 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd752b-3964-48f4-b8d2-137ba0b63f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:08.504456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd752b-3964-48f4-b8d2-137ba0b63f44 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:08.504735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd752b-3964-48f4-b8d2-137ba0b63f44 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:08.505009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd752b-3964-48f4-b8d2-137ba0b63f44 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:08.505647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd752b-3964-48f4-b8d2-137ba0b63f44 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:08.507029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd752b-3964-48f4-b8d2-137ba0b63f44 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:08.517742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-2bcd752b-3964-48f4-b8d2-137ba0b63f44 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 15:24:08.518904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 646/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Mar 8 15:24:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:24:08.525463 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927daba5-cf83-4877-9c75-6348211ed0aa None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:08.617587 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927daba5-cf83-4877-9c75-6348211ed0aa None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:08.649261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d28324-f3b7-455d-be10-ea7469118a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:08.649906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d28324-f3b7-455d-be10-ea7469118a16 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:08.650715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d28324-f3b7-455d-be10-ea7469118a16 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:08.650990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d28324-f3b7-455d-be10-ea7469118a16 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:08.651683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d28324-f3b7-455d-be10-ea7469118a16 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:08.651986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d28324-f3b7-455d-be10-ea7469118a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:08.653379 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d28324-f3b7-455d-be10-ea7469118a16 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:08.657889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 645/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Mar 8 15:24:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:08.663682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd752b-3964-48f4-b8d2-137ba0b63f44 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:08.757505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd752b-3964-48f4-b8d2-137ba0b63f44 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:08.789290 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56737791-cdee-4de9-8583-7ae41effbd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:08.789936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56737791-cdee-4de9-8583-7ae41effbd83 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:08.790220 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56737791-cdee-4de9-8583-7ae41effbd83 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:08.790500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56737791-cdee-4de9-8583-7ae41effbd83 None admin] PATH_INFO: `/v3/services` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:08.791237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56737791-cdee-4de9-8583-7ae41effbd83 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:08.791545 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56737791-cdee-4de9-8583-7ae41effbd83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:08.792929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56737791-cdee-4de9-8583-7ae41effbd83 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:08.797107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 647/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Mar 8 15:24:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:24:11.069057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ed109-6470-42b5-af01-8e419ca69af1 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:11.069607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ed109-6470-42b5-af01-8e419ca69af1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:11.069607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ed109-6470-42b5-af01-8e419ca69af1 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:11.071356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 646/1293] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:24:11.076741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a31db1-de17-4873-a4c8-41b30b95d320 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:11.077180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a31db1-de17-4873-a4c8-41b30b95d320 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:11.077311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a31db1-de17-4873-a4c8-41b30b95d320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:11.094803 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-d6a31db1-de17-4873-a4c8-41b30b95d320 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:24:11.095995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d6a31db1-de17-4873-a4c8-41b30b95d320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:24:11.159451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 648/1294] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:24:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:24:11.183006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ed109-6470-42b5-af01-8e419ca69af1 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:11.278017 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ed109-6470-42b5-af01-8e419ca69af1 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:11.310311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af9410-761c-421e-b33f-2e2236cbe6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:11.310956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af9410-761c-421e-b33f-2e2236cbe6e7 None admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:11.311238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af9410-761c-421e-b33f-2e2236cbe6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:11.311512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af9410-761c-421e-b33f-2e2236cbe6e7 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:11.312259 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af9410-761c-421e-b33f-2e2236cbe6e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:11.313617 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af9410-761c-421e-b33f-2e2236cbe6e7 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:11.374733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 647/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Mar 8 15:24:11 2022] POST /identity/v3/services => generated 246 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:24:13.666330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf4cce-ee5d-4aaf-aa2b-280b859a4e54 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:13.666859 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf4cce-ee5d-4aaf-aa2b-280b859a4e54 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:13.666951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf4cce-ee5d-4aaf-aa2b-280b859a4e54 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:13.668688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 649/1296] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:24:13.673817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a88e53-943a-4722-9c2b-83b0d29291b9 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:13.674488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a88e53-943a-4722-9c2b-83b0d29291b9 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:13.674488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a88e53-943a-4722-9c2b-83b0d29291b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:13.691161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-43a88e53-943a-4722-9c2b-83b0d29291b9 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:24:13.692419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-43a88e53-943a-4722-9c2b-83b0d29291b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:24:13.761041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 648/1297] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:24:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:24:13.783517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf4cce-ee5d-4aaf-aa2b-280b859a4e54 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:13.878934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf4cce-ee5d-4aaf-aa2b-280b859a4e54 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:13.910571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec2f5a-63cb-41a2-95ac-9689b05b7f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:13.911341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2f5a-63cb-41a2-95ac-9689b05b7f12 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:13.911622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2f5a-63cb-41a2-95ac-9689b05b7f12 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:13.911893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2f5a-63cb-41a2-95ac-9689b05b7f12 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:13.912601 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec2f5a-63cb-41a2-95ac-9689b05b7f12 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:13.913961 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec2f5a-63cb-41a2-95ac-9689b05b7f12 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:13.924421 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-37ec2f5a-63cb-41a2-95ac-9689b05b7f12 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 15:24:13.925527 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 650/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Mar 8 15:24:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:24:13.932066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a88e53-943a-4722-9c2b-83b0d29291b9 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:14.025985 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a88e53-943a-4722-9c2b-83b0d29291b9 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:14.059044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae12a44-e96c-40dc-bff9-c5288abf8b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:14.059700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12a44-e96c-40dc-bff9-c5288abf8b73 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:14.059986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12a44-e96c-40dc-bff9-c5288abf8b73 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:14.060296 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae12a44-e96c-40dc-bff9-c5288abf8b73 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:14.061001 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae12a44-e96c-40dc-bff9-c5288abf8b73 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:14.061331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae12a44-e96c-40dc-bff9-c5288abf8b73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:14.062761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae12a44-e96c-40dc-bff9-c5288abf8b73 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:14.067725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 649/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Mar 8 15:24:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:14.073793 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec2f5a-63cb-41a2-95ac-9689b05b7f12 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:14.170077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec2f5a-63cb-41a2-95ac-9689b05b7f12 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:14.202060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dddecb-12a2-45d1-941b-71afe6577d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:14.202645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dddecb-12a2-45d1-941b-71afe6577d15 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:14.202948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dddecb-12a2-45d1-941b-71afe6577d15 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:14.203226 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dddecb-12a2-45d1-941b-71afe6577d15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:14.204000 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dddecb-12a2-45d1-941b-71afe6577d15 None admin] RBAC: Adding query filter params (interface=public, service_id=755f98dc2194419498cd84a3ccde3c5d, region_id=RegionOne) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:14.204346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dddecb-12a2-45d1-941b-71afe6577d15 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:14.205696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dddecb-12a2-45d1-941b-71afe6577d15 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:14.210480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 651/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Mar 8 15:24:14 2022] GET /identity/v3/endpoints?service_id=755f98dc2194419498cd84a3ccde3c5d&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:14.216327 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae12a44-e96c-40dc-bff9-c5288abf8b73 None admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:14.310619 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae12a44-e96c-40dc-bff9-c5288abf8b73 None admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:14.341597 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c994432-4d99-46ce-bc2a-3671a605c636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:14.342237 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c994432-4d99-46ce-bc2a-3671a605c636 None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:14.342520 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c994432-4d99-46ce-bc2a-3671a605c636 None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:14.342797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c994432-4d99-46ce-bc2a-3671a605c636 None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:14.343469 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c994432-4d99-46ce-bc2a-3671a605c636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:14.344858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c994432-4d99-46ce-bc2a-3671a605c636 None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:14.351344 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 650/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Mar 8 15:24:14 2022] GET /identity/v3/services => generated 2191 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:24:16.641434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48dc70-7ecd-468a-8d0c-012e63271911 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:16.641940 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48dc70-7ecd-468a-8d0c-012e63271911 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:16.642052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48dc70-7ecd-468a-8d0c-012e63271911 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:16.643745 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 652/1302] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:24:16.648939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f169e-f6f7-4bda-8a4e-07785ba02cb3 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:16.649312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f169e-f6f7-4bda-8a4e-07785ba02cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:16.649511 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f169e-f6f7-4bda-8a4e-07785ba02cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:16.666587 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-6f8f169e-f6f7-4bda-8a4e-07785ba02cb3 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:24:16.667872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6f8f169e-f6f7-4bda-8a4e-07785ba02cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:24:16.731260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 651/1303] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:24:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 15:24:16.754146 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48dc70-7ecd-468a-8d0c-012e63271911 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:16.851054 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48dc70-7ecd-468a-8d0c-012e63271911 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:16.883474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5db8c-a2b0-4555-91f9-822b6e34e116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:16.884298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5db8c-a2b0-4555-91f9-822b6e34e116 None admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:16.885194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5db8c-a2b0-4555-91f9-822b6e34e116 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:16.885472 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5db8c-a2b0-4555-91f9-822b6e34e116 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:16.886123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5db8c-a2b0-4555-91f9-822b6e34e116 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:16.887502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5db8c-a2b0-4555-91f9-822b6e34e116 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:16.901730 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING keystone.server.flask.application [None req-29e5db8c-a2b0-4555-91f9-822b6e34e116 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 15:24:16.901730 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 653/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Mar 8 15:24:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 15:24:16.905454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f169e-f6f7-4bda-8a4e-07785ba02cb3 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:16.998970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f169e-f6f7-4bda-8a4e-07785ba02cb3 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:17.031844 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54aa0f0-d166-45b0-ad7c-77a079c3985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:17.032529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aa0f0-d166-45b0-ad7c-77a079c3985b None admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:17.032812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aa0f0-d166-45b0-ad7c-77a079c3985b None admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:17.033085 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aa0f0-d166-45b0-ad7c-77a079c3985b None admin] PATH_INFO: `/v3/services` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:17.033780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54aa0f0-d166-45b0-ad7c-77a079c3985b None admin] RBAC: Adding query filter params (name=placement) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:24:17.034088 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54aa0f0-d166-45b0-ad7c-77a079c3985b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:17.035494 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54aa0f0-d166-45b0-ad7c-77a079c3985b None admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:17.040528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 652/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Mar 8 15:24:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:24:17.047063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5db8c-a2b0-4555-91f9-822b6e34e116 None admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:24:17.143916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5db8c-a2b0-4555-91f9-822b6e34e116 None admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:24:17.176412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e013c-e73f-47d7-996f-31d9212ac152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:24:17.177002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e013c-e73f-47d7-996f-31d9212ac152 None admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:24:17.177290 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e013c-e73f-47d7-996f-31d9212ac152 None admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:24:17.177579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e013c-e73f-47d7-996f-31d9212ac152 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:24:17.178315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e013c-e73f-47d7-996f-31d9212ac152 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:24:17.179684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e013c-e73f-47d7-996f-31d9212ac152 None admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:24:17.293553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 654/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Mar 8 15:24:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:30:20.964074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e172684-c136-476b-aefe-3f160607c876 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:20.965597 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e172684-c136-476b-aefe-3f160607c876 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:20.966034 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e172684-c136-476b-aefe-3f160607c876 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:20.968002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 653/1307] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:30:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:20.973810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fe496-883f-4efd-ac10-717755c5c9be None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:20.974615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fe496-883f-4efd-ac10-717755c5c9be None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:20.975124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fe496-883f-4efd-ac10-717755c5c9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:21.063659 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-fc5fe496-883f-4efd-ac10-717755c5c9be None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:21.065306 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-fc5fe496-883f-4efd-ac10-717755c5c9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:21.280274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 655/1308] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:30:21.295370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e172684-c136-476b-aefe-3f160607c876 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:21.297563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2e172684-c136-476b-aefe-3f160607c876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:21.559870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e172684-c136-476b-aefe-3f160607c876 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:21.662792 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05b644-03c8-4aec-a59c-5901b22bdab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:21.663547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05b644-03c8-4aec-a59c-5901b22bdab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:21.663833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05b644-03c8-4aec-a59c-5901b22bdab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:21.664107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05b644-03c8-4aec-a59c-5901b22bdab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:21.664987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05b644-03c8-4aec-a59c-5901b22bdab5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:21.666773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING py.warnings [None req-8f05b644-03c8-4aec-a59c-5901b22bdab5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:30:21.666773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: warnings.warn(msg) Mar 08 15:30:21.666773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: Mar 08 15:30:21.668545 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05b644-03c8-4aec-a59c-5901b22bdab5 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:21.702101 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 654/1309] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:30:21 2022] GET /identity/v3/projects => generated 2553 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:30:24.097862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3204-26f1-45ad-bd11-b1745d5e8be9 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:24.098371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3204-26f1-45ad-bd11-b1745d5e8be9 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:24.098484 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a3204-26f1-45ad-bd11-b1745d5e8be9 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:24.100235 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 656/1310] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:30:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:24.106410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59b82e-1319-4f89-96f2-03528e45e698 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:24.106866 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59b82e-1319-4f89-96f2-03528e45e698 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:24.107137 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59b82e-1319-4f89-96f2-03528e45e698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:24.176055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-6c59b82e-1319-4f89-96f2-03528e45e698 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:24.177239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6c59b82e-1319-4f89-96f2-03528e45e698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:24.270217 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 655/1311] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:24.321195 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd8e91-70e6-4efb-b3c4-677b09bbf8af None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:24.321533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd8e91-70e6-4efb-b3c4-677b09bbf8af None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:24.321824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd8e91-70e6-4efb-b3c4-677b09bbf8af None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:24.323629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 657/1312] 10.222.0.25 () {54 vars in 964 bytes} [Tue Mar 8 15:30:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:24.329662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924981ca-e3ce-47fa-80f7-67350a8c01f1 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:24.330030 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924981ca-e3ce-47fa-80f7-67350a8c01f1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:24.330382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924981ca-e3ce-47fa-80f7-67350a8c01f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:24.404381 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-924981ca-e3ce-47fa-80f7-67350a8c01f1 None None] MFA Rules not processed for user `028d499ea279442d822c6723c367f459`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:24.405654 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-924981ca-e3ce-47fa-80f7-67350a8c01f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:24.477825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 656/1313] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Mar 8 15:30:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:24.486855 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd8e91-70e6-4efb-b3c4-677b09bbf8af None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:24.488403 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b1dd8e91-70e6-4efb-b3c4-677b09bbf8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:24.593936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd8e91-70e6-4efb-b3c4-677b09bbf8af None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:24.675680 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a285c-756e-4ee4-86b4-77c35950c2e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:24.676360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a285c-756e-4ee4-86b4-77c35950c2e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:24.676656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a285c-756e-4ee4-86b4-77c35950c2e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:24.676935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a285c-756e-4ee4-86b4-77c35950c2e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:24.678591 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-165a285c-756e-4ee4-86b4-77c35950c2e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:24.804574 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a285c-756e-4ee4-86b4-77c35950c2e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:24.806030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a285c-756e-4ee4-86b4-77c35950c2e9 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:24.823279 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 658/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:27.397170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6254b-9ba7-4dac-9769-11668706d28b None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:27.397656 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6254b-9ba7-4dac-9769-11668706d28b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:27.397765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6254b-9ba7-4dac-9769-11668706d28b None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:27.399578 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 657/1315] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:27.405587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd61484-20a1-4d15-b4d4-256a66b8357d None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:27.406026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd61484-20a1-4d15-b4d4-256a66b8357d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:27.406151 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd61484-20a1-4d15-b4d4-256a66b8357d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:27.471991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-3fd61484-20a1-4d15-b4d4-256a66b8357d None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:27.473248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3fd61484-20a1-4d15-b4d4-256a66b8357d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:27.566113 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 659/1316] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:27.603889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6254b-9ba7-4dac-9769-11668706d28b None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:27.606058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c6e6254b-9ba7-4dac-9769-11668706d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:27.709943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6254b-9ba7-4dac-9769-11668706d28b None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:27.783993 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7e4c4-8431-4cb7-a611-cf357b3de8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:27.784674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7e4c4-8431-4cb7-a611-cf357b3de8ac service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:27.784953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7e4c4-8431-4cb7-a611-cf357b3de8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:27.785225 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7e4c4-8431-4cb7-a611-cf357b3de8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:27.786859 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6fa7e4c4-8431-4cb7-a611-cf357b3de8ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:27.893787 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7e4c4-8431-4cb7-a611-cf357b3de8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:27.895226 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7e4c4-8431-4cb7-a611-cf357b3de8ac service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:27.912999 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 658/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:30.832027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93e6e-b578-4fc6-864b-34a6add1fc58 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:30.832571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93e6e-b578-4fc6-864b-34a6add1fc58 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:30.832682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93e6e-b578-4fc6-864b-34a6add1fc58 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:30.834465 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 660/1318] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:30.840477 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97685460-316c-4474-a9ad-8105a33f5904 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:30.840911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97685460-316c-4474-a9ad-8105a33f5904 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:30.841045 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97685460-316c-4474-a9ad-8105a33f5904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:30.906312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-97685460-316c-4474-a9ad-8105a33f5904 None None] MFA Rules not processed for user `3fa609439efa41e7832b839df854b004`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:30.907493 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-97685460-316c-4474-a9ad-8105a33f5904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:31.003405 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 659/1319] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:30:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:31.044924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93e6e-b578-4fc6-864b-34a6add1fc58 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:31.046484 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d7c93e6e-b578-4fc6-864b-34a6add1fc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:31.153817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93e6e-b578-4fc6-864b-34a6add1fc58 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:31.225715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59204ea1-51db-4bdf-85bf-ebe09096f6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:31.226361 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59204ea1-51db-4bdf-85bf-ebe09096f6af service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:31.226642 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59204ea1-51db-4bdf-85bf-ebe09096f6af service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:31.226920 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59204ea1-51db-4bdf-85bf-ebe09096f6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:31.228580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-59204ea1-51db-4bdf-85bf-ebe09096f6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:31.337888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59204ea1-51db-4bdf-85bf-ebe09096f6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:31.339345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59204ea1-51db-4bdf-85bf-ebe09096f6af service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:31.358161 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 661/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:34.466939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c9714-cc24-40b9-9691-09211582953f None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:34.467715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c9714-cc24-40b9-9691-09211582953f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:34.467715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c9714-cc24-40b9-9691-09211582953f None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:34.469476 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 660/1321] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:34.474872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06b6f3-034c-4e8c-bacb-e79ce0edc921 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:34.475319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06b6f3-034c-4e8c-bacb-e79ce0edc921 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:34.475408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06b6f3-034c-4e8c-bacb-e79ce0edc921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:34.536804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-9c06b6f3-034c-4e8c-bacb-e79ce0edc921 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:34.537979 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9c06b6f3-034c-4e8c-bacb-e79ce0edc921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:34.628425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 662/1322] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:30:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:30:34.667026 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c9714-cc24-40b9-9691-09211582953f None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:34.668618 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-340c9714-cc24-40b9-9691-09211582953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:34.767564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c9714-cc24-40b9-9691-09211582953f None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:34.840474 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9af4f-f589-498d-848a-1344847baccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:34.841162 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9af4f-f589-498d-848a-1344847baccf service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:34.841446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9af4f-f589-498d-848a-1344847baccf service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:34.841721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9af4f-f589-498d-848a-1344847baccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:34.843624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b1e9af4f-f589-498d-848a-1344847baccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:34.947806 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9af4f-f589-498d-848a-1344847baccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:34.949272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9af4f-f589-498d-848a-1344847baccf service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:34.966473 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 661/1323] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:38.301258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de4baf-df8f-4624-9bb5-eebd3c95e60c None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:38.301864 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de4baf-df8f-4624-9bb5-eebd3c95e60c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:38.301864 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de4baf-df8f-4624-9bb5-eebd3c95e60c None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:38.303589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 663/1324] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:38.309108 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2abc-19e7-40ff-af15-af058a1d69b0 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:38.309554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2abc-19e7-40ff-af15-af058a1d69b0 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:38.309669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2abc-19e7-40ff-af15-af058a1d69b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:38.372949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-92eb2abc-19e7-40ff-af15-af058a1d69b0 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:38.374139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-92eb2abc-19e7-40ff-af15-af058a1d69b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:38.466711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 662/1325] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:38.518369 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d1553-d566-4713-994f-25f65b8cdcfa None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:38.518665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d1553-d566-4713-994f-25f65b8cdcfa None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:38.518949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d1553-d566-4713-994f-25f65b8cdcfa None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:38.520813 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 664/1326] 10.222.0.25 () {54 vars in 964 bytes} [Tue Mar 8 15:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:38.527341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c37b1-1294-48c5-8379-3d9a8c595af9 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:38.527640 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c37b1-1294-48c5-8379-3d9a8c595af9 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:38.527918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c37b1-1294-48c5-8379-3d9a8c595af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:38.601945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-f06c37b1-1294-48c5-8379-3d9a8c595af9 None None] MFA Rules not processed for user `028d499ea279442d822c6723c367f459`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:38.603147 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f06c37b1-1294-48c5-8379-3d9a8c595af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:38.676382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 663/1327] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Mar 8 15:30:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:38.685316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d1553-d566-4713-994f-25f65b8cdcfa None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:38.686856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-783d1553-d566-4713-994f-25f65b8cdcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:38.786246 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d1553-d566-4713-994f-25f65b8cdcfa None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:38.856904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33da7e-30ac-4397-bf21-d7d2698a4fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:38.857554 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33da7e-30ac-4397-bf21-d7d2698a4fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:38.857832 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33da7e-30ac-4397-bf21-d7d2698a4fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:38.858103 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33da7e-30ac-4397-bf21-d7d2698a4fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:38.859787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2f33da7e-30ac-4397-bf21-d7d2698a4fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:38.966370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33da7e-30ac-4397-bf21-d7d2698a4fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:38.968074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33da7e-30ac-4397-bf21-d7d2698a4fc5 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:38.985109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 665/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:41.588084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b770d-fed0-4fa2-b35f-9960a6f50c08 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:41.589135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b770d-fed0-4fa2-b35f-9960a6f50c08 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:41.589247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b770d-fed0-4fa2-b35f-9960a6f50c08 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:41.590954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 664/1329] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:41.596478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8011547-1968-491f-afe6-801fd3e925b8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:41.596908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8011547-1968-491f-afe6-801fd3e925b8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:41.597050 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8011547-1968-491f-afe6-801fd3e925b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:41.659633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b8011547-1968-491f-afe6-801fd3e925b8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:41.660853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b8011547-1968-491f-afe6-801fd3e925b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:41.754346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 666/1330] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:41.789478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b770d-fed0-4fa2-b35f-9960a6f50c08 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:41.791058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6a1b770d-fed0-4fa2-b35f-9960a6f50c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:41.893275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b770d-fed0-4fa2-b35f-9960a6f50c08 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:41.964400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5ce47-4038-4b47-ae71-ba3a139da7f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:41.965047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5ce47-4038-4b47-ae71-ba3a139da7f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:41.965332 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5ce47-4038-4b47-ae71-ba3a139da7f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:41.965672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5ce47-4038-4b47-ae71-ba3a139da7f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:41.967536 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-abd5ce47-4038-4b47-ae71-ba3a139da7f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:42.076532 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5ce47-4038-4b47-ae71-ba3a139da7f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:42.077970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5ce47-4038-4b47-ae71-ba3a139da7f4 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:42.095809 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 665/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:44.449336 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2c5d4-ea76-443e-bd3a-0b7b4257a400 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:44.449854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2c5d4-ea76-443e-bd3a-0b7b4257a400 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:44.449854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2c5d4-ea76-443e-bd3a-0b7b4257a400 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:44.451580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 667/1332] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:44.457042 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026281e6-d3df-4f12-b6eb-f31eae2c6b68 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:44.457441 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026281e6-d3df-4f12-b6eb-f31eae2c6b68 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:44.457595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026281e6-d3df-4f12-b6eb-f31eae2c6b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:44.520014 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-026281e6-d3df-4f12-b6eb-f31eae2c6b68 None None] MFA Rules not processed for user `3fa609439efa41e7832b839df854b004`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:44.521217 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-026281e6-d3df-4f12-b6eb-f31eae2c6b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:44.612309 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 666/1333] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:30:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:44.649307 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2c5d4-ea76-443e-bd3a-0b7b4257a400 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:44.650963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4df2c5d4-ea76-443e-bd3a-0b7b4257a400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:44.751287 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2c5d4-ea76-443e-bd3a-0b7b4257a400 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:44.820796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e476b7c-0b2a-4734-98a3-32b702bc6243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:44.821434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e476b7c-0b2a-4734-98a3-32b702bc6243 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:44.821718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e476b7c-0b2a-4734-98a3-32b702bc6243 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:44.821988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e476b7c-0b2a-4734-98a3-32b702bc6243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:44.823648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0e476b7c-0b2a-4734-98a3-32b702bc6243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:44.933020 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e476b7c-0b2a-4734-98a3-32b702bc6243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:44.934458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e476b7c-0b2a-4734-98a3-32b702bc6243 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:44.951812 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 668/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:47.852131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b581c-bc47-4dee-a5eb-e283577af732 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:47.852643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b581c-bc47-4dee-a5eb-e283577af732 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:47.852643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b581c-bc47-4dee-a5eb-e283577af732 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:47.854959 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 667/1335] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:47.860421 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a6172-3924-49fe-bfc0-035449df1a6a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:47.860834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a6172-3924-49fe-bfc0-035449df1a6a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:47.861107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a6172-3924-49fe-bfc0-035449df1a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:47.924126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f61a6172-3924-49fe-bfc0-035449df1a6a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:47.925384 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f61a6172-3924-49fe-bfc0-035449df1a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:48.018054 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 669/1336] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:48.053654 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b581c-bc47-4dee-a5eb-e283577af732 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:48.055141 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6f9b581c-bc47-4dee-a5eb-e283577af732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:48.157246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b581c-bc47-4dee-a5eb-e283577af732 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:48.235945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425343d2-e588-47e9-bd77-38bac58f8d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:48.236632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425343d2-e588-47e9-bd77-38bac58f8d88 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:48.236922 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425343d2-e588-47e9-bd77-38bac58f8d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:48.237199 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425343d2-e588-47e9-bd77-38bac58f8d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:48.238862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-425343d2-e588-47e9-bd77-38bac58f8d88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:48.348017 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425343d2-e588-47e9-bd77-38bac58f8d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:48.349512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425343d2-e588-47e9-bd77-38bac58f8d88 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:48.367596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 668/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:50.707810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dc0f1-69f6-42b2-892b-05a999eec39f None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:50.708353 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dc0f1-69f6-42b2-892b-05a999eec39f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:50.708445 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dc0f1-69f6-42b2-892b-05a999eec39f None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:50.710189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 670/1338] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:30:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:50.715513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ba6dc-3d7b-48c1-97bd-dde6a2a0b9c0 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:50.715893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ba6dc-3d7b-48c1-97bd-dde6a2a0b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:50.716071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ba6dc-3d7b-48c1-97bd-dde6a2a0b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:50.779541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-3b5ba6dc-3d7b-48c1-97bd-dde6a2a0b9c0 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:50.780756 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3b5ba6dc-3d7b-48c1-97bd-dde6a2a0b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:50.874737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 669/1339] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:50.918210 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dc0f1-69f6-42b2-892b-05a999eec39f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:50.919728 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-839dc0f1-69f6-42b2-892b-05a999eec39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:51.020575 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dc0f1-69f6-42b2-892b-05a999eec39f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:51.098775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c53e37-257c-4e45-9ae6-4b765e4211a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:51.099432 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c53e37-257c-4e45-9ae6-4b765e4211a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:51.099718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c53e37-257c-4e45-9ae6-4b765e4211a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:51.099996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c53e37-257c-4e45-9ae6-4b765e4211a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:51.102072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b0c53e37-257c-4e45-9ae6-4b765e4211a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:51.215477 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c53e37-257c-4e45-9ae6-4b765e4211a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:51.217228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c53e37-257c-4e45-9ae6-4b765e4211a2 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:51.237835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 671/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:54.161155 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a52fa7-5d71-4337-8acb-1899317d91d5 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:54.161614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a52fa7-5d71-4337-8acb-1899317d91d5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:54.161708 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a52fa7-5d71-4337-8acb-1899317d91d5 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:54.163512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 670/1341] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:30:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:54.169346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a6cfe-9ca1-41aa-a30b-26589372f110 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:54.169742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a6cfe-9ca1-41aa-a30b-26589372f110 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:54.169902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a6cfe-9ca1-41aa-a30b-26589372f110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:54.213200 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-4e4a6cfe-9ca1-41aa-a30b-26589372f110 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:54.214388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4e4a6cfe-9ca1-41aa-a30b-26589372f110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:54.298623 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 672/1342] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:30:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:54.334888 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a52fa7-5d71-4337-8acb-1899317d91d5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:54.337047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-98a52fa7-5d71-4337-8acb-1899317d91d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:54.370699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a52fa7-5d71-4337-8acb-1899317d91d5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:54.374197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41b50c-ce6c-4178-9740-ea922fae2aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:54.374824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41b50c-ce6c-4178-9740-ea922fae2aec service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:54.375108 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41b50c-ce6c-4178-9740-ea922fae2aec service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:54.375383 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41b50c-ce6c-4178-9740-ea922fae2aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:54.384106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41b50c-ce6c-4178-9740-ea922fae2aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:54.386122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41b50c-ce6c-4178-9740-ea922fae2aec service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:54.395231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 671/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:30:58.979703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc9e03-352b-4143-ba80-4505efc7b267 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:58.980242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc9e03-352b-4143-ba80-4505efc7b267 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:58.980335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc9e03-352b-4143-ba80-4505efc7b267 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:58.982079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 673/1344] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:30:58.987262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbada64-d85a-4d37-9673-f6241c053478 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:58.987664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbada64-d85a-4d37-9673-f6241c053478 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:58.987801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbada64-d85a-4d37-9673-f6241c053478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:59.016555 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-3bbada64-d85a-4d37-9673-f6241c053478 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:30:59.017673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3bbada64-d85a-4d37-9673-f6241c053478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:30:59.026239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 672/1345] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:30:59.064784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc9e03-352b-4143-ba80-4505efc7b267 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:30:59.075823 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc9e03-352b-4143-ba80-4505efc7b267 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:30:59.079368 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6244aef-0140-4abc-82ca-2251bdce8b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:30:59.079994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6244aef-0140-4abc-82ca-2251bdce8b35 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:30:59.080318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6244aef-0140-4abc-82ca-2251bdce8b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:30:59.080598 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6244aef-0140-4abc-82ca-2251bdce8b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:30:59.089882 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6244aef-0140-4abc-82ca-2251bdce8b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:30:59.091577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6244aef-0140-4abc-82ca-2251bdce8b35 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:30:59.101119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 674/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:02.433552 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524876e-5d70-498b-85ad-83dd313a91c3 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:02.434210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524876e-5d70-498b-85ad-83dd313a91c3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:02.434210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524876e-5d70-498b-85ad-83dd313a91c3 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:02.435769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 673/1347] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:02.441043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5fe65-c0fd-4c32-80bc-c671f84a1421 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:02.441480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5fe65-c0fd-4c32-80bc-c671f84a1421 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:02.441594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5fe65-c0fd-4c32-80bc-c671f84a1421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:02.459720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-8df5fe65-c0fd-4c32-80bc-c671f84a1421 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:02.460925 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8df5fe65-c0fd-4c32-80bc-c671f84a1421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:02.468802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 675/1348] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:31:02.505470 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524876e-5d70-498b-85ad-83dd313a91c3 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:02.516821 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524876e-5d70-498b-85ad-83dd313a91c3 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:02.520399 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06740c0-2975-43af-81d2-7f832e08e200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:02.521053 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06740c0-2975-43af-81d2-7f832e08e200 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:02.521332 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06740c0-2975-43af-81d2-7f832e08e200 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:02.521607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06740c0-2975-43af-81d2-7f832e08e200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:02.533417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06740c0-2975-43af-81d2-7f832e08e200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:02.534852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06740c0-2975-43af-81d2-7f832e08e200 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:02.545048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 674/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:07.172112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bd269-a128-464b-958a-45e341e586ab None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:07.172641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bd269-a128-464b-958a-45e341e586ab None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:07.172810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bd269-a128-464b-958a-45e341e586ab None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:07.174600 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 676/1350] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:07.179957 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa626937-aa43-4272-94a6-dd229e6d6936 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:07.180481 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa626937-aa43-4272-94a6-dd229e6d6936 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:07.181194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa626937-aa43-4272-94a6-dd229e6d6936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:07.198857 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-aa626937-aa43-4272-94a6-dd229e6d6936 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:07.200025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-aa626937-aa43-4272-94a6-dd229e6d6936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:07.208011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 675/1351] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:07.246647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bd269-a128-464b-958a-45e341e586ab None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:07.257328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bd269-a128-464b-958a-45e341e586ab None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:07.261398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c1619-2917-4dc7-b8e0-8cdca65d8443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:07.262029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c1619-2917-4dc7-b8e0-8cdca65d8443 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:07.262313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c1619-2917-4dc7-b8e0-8cdca65d8443 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:07.262590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c1619-2917-4dc7-b8e0-8cdca65d8443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:07.271522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c1619-2917-4dc7-b8e0-8cdca65d8443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:07.272998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c1619-2917-4dc7-b8e0-8cdca65d8443 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:07.283068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 677/1352] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:12.490804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5b482-2aa1-41ca-b586-940ff6446075 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:12.491247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5b482-2aa1-41ca-b586-940ff6446075 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:12.491356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5b482-2aa1-41ca-b586-940ff6446075 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:12.494333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 676/1353] 10.222.0.25 () {54 vars in 921 bytes} [Tue Mar 8 15:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:12.499817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04071599-ad93-4304-ac76-72aada2353f3 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:12.503330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04071599-ad93-4304-ac76-72aada2353f3 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:12.503330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04071599-ad93-4304-ac76-72aada2353f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:12.582811 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-04071599-ad93-4304-ac76-72aada2353f3 None None] MFA Rules not processed for user `13471dce9430484ab46b355d1303f504`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:12.584661 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-04071599-ad93-4304-ac76-72aada2353f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:12.689105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 678/1354] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Mar 8 15:31:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:17.134528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795ed9-b779-4034-943e-7a000c216767 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:17.135392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795ed9-b779-4034-943e-7a000c216767 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:17.135677 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795ed9-b779-4034-943e-7a000c216767 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:17.139925 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 677/1355] 10.222.0.25 () {54 vars in 921 bytes} [Tue Mar 8 15:31:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:17.143018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c98225-2d37-4c48-87be-297777c814e7 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:17.143457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c98225-2d37-4c48-87be-297777c814e7 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:17.143593 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c98225-2d37-4c48-87be-297777c814e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:17.162668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a7c98225-2d37-4c48-87be-297777c814e7 None None] MFA Rules not processed for user `13471dce9430484ab46b355d1303f504`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:17.164174 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a7c98225-2d37-4c48-87be-297777c814e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:17.174196 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 679/1356] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Mar 8 15:31:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:18.695349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e233a4-4e16-4f93-b7e5-7665cd4f335c None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:18.696440 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e233a4-4e16-4f93-b7e5-7665cd4f335c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:18.696691 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e233a4-4e16-4f93-b7e5-7665cd4f335c None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:18.698490 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 678/1357] 10.222.0.25 () {54 vars in 921 bytes} [Tue Mar 8 15:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:18.703637 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7973940-18f2-472f-9716-aec06dbc0d37 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:18.704053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7973940-18f2-472f-9716-aec06dbc0d37 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:18.704210 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7973940-18f2-472f-9716-aec06dbc0d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:18.722809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-e7973940-18f2-472f-9716-aec06dbc0d37 None None] MFA Rules not processed for user `13471dce9430484ab46b355d1303f504`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:18.723971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e7973940-18f2-472f-9716-aec06dbc0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:18.732337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 680/1358] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Mar 8 15:31:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:31:22.528965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112335b0-c132-4977-9cd2-999bca33e1a6 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:22.529475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112335b0-c132-4977-9cd2-999bca33e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:22.529475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112335b0-c132-4977-9cd2-999bca33e1a6 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:22.531167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 679/1359] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:22.536411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3087ebf-ebf5-4124-b9f9-f57f767996e9 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:22.536820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3087ebf-ebf5-4124-b9f9-f57f767996e9 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:22.536962 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3087ebf-ebf5-4124-b9f9-f57f767996e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:22.556083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-d3087ebf-ebf5-4124-b9f9-f57f767996e9 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:22.557283 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d3087ebf-ebf5-4124-b9f9-f57f767996e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:22.565026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 681/1360] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:22.612431 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e049a-3ea6-4c1a-9395-5129f4374d06 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:22.612853 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e049a-3ea6-4c1a-9395-5129f4374d06 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:22.613234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e049a-3ea6-4c1a-9395-5129f4374d06 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:22.615271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 680/1361] 10.222.0.25 () {54 vars in 961 bytes} [Tue Mar 8 15:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:22.620606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82051fd1-011a-42e1-8b29-303a837479a2 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:22.620893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82051fd1-011a-42e1-8b29-303a837479a2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:22.621167 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82051fd1-011a-42e1-8b29-303a837479a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:22.667816 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-82051fd1-011a-42e1-8b29-303a837479a2 None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:22.669021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-82051fd1-011a-42e1-8b29-303a837479a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:22.756584 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 682/1362] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Mar 8 15:31:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:31:22.765536 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e049a-3ea6-4c1a-9395-5129f4374d06 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:22.781783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e049a-3ea6-4c1a-9395-5129f4374d06 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:22.788074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4b32f-3c75-46b9-8531-5c329e5bda5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:22.788750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4b32f-3c75-46b9-8531-5c329e5bda5c service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:22.789653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4b32f-3c75-46b9-8531-5c329e5bda5c service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:22.789934 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4b32f-3c75-46b9-8531-5c329e5bda5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:22.798970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4b32f-3c75-46b9-8531-5c329e5bda5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:22.800596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4b32f-3c75-46b9-8531-5c329e5bda5c service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:22.811069 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 681/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:31:25.376460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec7a6-98c1-48f8-b1e8-39e54c8e6105 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:25.377009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec7a6-98c1-48f8-b1e8-39e54c8e6105 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:25.377009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ec7a6-98c1-48f8-b1e8-39e54c8e6105 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:25.378757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 683/1364] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:25.384557 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085215c-2b34-42b5-ac19-37b9dbabb17d None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:25.384972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085215c-2b34-42b5-ac19-37b9dbabb17d None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:25.385116 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085215c-2b34-42b5-ac19-37b9dbabb17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:25.403599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-9085215c-2b34-42b5-ac19-37b9dbabb17d None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:25.404810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9085215c-2b34-42b5-ac19-37b9dbabb17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:25.413055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 682/1365] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:31:25.457532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ec7a6-98c1-48f8-b1e8-39e54c8e6105 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:25.471925 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ec7a6-98c1-48f8-b1e8-39e54c8e6105 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:25.477814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881289ad-9f62-4950-b8c5-749a07b6115c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:25.478482 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881289ad-9f62-4950-b8c5-749a07b6115c service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:25.478796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881289ad-9f62-4950-b8c5-749a07b6115c service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:25.479074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881289ad-9f62-4950-b8c5-749a07b6115c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:25.487221 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881289ad-9f62-4950-b8c5-749a07b6115c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:25.488855 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881289ad-9f62-4950-b8c5-749a07b6115c service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:25.498658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 684/1366] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:28.250953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7904-e186-4b46-9da3-145f6a570bec None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:28.251474 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7904-e186-4b46-9da3-145f6a570bec None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:28.251563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c7904-e186-4b46-9da3-145f6a570bec None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:28.253298 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 683/1367] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:28.259607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1353c-112f-4afa-b5ce-dd2b12c6a1a2 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:28.259996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1353c-112f-4afa-b5ce-dd2b12c6a1a2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:28.261755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1353c-112f-4afa-b5ce-dd2b12c6a1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:28.279046 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-9ab1353c-112f-4afa-b5ce-dd2b12c6a1a2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:28.280299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9ab1353c-112f-4afa-b5ce-dd2b12c6a1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:28.288599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 685/1368] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:28.340724 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e5f9a-37c4-4363-ac19-857dff7ef686 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:28.341009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e5f9a-37c4-4363-ac19-857dff7ef686 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:28.341504 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e5f9a-37c4-4363-ac19-857dff7ef686 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:28.343341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 684/1369] 10.222.0.25 () {54 vars in 961 bytes} [Tue Mar 8 15:31:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:28.352044 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec740a-f11a-454e-9ddf-f3c05f3dd5f6 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:28.352724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec740a-f11a-454e-9ddf-f3c05f3dd5f6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:28.353493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec740a-f11a-454e-9ddf-f3c05f3dd5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:28.385817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f3ec740a-f11a-454e-9ddf-f3c05f3dd5f6 None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:28.387142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f3ec740a-f11a-454e-9ddf-f3c05f3dd5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:28.398140 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 686/1370] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Mar 8 15:31:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:28.407533 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e5f9a-37c4-4363-ac19-857dff7ef686 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:28.423036 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e5f9a-37c4-4363-ac19-857dff7ef686 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:28.428992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516e818-5df0-4263-982b-a3025a9d6578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:28.429727 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516e818-5df0-4263-982b-a3025a9d6578 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:28.429997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516e818-5df0-4263-982b-a3025a9d6578 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:28.430270 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516e818-5df0-4263-982b-a3025a9d6578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:28.439432 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516e818-5df0-4263-982b-a3025a9d6578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:28.441474 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516e818-5df0-4263-982b-a3025a9d6578 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:28.456378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 685/1371] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:31:30.785737 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b35ace-d523-4d04-ba9b-5f6fda24ece0 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:30.786269 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b35ace-d523-4d04-ba9b-5f6fda24ece0 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:30.786269 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b35ace-d523-4d04-ba9b-5f6fda24ece0 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:30.791964 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 687/1372] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:30.793681 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a799d08-190c-4779-a7d1-5927041e0fc6 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:30.794109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a799d08-190c-4779-a7d1-5927041e0fc6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:30.794398 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a799d08-190c-4779-a7d1-5927041e0fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:30.812510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-3a799d08-190c-4779-a7d1-5927041e0fc6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:30.813693 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3a799d08-190c-4779-a7d1-5927041e0fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:30.822267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 686/1373] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:31.004214 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72c796-efa3-4eef-ab63-64beb1129261 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:31.004592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72c796-efa3-4eef-ab63-64beb1129261 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:31.004772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72c796-efa3-4eef-ab63-64beb1129261 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:31.006576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 688/1374] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:31.012448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603f4e7-8f93-46dd-83f5-1e70663215d8 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:31.012740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603f4e7-8f93-46dd-83f5-1e70663215d8 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:31.013018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603f4e7-8f93-46dd-83f5-1e70663215d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:31.030680 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-4603f4e7-8f93-46dd-83f5-1e70663215d8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:31.031993 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4603f4e7-8f93-46dd-83f5-1e70663215d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:31.040226 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 687/1375] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:31.084553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19618a-847a-42b9-b93c-f5228dc26c6d None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:31.084846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19618a-847a-42b9-b93c-f5228dc26c6d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:31.085133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603f4e7-8f93-46dd-83f5-1e70663215d8 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:31.085297 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19618a-847a-42b9-b93c-f5228dc26c6d None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:31.087243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 689/1376] 10.222.0.25 () {54 vars in 963 bytes} [Tue Mar 8 15:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:31.092980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1004cf-94c9-4b4e-af99-eb9e93d31a48 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:31.094089 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1004cf-94c9-4b4e-af99-eb9e93d31a48 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:31.094575 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1004cf-94c9-4b4e-af99-eb9e93d31a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:31.098147 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603f4e7-8f93-46dd-83f5-1e70663215d8 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:31.103925 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476c1a9-a4d9-46d9-b749-2b96e00e2e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:31.104670 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476c1a9-a4d9-46d9-b749-2b96e00e2e9a service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:31.105031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476c1a9-a4d9-46d9-b749-2b96e00e2e9a service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:31.105391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476c1a9-a4d9-46d9-b749-2b96e00e2e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:31.114142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476c1a9-a4d9-46d9-b749-2b96e00e2e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:31.115816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476c1a9-a4d9-46d9-b749-2b96e00e2e9a service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:31.126642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 688/1377] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:31.151941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-9c1004cf-94c9-4b4e-af99-eb9e93d31a48 None None] MFA Rules not processed for user `7acd143470fb416c8adc57351c5d0324`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:31.153900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9c1004cf-94c9-4b4e-af99-eb9e93d31a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:31.230794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 690/1378] 10.222.0.25 () {58 vars in 1060 bytes} [Tue Mar 8 15:31:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:31.236284 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476c1a9-a4d9-46d9-b749-2b96e00e2e9a service nova] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:31.246256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476c1a9-a4d9-46d9-b749-2b96e00e2e9a service nova] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:31.249943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703461a-fa95-498f-b909-b0ef4bb15a40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:31.250591 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703461a-fa95-498f-b909-b0ef4bb15a40 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:31.250871 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703461a-fa95-498f-b909-b0ef4bb15a40 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:31.251145 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703461a-fa95-498f-b909-b0ef4bb15a40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:31.260288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703461a-fa95-498f-b909-b0ef4bb15a40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:31.261701 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703461a-fa95-498f-b909-b0ef4bb15a40 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:31.271272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 689/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:33.588078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9691a0-f7ce-452b-8193-3db74c9c71bb None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:33.588078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9691a0-f7ce-452b-8193-3db74c9c71bb None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:33.588078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9691a0-f7ce-452b-8193-3db74c9c71bb None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:33.588078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 691/1380] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:33.595669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116d522-45de-475a-aa75-a6de3f69068c None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:33.595669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116d522-45de-475a-aa75-a6de3f69068c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:33.596215 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116d522-45de-475a-aa75-a6de3f69068c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:33.614472 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-3116d522-45de-475a-aa75-a6de3f69068c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:33.615709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3116d522-45de-475a-aa75-a6de3f69068c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:33.625997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 690/1381] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:33.669450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9691a0-f7ce-452b-8193-3db74c9c71bb None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:33.684726 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9691a0-f7ce-452b-8193-3db74c9c71bb None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:33.690248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c5c5e-9784-4cbf-ad4f-306a5ec154fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:33.690894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c5c5e-9784-4cbf-ad4f-306a5ec154fe service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:33.691166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c5c5e-9784-4cbf-ad4f-306a5ec154fe service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:33.691439 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c5c5e-9784-4cbf-ad4f-306a5ec154fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:33.700952 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c5c5e-9784-4cbf-ad4f-306a5ec154fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:33.702548 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c5c5e-9784-4cbf-ad4f-306a5ec154fe service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:33.712611 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 692/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:36.157973 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be13a1-5225-4e34-9b9d-6fb2adae3673 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:36.158883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be13a1-5225-4e34-9b9d-6fb2adae3673 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:36.159272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be13a1-5225-4e34-9b9d-6fb2adae3673 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:36.161379 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 691/1383] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:36.167161 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900337c-e1d7-4639-b796-3e87486022b0 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:36.167939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900337c-e1d7-4639-b796-3e87486022b0 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:36.168413 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900337c-e1d7-4639-b796-3e87486022b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:36.187296 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-4900337c-e1d7-4639-b796-3e87486022b0 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:36.188731 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4900337c-e1d7-4639-b796-3e87486022b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:36.197729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 693/1384] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:36.242526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be13a1-5225-4e34-9b9d-6fb2adae3673 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:36.259196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be13a1-5225-4e34-9b9d-6fb2adae3673 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:36.266221 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f192fbc-693b-4434-93a8-9a92e89f3dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:36.267109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f192fbc-693b-4434-93a8-9a92e89f3dd2 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:36.267464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f192fbc-693b-4434-93a8-9a92e89f3dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:36.267814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f192fbc-693b-4434-93a8-9a92e89f3dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:36.276581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f192fbc-693b-4434-93a8-9a92e89f3dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:36.278248 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f192fbc-693b-4434-93a8-9a92e89f3dd2 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:36.288192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 692/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:38.708977 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c00e6-2ed3-495e-abdc-846b75ea55d4 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:38.709429 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c00e6-2ed3-495e-abdc-846b75ea55d4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:38.709535 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c00e6-2ed3-495e-abdc-846b75ea55d4 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:38.711281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 694/1386] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:38.716684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2f04f-074f-4549-8900-4122e5854287 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:38.717104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2f04f-074f-4549-8900-4122e5854287 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:38.717243 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2f04f-074f-4549-8900-4122e5854287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:38.735531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-dfd2f04f-074f-4549-8900-4122e5854287 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:38.736739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-dfd2f04f-074f-4549-8900-4122e5854287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:38.745745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 693/1387] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:38.787539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c00e6-2ed3-495e-abdc-846b75ea55d4 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:38.801913 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c00e6-2ed3-495e-abdc-846b75ea55d4 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:38.807427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff348-b39f-4cc8-b18e-11cd8a63ed91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:38.808061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff348-b39f-4cc8-b18e-11cd8a63ed91 service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:38.808385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff348-b39f-4cc8-b18e-11cd8a63ed91 service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:38.808665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff348-b39f-4cc8-b18e-11cd8a63ed91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:38.816865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fff348-b39f-4cc8-b18e-11cd8a63ed91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:38.818440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fff348-b39f-4cc8-b18e-11cd8a63ed91 service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:38.828510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 695/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:41.211402 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1773d2-1bcc-4d83-83e7-d4370e2904e8 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:41.212172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1773d2-1bcc-4d83-83e7-d4370e2904e8 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:41.212172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1773d2-1bcc-4d83-83e7-d4370e2904e8 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:41.213857 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 694/1389] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:41.219526 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f17d0-0af2-4c10-bb77-3edc9623f3a4 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:41.220082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f17d0-0af2-4c10-bb77-3edc9623f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:41.220220 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f17d0-0af2-4c10-bb77-3edc9623f3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:41.239331 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-db6f17d0-0af2-4c10-bb77-3edc9623f3a4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:41.240625 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-db6f17d0-0af2-4c10-bb77-3edc9623f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:41.249675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 696/1390] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:41.295752 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1773d2-1bcc-4d83-83e7-d4370e2904e8 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:41.310138 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1773d2-1bcc-4d83-83e7-d4370e2904e8 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:41.315689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb15a2b-f8aa-48cb-84fd-4ebb96f85da1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:41.316356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb15a2b-f8aa-48cb-84fd-4ebb96f85da1 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:41.316641 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb15a2b-f8aa-48cb-84fd-4ebb96f85da1 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:41.316920 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb15a2b-f8aa-48cb-84fd-4ebb96f85da1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:41.325324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb15a2b-f8aa-48cb-84fd-4ebb96f85da1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:41.326945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb15a2b-f8aa-48cb-84fd-4ebb96f85da1 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:41.336939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 695/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:43.829937 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32608b6d-32c9-406c-8460-c014081be495 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:43.830512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32608b6d-32c9-406c-8460-c014081be495 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:43.830512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32608b6d-32c9-406c-8460-c014081be495 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:43.832259 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 697/1392] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:31:43.838894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec239e-e36b-478c-a209-f802f0a25240 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:43.839605 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec239e-e36b-478c-a209-f802f0a25240 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:43.839750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec239e-e36b-478c-a209-f802f0a25240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:43.858543 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-98ec239e-e36b-478c-a209-f802f0a25240 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:43.859738 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-98ec239e-e36b-478c-a209-f802f0a25240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:43.868101 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 696/1393] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:43.913868 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32608b6d-32c9-406c-8460-c014081be495 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:43.928214 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32608b6d-32c9-406c-8460-c014081be495 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:43.934209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16146a43-7b38-4d65-bc66-e4de660f1780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:43.934844 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146a43-7b38-4d65-bc66-e4de660f1780 service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:43.935124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146a43-7b38-4d65-bc66-e4de660f1780 service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:43.935398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146a43-7b38-4d65-bc66-e4de660f1780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:43.943462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146a43-7b38-4d65-bc66-e4de660f1780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:43.945159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146a43-7b38-4d65-bc66-e4de660f1780 service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:43.954359 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 698/1394] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:46.453512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952dd37-e602-42d7-b45e-6c49d5cafd0b None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:46.454071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952dd37-e602-42d7-b45e-6c49d5cafd0b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:46.454071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952dd37-e602-42d7-b45e-6c49d5cafd0b None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:46.455799 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 697/1395] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:46.461281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080b59-8a87-4dfd-9d8a-cdab71d7363a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:46.461686 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080b59-8a87-4dfd-9d8a-cdab71d7363a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:46.461975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080b59-8a87-4dfd-9d8a-cdab71d7363a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:46.480522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-30080b59-8a87-4dfd-9d8a-cdab71d7363a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:46.481731 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-30080b59-8a87-4dfd-9d8a-cdab71d7363a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:46.490070 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 699/1396] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:46.534575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952dd37-e602-42d7-b45e-6c49d5cafd0b None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:46.549265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952dd37-e602-42d7-b45e-6c49d5cafd0b None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:46.554581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae82f4-27c4-4f9e-ba4e-e305d78385c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:46.555202 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae82f4-27c4-4f9e-ba4e-e305d78385c4 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:46.555482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae82f4-27c4-4f9e-ba4e-e305d78385c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:46.555755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae82f4-27c4-4f9e-ba4e-e305d78385c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:46.563518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae82f4-27c4-4f9e-ba4e-e305d78385c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:46.565102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae82f4-27c4-4f9e-ba4e-e305d78385c4 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:46.574219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 698/1397] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:47.657740 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c448bc-7ab4-4d0e-9546-7cc7bcdfb8a1 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:47.658299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c448bc-7ab4-4d0e-9546-7cc7bcdfb8a1 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:47.658400 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c448bc-7ab4-4d0e-9546-7cc7bcdfb8a1 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:47.660263 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 700/1398] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:47.666658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6793b9-7a9c-4924-80a2-fb3ae598ceec None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:47.667106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6793b9-7a9c-4924-80a2-fb3ae598ceec None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:47.667210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6793b9-7a9c-4924-80a2-fb3ae598ceec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:47.685417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ca6793b9-7a9c-4924-80a2-fb3ae598ceec None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:47.686603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ca6793b9-7a9c-4924-80a2-fb3ae598ceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:47.694449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 699/1399] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:47.750567 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07041b-184a-47d6-9c91-ed87c7976998 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:47.750858 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07041b-184a-47d6-9c91-ed87c7976998 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:47.751137 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07041b-184a-47d6-9c91-ed87c7976998 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:47.752897 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 701/1400] 10.222.0.25 () {54 vars in 961 bytes} [Tue Mar 8 15:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:47.757869 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88211-cc7c-4d6e-b988-1a1c72b6ce72 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:47.758237 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88211-cc7c-4d6e-b988-1a1c72b6ce72 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:47.758620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88211-cc7c-4d6e-b988-1a1c72b6ce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:47.807170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-34f88211-cc7c-4d6e-b988-1a1c72b6ce72 None None] MFA Rules not processed for user `2f9935443bcc4d34aeb56e5b77a96720`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:47.808410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-34f88211-cc7c-4d6e-b988-1a1c72b6ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:47.870167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 700/1401] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Mar 8 15:31:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:47.877659 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07041b-184a-47d6-9c91-ed87c7976998 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:47.888400 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07041b-184a-47d6-9c91-ed87c7976998 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:47.891881 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce8cf5-0e41-4ed0-98a4-56872c2c3a50 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f9935443bcc4d34aeb56e5b77a96720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:47.892573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce8cf5-0e41-4ed0-98a4-56872c2c3a50 service glance] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:47.892858 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce8cf5-0e41-4ed0-98a4-56872c2c3a50 service glance] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:47.893136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce8cf5-0e41-4ed0-98a4-56872c2c3a50 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:47.901788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce8cf5-0e41-4ed0-98a4-56872c2c3a50 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:47.903205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce8cf5-0e41-4ed0-98a4-56872c2c3a50 service glance] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:47.912318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 702/1402] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:48.502424 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1573c3-ab81-4ff4-bf5a-41c754b8c7d2 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:48.504963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1573c3-ab81-4ff4-bf5a-41c754b8c7d2 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:48.504963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1573c3-ab81-4ff4-bf5a-41c754b8c7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:48.550805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-0b1573c3-ab81-4ff4-bf5a-41c754b8c7d2 None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:48.552013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0b1573c3-ab81-4ff4-bf5a-41c754b8c7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:48.613281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 701/1403] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:31:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:48.665639 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b83f46-edcc-4815-9c68-91a55c6fd606 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:48.666157 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b83f46-edcc-4815-9c68-91a55c6fd606 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:48.666320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b83f46-edcc-4815-9c68-91a55c6fd606 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:48.668313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 703/1404] 10.222.0.25 () {54 vars in 942 bytes} [Tue Mar 8 15:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:48.674969 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aecdbc-9c7d-45c9-a7b3-42525cfe7df1 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:48.675424 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aecdbc-9c7d-45c9-a7b3-42525cfe7df1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:48.675522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aecdbc-9c7d-45c9-a7b3-42525cfe7df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:48.729300 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-11aecdbc-9c7d-45c9-a7b3-42525cfe7df1 None None] MFA Rules not processed for user `10fc82e0c3f0414492c1df4381918877`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:48.730496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-11aecdbc-9c7d-45c9-a7b3-42525cfe7df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:48.800282 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 702/1405] 10.222.0.25 () {58 vars in 1039 bytes} [Tue Mar 8 15:31:48 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:48.809469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b83f46-edcc-4815-9c68-91a55c6fd606 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:48.822522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b83f46-edcc-4815-9c68-91a55c6fd606 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:48.827393 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707d3fb-df5a-4978-a658-36dd6a771f51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:48.828022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707d3fb-df5a-4978-a658-36dd6a771f51 service swift] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:48.828345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707d3fb-df5a-4978-a658-36dd6a771f51 service swift] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:48.828623 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707d3fb-df5a-4978-a658-36dd6a771f51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:48.836949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707d3fb-df5a-4978-a658-36dd6a771f51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:48.838519 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707d3fb-df5a-4978-a658-36dd6a771f51 service swift] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:48.846518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 704/1406] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:31:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:31:49.073222 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a47024-0166-4786-a9d3-3eedddb1c200 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:49.073426 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a47024-0166-4786-a9d3-3eedddb1c200 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:49.073713 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a47024-0166-4786-a9d3-3eedddb1c200 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:49.075517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 703/1407] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:49.080858 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863061d-90de-46e8-979d-4c54fbc12dd3 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:49.081160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863061d-90de-46e8-979d-4c54fbc12dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:49.081441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863061d-90de-46e8-979d-4c54fbc12dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:49.101777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b863061d-90de-46e8-979d-4c54fbc12dd3 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:49.105522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b863061d-90de-46e8-979d-4c54fbc12dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:49.111272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 705/1408] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:49.156013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a47024-0166-4786-a9d3-3eedddb1c200 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:49.171047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a47024-0166-4786-a9d3-3eedddb1c200 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:49.176425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b6bb5-45ea-4e3e-9146-8084f2cda327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:49.177055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b6bb5-45ea-4e3e-9146-8084f2cda327 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:49.177337 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b6bb5-45ea-4e3e-9146-8084f2cda327 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:49.177613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b6bb5-45ea-4e3e-9146-8084f2cda327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:49.186169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b6bb5-45ea-4e3e-9146-8084f2cda327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:49.188518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b6bb5-45ea-4e3e-9146-8084f2cda327 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:49.196983 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 704/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:31:51.708246 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5ff9-3b6f-4d9d-891b-e25c5290847f None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:51.711360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5ff9-3b6f-4d9d-891b-e25c5290847f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:51.711360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f5ff9-3b6f-4d9d-891b-e25c5290847f None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:51.711360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 706/1410] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:31:51.717072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70c1f-24f9-4ef1-b38f-0b6e04ca0c26 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:51.717515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70c1f-24f9-4ef1-b38f-0b6e04ca0c26 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:51.717608 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70c1f-24f9-4ef1-b38f-0b6e04ca0c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:51.736626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-57e70c1f-24f9-4ef1-b38f-0b6e04ca0c26 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:31:51.741207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-57e70c1f-24f9-4ef1-b38f-0b6e04ca0c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:31:51.752186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 705/1411] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:31:51.795344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f5ff9-3b6f-4d9d-891b-e25c5290847f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:31:51.812100 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f5ff9-3b6f-4d9d-891b-e25c5290847f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:31:51.819513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46af39-a0f8-4598-ab88-d79f53b79dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:31:51.820164 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46af39-a0f8-4598-ab88-d79f53b79dfe service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:31:51.820454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46af39-a0f8-4598-ab88-d79f53b79dfe service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:31:51.820732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46af39-a0f8-4598-ab88-d79f53b79dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:31:51.829647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46af39-a0f8-4598-ab88-d79f53b79dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:31:51.831238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46af39-a0f8-4598-ab88-d79f53b79dfe service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:31:51.841174 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 707/1412] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:13.308502 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bbc6c-fd83-4bb3-bb1e-00dd78d67d2c None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:13.309064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bbc6c-fd83-4bb3-bb1e-00dd78d67d2c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:13.309064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bbc6c-fd83-4bb3-bb1e-00dd78d67d2c None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:13.310823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 706/1413] 10.222.0.25 () {54 vars in 918 bytes} [Tue Mar 8 15:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:13.316209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c57dde-8457-4661-b7f5-eedec36c68d5 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:13.316665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c57dde-8457-4661-b7f5-eedec36c68d5 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:13.316759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c57dde-8457-4661-b7f5-eedec36c68d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:13.335755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-66c57dde-8457-4661-b7f5-eedec36c68d5 None None] MFA Rules not processed for user `13471dce9430484ab46b355d1303f504`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:13.337002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-66c57dde-8457-4661-b7f5-eedec36c68d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:13.346005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 708/1414] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Mar 8 15:32:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:13.360610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7824bc-e51d-490d-844a-c34ad8d93668 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:13.360898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7824bc-e51d-490d-844a-c34ad8d93668 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:13.361172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7824bc-e51d-490d-844a-c34ad8d93668 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:13.362906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 707/1415] 10.222.0.25 () {54 vars in 918 bytes} [Tue Mar 8 15:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:13.368276 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30bf91-f25c-481c-b698-ff3f12c8cc5a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:13.368570 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30bf91-f25c-481c-b698-ff3f12c8cc5a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:13.368851 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30bf91-f25c-481c-b698-ff3f12c8cc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:13.387560 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-7d30bf91-f25c-481c-b698-ff3f12c8cc5a None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:13.388784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7d30bf91-f25c-481c-b698-ff3f12c8cc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:13.397826 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 709/1416] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Mar 8 15:32:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:16.115771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13f46f-e8a4-469c-b8ff-e94869f0340f None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:16.116356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13f46f-e8a4-469c-b8ff-e94869f0340f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:16.116356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13f46f-e8a4-469c-b8ff-e94869f0340f None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:16.118127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:16.123252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ee9ed-aa08-4df4-b980-86e97bdd47b4 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:16.123671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ee9ed-aa08-4df4-b980-86e97bdd47b4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:16.123837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ee9ed-aa08-4df4-b980-86e97bdd47b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:16.141578 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-bc7ee9ed-aa08-4df4-b980-86e97bdd47b4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:16.142782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-bc7ee9ed-aa08-4df4-b980-86e97bdd47b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:16.150398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:16.195883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13f46f-e8a4-469c-b8ff-e94869f0340f None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:16.214497 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13f46f-e8a4-469c-b8ff-e94869f0340f None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:16.219893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2daa6d-86fd-47c5-8fe4-91fd6d66e61a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:16.220555 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2daa6d-86fd-47c5-8fe4-91fd6d66e61a service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:16.220836 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2daa6d-86fd-47c5-8fe4-91fd6d66e61a service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:16.221111 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2daa6d-86fd-47c5-8fe4-91fd6d66e61a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:16.229630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2daa6d-86fd-47c5-8fe4-91fd6d66e61a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:16.231204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2daa6d-86fd-47c5-8fe4-91fd6d66e61a service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:16.241037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 709/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:17.594498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0af4a-93b7-4b9b-b03a-f90e3b2f2467 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:17.595024 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0af4a-93b7-4b9b-b03a-f90e3b2f2467 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:17.595024 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0af4a-93b7-4b9b-b03a-f90e3b2f2467 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:17.596773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 15:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:17.602213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bbd39-c503-4693-9a71-b6dfeb21fb0a None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:17.602662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bbd39-c503-4693-9a71-b6dfeb21fb0a None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:17.602773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bbd39-c503-4693-9a71-b6dfeb21fb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:17.620797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ae9bbd39-c503-4693-9a71-b6dfeb21fb0a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:17.621994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ae9bbd39-c503-4693-9a71-b6dfeb21fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:17.630235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 15:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:17.801450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0af4a-93b7-4b9b-b03a-f90e3b2f2467 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:17.815214 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0af4a-93b7-4b9b-b03a-f90e3b2f2467 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:17.821014 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec75eb2-f613-4b29-8ac4-ae0bf389c702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:17.821629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec75eb2-f613-4b29-8ac4-ae0bf389c702 service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:17.821910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec75eb2-f613-4b29-8ac4-ae0bf389c702 service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:17.822185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec75eb2-f613-4b29-8ac4-ae0bf389c702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:17.829944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec75eb2-f613-4b29-8ac4-ae0bf389c702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:17.831497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec75eb2-f613-4b29-8ac4-ae0bf389c702 service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:17.841403 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 712/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:19.153727 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769123ba-7634-4e81-8124-101c6f2031b3 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:19.154260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769123ba-7634-4e81-8124-101c6f2031b3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:19.154260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769123ba-7634-4e81-8124-101c6f2031b3 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:19.156081 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 15:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:19.163742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49705a-d603-4c8a-9596-30233a2918a2 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:19.164387 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49705a-d603-4c8a-9596-30233a2918a2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:19.164387 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49705a-d603-4c8a-9596-30233a2918a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:19.190743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-cf49705a-d603-4c8a-9596-30233a2918a2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:19.192132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-cf49705a-d603-4c8a-9596-30233a2918a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:19.199973 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 15:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:19.349192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769123ba-7634-4e81-8124-101c6f2031b3 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:19.363169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769123ba-7634-4e81-8124-101c6f2031b3 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:19.369100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7498c-e26f-46bc-b98a-d91237acc367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:19.369723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7498c-e26f-46bc-b98a-d91237acc367 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:19.370005 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7498c-e26f-46bc-b98a-d91237acc367 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:19.370281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7498c-e26f-46bc-b98a-d91237acc367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:19.378129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7498c-e26f-46bc-b98a-d91237acc367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:19.380277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7498c-e26f-46bc-b98a-d91237acc367 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:19.388951 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 712/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:20.701918 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fcd36-01a9-408b-8cdd-9ef5da379630 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:20.702458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fcd36-01a9-408b-8cdd-9ef5da379630 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:20.702458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fcd36-01a9-408b-8cdd-9ef5da379630 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:20.704242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 15:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:20.709101 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b758d14-73e5-49a5-90b8-c5df1501f574 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:20.709510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b758d14-73e5-49a5-90b8-c5df1501f574 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:20.709655 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b758d14-73e5-49a5-90b8-c5df1501f574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:20.728715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-4b758d14-73e5-49a5-90b8-c5df1501f574 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:20.729902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4b758d14-73e5-49a5-90b8-c5df1501f574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:20.737822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 15:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:20.887304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fcd36-01a9-408b-8cdd-9ef5da379630 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:20.901858 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fcd36-01a9-408b-8cdd-9ef5da379630 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:20.907240 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420ad23-4886-4745-8215-567832f481fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:20.907860 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420ad23-4886-4745-8215-567832f481fd service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:20.908161 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420ad23-4886-4745-8215-567832f481fd service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:20.908448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420ad23-4886-4745-8215-567832f481fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:20.916219 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420ad23-4886-4745-8215-567832f481fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:20.917791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420ad23-4886-4745-8215-567832f481fd service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:20.926893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 715/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:22.215213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd2a6c-c833-4fdb-81ea-7f3e93ab32cf None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:22.215723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd2a6c-c833-4fdb-81ea-7f3e93ab32cf None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:22.215826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd2a6c-c833-4fdb-81ea-7f3e93ab32cf None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:22.217565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 15:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:22.222425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee527d7-9c2f-40c2-a3d1-94f9a76b03a4 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:22.222863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee527d7-9c2f-40c2-a3d1-94f9a76b03a4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:22.223536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee527d7-9c2f-40c2-a3d1-94f9a76b03a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:22.241594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-6ee527d7-9c2f-40c2-a3d1-94f9a76b03a4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:22.242770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-6ee527d7-9c2f-40c2-a3d1-94f9a76b03a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:22.250441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 15:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:22.398213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd2a6c-c833-4fdb-81ea-7f3e93ab32cf None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:22.412692 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd2a6c-c833-4fdb-81ea-7f3e93ab32cf None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:22.417964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae923c-f8f2-4209-a059-c233c419d0f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:22.418627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae923c-f8f2-4209-a059-c233c419d0f0 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:22.418909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae923c-f8f2-4209-a059-c233c419d0f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:22.419185 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae923c-f8f2-4209-a059-c233c419d0f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:22.427812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae923c-f8f2-4209-a059-c233c419d0f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:22.429415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae923c-f8f2-4209-a059-c233c419d0f0 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:22.438549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 715/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:23.749948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a871a34-9925-468e-87f1-a4e23cf22595 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:23.750461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a871a34-9925-468e-87f1-a4e23cf22595 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:23.750461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a871a34-9925-468e-87f1-a4e23cf22595 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:23.752206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 15:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:23.757244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507283b8-81d8-45ff-b1eb-85bec7b93384 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:23.757822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507283b8-81d8-45ff-b1eb-85bec7b93384 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:23.758102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507283b8-81d8-45ff-b1eb-85bec7b93384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:23.775750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-507283b8-81d8-45ff-b1eb-85bec7b93384 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:23.776969 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-507283b8-81d8-45ff-b1eb-85bec7b93384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:23.784618 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 15:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:23.935714 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a871a34-9925-468e-87f1-a4e23cf22595 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:23.949599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a871a34-9925-468e-87f1-a4e23cf22595 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:23.954881 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59daaeb-4ab9-4a81-b2a7-a2588a8e3338 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:23.955499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59daaeb-4ab9-4a81-b2a7-a2588a8e3338 service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:23.955782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59daaeb-4ab9-4a81-b2a7-a2588a8e3338 service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:23.956055 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59daaeb-4ab9-4a81-b2a7-a2588a8e3338 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:23.964492 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59daaeb-4ab9-4a81-b2a7-a2588a8e3338 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:23.966061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59daaeb-4ab9-4a81-b2a7-a2588a8e3338 service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:23.975862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 718/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:25.308811 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386de09f-a2d5-4632-b2d4-417eee228193 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:25.309370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386de09f-a2d5-4632-b2d4-417eee228193 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:25.309370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386de09f-a2d5-4632-b2d4-417eee228193 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:25.311179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 15:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:25.316273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34169d-5be7-490c-b491-7f2583e992eb None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:25.316683 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34169d-5be7-490c-b491-7f2583e992eb None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:25.316859 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34169d-5be7-490c-b491-7f2583e992eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:25.334358 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-8b34169d-5be7-490c-b491-7f2583e992eb None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:25.335539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8b34169d-5be7-490c-b491-7f2583e992eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:25.343572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 15:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:25.495138 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386de09f-a2d5-4632-b2d4-417eee228193 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:25.509059 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386de09f-a2d5-4632-b2d4-417eee228193 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:25.514386 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986680d7-1ab6-4628-a712-5a3bed6de793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:25.515006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986680d7-1ab6-4628-a712-5a3bed6de793 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:25.515293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986680d7-1ab6-4628-a712-5a3bed6de793 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:25.515568 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986680d7-1ab6-4628-a712-5a3bed6de793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:25.523976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986680d7-1ab6-4628-a712-5a3bed6de793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:25.525578 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986680d7-1ab6-4628-a712-5a3bed6de793 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:25.534700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 718/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:26.855265 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aeadb-ba8f-4007-af1f-828c8e34da48 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:26.855822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aeadb-ba8f-4007-af1f-828c8e34da48 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:26.855822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aeadb-ba8f-4007-af1f-828c8e34da48 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:26.857630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 15:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:26.862422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6196a4-948a-49f1-b985-58c188ee64a6 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:26.862816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6196a4-948a-49f1-b985-58c188ee64a6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:26.862975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6196a4-948a-49f1-b985-58c188ee64a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:26.881592 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ce6196a4-948a-49f1-b985-58c188ee64a6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:26.882765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ce6196a4-948a-49f1-b985-58c188ee64a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:26.890711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 15:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:27.039459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3aeadb-ba8f-4007-af1f-828c8e34da48 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:27.053882 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3aeadb-ba8f-4007-af1f-828c8e34da48 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:27.059143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de5aee-a10b-4b64-996e-db2470b0fd86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:27.059761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de5aee-a10b-4b64-996e-db2470b0fd86 service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:27.063193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de5aee-a10b-4b64-996e-db2470b0fd86 service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:27.063193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de5aee-a10b-4b64-996e-db2470b0fd86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:27.068769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de5aee-a10b-4b64-996e-db2470b0fd86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:27.070337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de5aee-a10b-4b64-996e-db2470b0fd86 service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:27.079357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 721/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:28.380965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb33ded-9065-463e-849f-5c1cf9aafdf3 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:28.381519 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb33ded-9065-463e-849f-5c1cf9aafdf3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:28.381519 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb33ded-9065-463e-849f-5c1cf9aafdf3 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:28.383304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 15:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:28.388454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79dfbc-92e6-4290-8509-8d15ef8ff82a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:28.388915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79dfbc-92e6-4290-8509-8d15ef8ff82a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:28.389035 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79dfbc-92e6-4290-8509-8d15ef8ff82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:28.406761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-de79dfbc-92e6-4290-8509-8d15ef8ff82a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:28.407884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-de79dfbc-92e6-4290-8509-8d15ef8ff82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:28.416055 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 15:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:28.564658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb33ded-9065-463e-849f-5c1cf9aafdf3 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:28.578675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb33ded-9065-463e-849f-5c1cf9aafdf3 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:28.584625 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a24a56-6140-4f78-ba40-e9baa62292a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:28.585251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24a56-6140-4f78-ba40-e9baa62292a9 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:28.585534 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24a56-6140-4f78-ba40-e9baa62292a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:28.585824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a24a56-6140-4f78-ba40-e9baa62292a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:28.594136 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a24a56-6140-4f78-ba40-e9baa62292a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:28.595707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a24a56-6140-4f78-ba40-e9baa62292a9 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:28.605556 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 721/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:30.750566 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5eeb9-7ce9-478d-9257-266d7b85d2ae None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:30.751147 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5eeb9-7ce9-478d-9257-266d7b85d2ae None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:30.751147 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5eeb9-7ce9-478d-9257-266d7b85d2ae None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:30.752959 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:30.758140 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7e4e7-7f7f-465e-8599-c7867b5829f7 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:30.758529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7e4e7-7f7f-465e-8599-c7867b5829f7 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:30.758700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7e4e7-7f7f-465e-8599-c7867b5829f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:30.776569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-c9f7e4e7-7f7f-465e-8599-c7867b5829f7 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:30.777782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c9f7e4e7-7f7f-465e-8599-c7867b5829f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:30.786079 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:30.823363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5eeb9-7ce9-478d-9257-266d7b85d2ae None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:30.834617 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5eeb9-7ce9-478d-9257-266d7b85d2ae None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:30.838415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338d859-33db-408f-a6d7-4785f87c4244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:30.839119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338d859-33db-408f-a6d7-4785f87c4244 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:30.839406 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338d859-33db-408f-a6d7-4785f87c4244 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:30.839705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338d859-33db-408f-a6d7-4785f87c4244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:30.849130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338d859-33db-408f-a6d7-4785f87c4244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:30.850560 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338d859-33db-408f-a6d7-4785f87c4244 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:30.860324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 724/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:33.301161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe85fa-08e4-4562-9b59-8000e58ad901 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:33.301765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe85fa-08e4-4562-9b59-8000e58ad901 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:33.301765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe85fa-08e4-4562-9b59-8000e58ad901 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:33.303485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:33.308694 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9d215-3db4-493e-a0a0-98c3bbd43e1e None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:33.309127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9d215-3db4-493e-a0a0-98c3bbd43e1e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:33.309249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9d215-3db4-493e-a0a0-98c3bbd43e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:33.327016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5bc9d215-3db4-493e-a0a0-98c3bbd43e1e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:33.328220 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5bc9d215-3db4-493e-a0a0-98c3bbd43e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:33.336446 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:32:33.373673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe85fa-08e4-4562-9b59-8000e58ad901 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:33.384954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe85fa-08e4-4562-9b59-8000e58ad901 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:33.389086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa11b64-0f7c-46c9-8bb6-8c8c0647744a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:33.389213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa11b64-0f7c-46c9-8bb6-8c8c0647744a service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:33.389399 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa11b64-0f7c-46c9-8bb6-8c8c0647744a service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:33.389675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa11b64-0f7c-46c9-8bb6-8c8c0647744a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:33.400267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa11b64-0f7c-46c9-8bb6-8c8c0647744a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:33.401703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa11b64-0f7c-46c9-8bb6-8c8c0647744a service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:33.410879 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 724/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:36.039953 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcbb9a-8a55-480f-a642-bc315122f5cd None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:36.040572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcbb9a-8a55-480f-a642-bc315122f5cd None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:36.040671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcbb9a-8a55-480f-a642-bc315122f5cd None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:36.042360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:36.048169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fe8aa-a42c-4ceb-9405-359a978aeaf1 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:36.048581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fe8aa-a42c-4ceb-9405-359a978aeaf1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:36.048900 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fe8aa-a42c-4ceb-9405-359a978aeaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:36.067339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-996fe8aa-a42c-4ceb-9405-359a978aeaf1 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:36.068549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-996fe8aa-a42c-4ceb-9405-359a978aeaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:36.076140 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:36.116622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcbb9a-8a55-480f-a642-bc315122f5cd None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:36.127104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcbb9a-8a55-480f-a642-bc315122f5cd None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:36.130578 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c11bc-07cd-4366-9019-ee15a991b0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:36.131201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c11bc-07cd-4366-9019-ee15a991b0ba service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:36.131484 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c11bc-07cd-4366-9019-ee15a991b0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:36.131764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c11bc-07cd-4366-9019-ee15a991b0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:36.140372 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c11bc-07cd-4366-9019-ee15a991b0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:36.142099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c11bc-07cd-4366-9019-ee15a991b0ba service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:36.151426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 727/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:38.557072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6e88-435f-4efd-8615-0321cad248ca None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:38.557610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6e88-435f-4efd-8615-0321cad248ca None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:38.557610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6e88-435f-4efd-8615-0321cad248ca None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:38.559305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:38.564670 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279282b-2e69-4da9-87d3-2c5b394bdd74 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:38.565091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279282b-2e69-4da9-87d3-2c5b394bdd74 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:38.565238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279282b-2e69-4da9-87d3-2c5b394bdd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:38.584027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-2279282b-2e69-4da9-87d3-2c5b394bdd74 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:38.585258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2279282b-2e69-4da9-87d3-2c5b394bdd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:38.593210 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:38.631435 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec6e88-435f-4efd-8615-0321cad248ca None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:38.641914 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec6e88-435f-4efd-8615-0321cad248ca None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:38.646080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f84b1-f950-4dd1-94a0-f2f0d53a4793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:38.646701 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f84b1-f950-4dd1-94a0-f2f0d53a4793 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:38.646982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f84b1-f950-4dd1-94a0-f2f0d53a4793 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:38.647257 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f84b1-f950-4dd1-94a0-f2f0d53a4793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:38.655955 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f84b1-f950-4dd1-94a0-f2f0d53a4793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:38.657422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f84b1-f950-4dd1-94a0-f2f0d53a4793 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:38.666623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 727/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:41.012244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a33e-085e-45ac-98c3-3e38f5849d61 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:41.012839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a33e-085e-45ac-98c3-3e38f5849d61 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:41.012839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a33e-085e-45ac-98c3-3e38f5849d61 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:41.014556 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:41.020459 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b7265-9039-423c-95d0-772d9438a9ed None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:41.020865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b7265-9039-423c-95d0-772d9438a9ed None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:41.021018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b7265-9039-423c-95d0-772d9438a9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:41.038456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ce5b7265-9039-423c-95d0-772d9438a9ed None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:41.039660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ce5b7265-9039-423c-95d0-772d9438a9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:41.048356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:41.088068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649a33e-085e-45ac-98c3-3e38f5849d61 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:41.099482 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649a33e-085e-45ac-98c3-3e38f5849d61 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:41.103055 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff7bfc-e289-4007-9d91-d10686653de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:41.103686 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff7bfc-e289-4007-9d91-d10686653de8 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:41.103975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff7bfc-e289-4007-9d91-d10686653de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:41.104295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff7bfc-e289-4007-9d91-d10686653de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:41.113648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff7bfc-e289-4007-9d91-d10686653de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:41.115082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff7bfc-e289-4007-9d91-d10686653de8 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:41.124272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 730/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:43.456734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bc73f-e0f9-4689-9533-ed41e02fd8b7 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:43.457249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bc73f-e0f9-4689-9533-ed41e02fd8b7 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:43.457356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bc73f-e0f9-4689-9533-ed41e02fd8b7 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:43.459033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:43.464843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fd158-80cd-494f-a68d-8567c8676d1f None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:43.465245 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fd158-80cd-494f-a68d-8567c8676d1f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:43.465401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fd158-80cd-494f-a68d-8567c8676d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:43.483067 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-923fd158-80cd-494f-a68d-8567c8676d1f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:43.484450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-923fd158-80cd-494f-a68d-8567c8676d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:43.492682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:43.530795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bc73f-e0f9-4689-9533-ed41e02fd8b7 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:43.541344 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bc73f-e0f9-4689-9533-ed41e02fd8b7 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:43.544841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39607a8c-616f-4c2c-bc5e-d5e16398fa1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:43.545462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607a8c-616f-4c2c-bc5e-d5e16398fa1c service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:43.545755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607a8c-616f-4c2c-bc5e-d5e16398fa1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:43.546028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607a8c-616f-4c2c-bc5e-d5e16398fa1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:43.555133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39607a8c-616f-4c2c-bc5e-d5e16398fa1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:43.556610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39607a8c-616f-4c2c-bc5e-d5e16398fa1c service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:43.566524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 730/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:45.895253 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c16573-3f5f-4079-9e54-6ea3e231db28 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:45.895807 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c16573-3f5f-4079-9e54-6ea3e231db28 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:45.895807 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c16573-3f5f-4079-9e54-6ea3e231db28 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:45.897622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:45.902912 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f05fc-3e0e-4a0c-bee1-6b6fc8303025 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:45.903321 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f05fc-3e0e-4a0c-bee1-6b6fc8303025 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:45.903504 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f05fc-3e0e-4a0c-bee1-6b6fc8303025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:45.920859 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-533f05fc-3e0e-4a0c-bee1-6b6fc8303025 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:45.922039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-533f05fc-3e0e-4a0c-bee1-6b6fc8303025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:45.930243 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:45.968012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c16573-3f5f-4079-9e54-6ea3e231db28 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:45.969701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-43c16573-3f5f-4079-9e54-6ea3e231db28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:45.982327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c16573-3f5f-4079-9e54-6ea3e231db28 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:45.985821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b17b7-e720-4d0d-9344-8ac1bbce96d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:45.986444 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b17b7-e720-4d0d-9344-8ac1bbce96d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:45.986732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b17b7-e720-4d0d-9344-8ac1bbce96d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:45.987014 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b17b7-e720-4d0d-9344-8ac1bbce96d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:45.996110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b17b7-e720-4d0d-9344-8ac1bbce96d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:45.997568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b17b7-e720-4d0d-9344-8ac1bbce96d0 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:46.007469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 733/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:48.358244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af59ce5-2628-444d-acb7-17c054d9958b None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:48.358810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af59ce5-2628-444d-acb7-17c054d9958b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:48.358810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af59ce5-2628-444d-acb7-17c054d9958b None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:48.360687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:48.365875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c1263-205c-4fd0-a6e9-796c7220faf8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:48.366281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c1263-205c-4fd0-a6e9-796c7220faf8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:48.366434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c1263-205c-4fd0-a6e9-796c7220faf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:48.384135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-739c1263-205c-4fd0-a6e9-796c7220faf8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:48.385358 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-739c1263-205c-4fd0-a6e9-796c7220faf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:48.398169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:48.430144 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af59ce5-2628-444d-acb7-17c054d9958b None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:48.443644 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af59ce5-2628-444d-acb7-17c054d9958b None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:48.447134 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171dced-48b8-4db7-87e6-8d3a3aeb90a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:48.447764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171dced-48b8-4db7-87e6-8d3a3aeb90a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:48.448047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171dced-48b8-4db7-87e6-8d3a3aeb90a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:48.448354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171dced-48b8-4db7-87e6-8d3a3aeb90a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:48.457611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171dced-48b8-4db7-87e6-8d3a3aeb90a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:48.459039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171dced-48b8-4db7-87e6-8d3a3aeb90a3 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:48.468429 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 733/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:32:50.855952 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a1fa7-3e5c-4cd9-bdc8-89f94857f744 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:50.856588 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a1fa7-3e5c-4cd9-bdc8-89f94857f744 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:50.856588 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a1fa7-3e5c-4cd9-bdc8-89f94857f744 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:50.858291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:32:50.864399 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902757ce-e0e2-4fa2-9c86-1ed10a5d5555 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:50.864871 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902757ce-e0e2-4fa2-9c86-1ed10a5d5555 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:50.864986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902757ce-e0e2-4fa2-9c86-1ed10a5d5555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:50.882357 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-902757ce-e0e2-4fa2-9c86-1ed10a5d5555 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:50.883541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-902757ce-e0e2-4fa2-9c86-1ed10a5d5555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:50.891338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:32:50.927937 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a1fa7-3e5c-4cd9-bdc8-89f94857f744 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:50.938389 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a1fa7-3e5c-4cd9-bdc8-89f94857f744 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:50.941895 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc873cd-d2a6-4893-99cc-b8f665e0cfff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:50.942517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc873cd-d2a6-4893-99cc-b8f665e0cfff service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:50.942800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc873cd-d2a6-4893-99cc-b8f665e0cfff service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:50.943077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc873cd-d2a6-4893-99cc-b8f665e0cfff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:50.951660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc873cd-d2a6-4893-99cc-b8f665e0cfff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:50.953113 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc873cd-d2a6-4893-99cc-b8f665e0cfff service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:50.962414 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 736/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:32:53.296350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ae14f-fea0-429a-ba20-a298308ec7c2 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:53.296878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ae14f-fea0-429a-ba20-a298308ec7c2 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:53.296878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ae14f-fea0-429a-ba20-a298308ec7c2 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:53.298858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 735/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:32:53.305435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c1489-e536-4c7c-80da-2d86c58c024f None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:53.305863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c1489-e536-4c7c-80da-2d86c58c024f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:53.305994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c1489-e536-4c7c-80da-2d86c58c024f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:53.324935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-852c1489-e536-4c7c-80da-2d86c58c024f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:32:53.326130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-852c1489-e536-4c7c-80da-2d86c58c024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:32:53.333892 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 737/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:32:53.370296 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ae14f-fea0-429a-ba20-a298308ec7c2 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:32:53.382422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ae14f-fea0-429a-ba20-a298308ec7c2 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:32:53.386015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53357e06-2715-4481-9965-cbfa934bb289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:32:53.386662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53357e06-2715-4481-9965-cbfa934bb289 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:32:53.386949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53357e06-2715-4481-9965-cbfa934bb289 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:32:53.388308 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53357e06-2715-4481-9965-cbfa934bb289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:32:53.397383 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53357e06-2715-4481-9965-cbfa934bb289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:32:53.398885 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53357e06-2715-4481-9965-cbfa934bb289 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:32:53.410068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 736/1473] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:33:14.299368 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97991335-7e9c-408c-a984-0fc99c8dd80c None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:14.299963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97991335-7e9c-408c-a984-0fc99c8dd80c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:14.299963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97991335-7e9c-408c-a984-0fc99c8dd80c None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:14.301917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 738/1474] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:33:14.307072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c97f4-8373-48a2-80ed-a3f1b792cc69 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:14.307498 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c97f4-8373-48a2-80ed-a3f1b792cc69 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:14.307649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c97f4-8373-48a2-80ed-a3f1b792cc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:14.325904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ae3c97f4-8373-48a2-80ed-a3f1b792cc69 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:33:14.327083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ae3c97f4-8373-48a2-80ed-a3f1b792cc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:33:14.335173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 737/1475] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:33:14.383998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cf5dc-b011-4b14-8e96-07a50e1cca12 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:14.384316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cf5dc-b011-4b14-8e96-07a50e1cca12 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:14.384592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cf5dc-b011-4b14-8e96-07a50e1cca12 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:14.386299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 739/1476] 10.222.0.25 () {54 vars in 961 bytes} [Tue Mar 8 15:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:33:14.391143 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add1ef8-6dfb-4814-a5b9-147fe7544d26 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:14.391429 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add1ef8-6dfb-4814-a5b9-147fe7544d26 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:14.391756 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add1ef8-6dfb-4814-a5b9-147fe7544d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:14.409778 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-9add1ef8-6dfb-4814-a5b9-147fe7544d26 None None] MFA Rules not processed for user `2f9935443bcc4d34aeb56e5b77a96720`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:33:14.410965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9add1ef8-6dfb-4814-a5b9-147fe7544d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:33:14.417330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 738/1477] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Mar 8 15:33:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:33:14.424825 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cf5dc-b011-4b14-8e96-07a50e1cca12 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:33:14.435027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cf5dc-b011-4b14-8e96-07a50e1cca12 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:33:14.438563 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9718ec-4e2a-4223-b38d-33120b6bcbbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f9935443bcc4d34aeb56e5b77a96720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:33:14.439722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9718ec-4e2a-4223-b38d-33120b6bcbbf service glance] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:14.440003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9718ec-4e2a-4223-b38d-33120b6bcbbf service glance] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:14.440322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9718ec-4e2a-4223-b38d-33120b6bcbbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:14.449016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9718ec-4e2a-4223-b38d-33120b6bcbbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:33:14.450437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9718ec-4e2a-4223-b38d-33120b6bcbbf service glance] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:33:14.459401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 740/1478] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:33:16.828751 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8def40e-0acc-4da0-a5a3-e451eaedc1fc None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:16.829823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8def40e-0acc-4da0-a5a3-e451eaedc1fc None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:16.829823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8def40e-0acc-4da0-a5a3-e451eaedc1fc None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:16.831603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 739/1479] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:33:16.837310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d887-835c-471b-86ab-1f89460a61eb None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:16.837710 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d887-835c-471b-86ab-1f89460a61eb None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:16.837866 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d887-835c-471b-86ab-1f89460a61eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:16.856038 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-44f4d887-835c-471b-86ab-1f89460a61eb None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:33:16.857249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-44f4d887-835c-471b-86ab-1f89460a61eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:33:16.864981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 741/1480] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:33:16.887902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8def40e-0acc-4da0-a5a3-e451eaedc1fc None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:33:16.900639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8def40e-0acc-4da0-a5a3-e451eaedc1fc None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:33:16.905067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecf784-5593-420c-b6ce-ccdb83cc22d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:33:16.905692 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecf784-5593-420c-b6ce-ccdb83cc22d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:16.905975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecf784-5593-420c-b6ce-ccdb83cc22d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:16.906256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecf784-5593-420c-b6ce-ccdb83cc22d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:16.906978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecf784-5593-420c-b6ce-ccdb83cc22d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:33:16.908885 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecf784-5593-420c-b6ce-ccdb83cc22d6 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:33:16.922092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 740/1481] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Mar 8 15:33:16 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:33:19.210254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026d85f-8252-423f-8948-f11ea6d09a04 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:19.210819 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026d85f-8252-423f-8948-f11ea6d09a04 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:19.210819 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026d85f-8252-423f-8948-f11ea6d09a04 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:19.212568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 742/1482] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:33:19.217838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf882-f659-438e-a21b-4f1e62621892 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:19.218239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf882-f659-438e-a21b-4f1e62621892 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:19.218385 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf882-f659-438e-a21b-4f1e62621892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:19.237338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-601cf882-f659-438e-a21b-4f1e62621892 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:33:19.238528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-601cf882-f659-438e-a21b-4f1e62621892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:33:19.246619 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 741/1483] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:33:19.287159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026d85f-8252-423f-8948-f11ea6d09a04 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:33:19.301565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026d85f-8252-423f-8948-f11ea6d09a04 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:33:19.306805 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84a74f-27e2-49f7-bcfe-39be6d5be0c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:33:19.307421 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84a74f-27e2-49f7-bcfe-39be6d5be0c7 service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:19.307703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84a74f-27e2-49f7-bcfe-39be6d5be0c7 service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:19.307978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84a74f-27e2-49f7-bcfe-39be6d5be0c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:19.316158 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84a74f-27e2-49f7-bcfe-39be6d5be0c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:33:19.318039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84a74f-27e2-49f7-bcfe-39be6d5be0c7 service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:33:19.327231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 743/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:33:21.798799 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae903c3-e0a0-408b-9f16-70d5bf0092ae None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:21.799325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae903c3-e0a0-408b-9f16-70d5bf0092ae None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:21.799325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae903c3-e0a0-408b-9f16-70d5bf0092ae None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:21.801323 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 742/1485] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:33:21.806297 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac251-6a9e-4a72-bd2b-c67fb41e2ba7 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:21.806699 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac251-6a9e-4a72-bd2b-c67fb41e2ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:21.806846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac251-6a9e-4a72-bd2b-c67fb41e2ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:21.824843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-692ac251-6a9e-4a72-bd2b-c67fb41e2ba7 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:33:21.826018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-692ac251-6a9e-4a72-bd2b-c67fb41e2ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:33:21.833667 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 744/1486] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:33:21.869399 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae903c3-e0a0-408b-9f16-70d5bf0092ae None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:33:21.880690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae903c3-e0a0-408b-9f16-70d5bf0092ae None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:33:21.884189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eadfb5-b861-4102-8eae-2bea1069e18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:33:21.884803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eadfb5-b861-4102-8eae-2bea1069e18c service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:21.885087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eadfb5-b861-4102-8eae-2bea1069e18c service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:21.885365 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eadfb5-b861-4102-8eae-2bea1069e18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:21.893956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eadfb5-b861-4102-8eae-2bea1069e18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:33:21.895375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eadfb5-b861-4102-8eae-2bea1069e18c service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:33:21.904574 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 743/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:33:24.279880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea64527-60c1-48de-85de-ac1bfa0a77a0 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:24.280465 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea64527-60c1-48de-85de-ac1bfa0a77a0 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:24.280574 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea64527-60c1-48de-85de-ac1bfa0a77a0 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:24.283230 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 745/1488] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:33:24.288464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938711c-1c0e-4da2-8c66-3464d4e95bd9 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:24.288866 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938711c-1c0e-4da2-8c66-3464d4e95bd9 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:24.289025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938711c-1c0e-4da2-8c66-3464d4e95bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:24.306459 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-4938711c-1c0e-4da2-8c66-3464d4e95bd9 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:33:24.307655 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4938711c-1c0e-4da2-8c66-3464d4e95bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:33:24.315859 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 744/1489] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:33:24.353683 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea64527-60c1-48de-85de-ac1bfa0a77a0 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:33:24.364041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea64527-60c1-48de-85de-ac1bfa0a77a0 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:33:24.367748 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829bc4a-a476-45ee-8009-58982651bc30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:33:24.368397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829bc4a-a476-45ee-8009-58982651bc30 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:24.368679 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829bc4a-a476-45ee-8009-58982651bc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:24.368954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829bc4a-a476-45ee-8009-58982651bc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:24.377959 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829bc4a-a476-45ee-8009-58982651bc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:33:24.379374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829bc4a-a476-45ee-8009-58982651bc30 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:33:24.389266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 746/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:33:26.840480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9c146-8d35-4bff-8261-974d83b81547 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:26.841028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9c146-8d35-4bff-8261-974d83b81547 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:26.841028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9c146-8d35-4bff-8261-974d83b81547 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:26.842801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 745/1491] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:33:26.848186 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fc667-5bfb-4937-bff0-5eaf30b4c76d None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:26.848629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fc667-5bfb-4937-bff0-5eaf30b4c76d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:26.848745 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fc667-5bfb-4937-bff0-5eaf30b4c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:26.867464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c47fc667-5bfb-4937-bff0-5eaf30b4c76d None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:33:26.868759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c47fc667-5bfb-4937-bff0-5eaf30b4c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:33:26.876987 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 747/1492] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:33:26.916658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9c146-8d35-4bff-8261-974d83b81547 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:33:26.927202 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9c146-8d35-4bff-8261-974d83b81547 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:33:26.930650 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f610c-4e5c-42be-8c47-ae953d89bdd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:33:26.931269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f610c-4e5c-42be-8c47-ae953d89bdd3 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:26.931547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f610c-4e5c-42be-8c47-ae953d89bdd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:26.931817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f610c-4e5c-42be-8c47-ae953d89bdd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:26.941223 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f610c-4e5c-42be-8c47-ae953d89bdd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:33:26.942641 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f610c-4e5c-42be-8c47-ae953d89bdd3 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:33:26.951728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 746/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:33:29.642652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab944f2-ec98-481d-a086-78f3280b763e None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:29.643177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab944f2-ec98-481d-a086-78f3280b763e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:29.643177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab944f2-ec98-481d-a086-78f3280b763e None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:29.645008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 748/1494] 10.222.0.25 () {54 vars in 926 bytes} [Tue Mar 8 15:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:33:29.650250 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a284f9-5d9e-4e59-80fc-dda373c0ae73 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:29.650726 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a284f9-5d9e-4e59-80fc-dda373c0ae73 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:29.650907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a284f9-5d9e-4e59-80fc-dda373c0ae73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:29.670090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-55a284f9-5d9e-4e59-80fc-dda373c0ae73 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:33:29.671452 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-55a284f9-5d9e-4e59-80fc-dda373c0ae73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:33:29.679994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 747/1495] 10.222.0.25 () {58 vars in 1023 bytes} [Tue Mar 8 15:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:33:29.717929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab944f2-ec98-481d-a086-78f3280b763e None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:33:29.728800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab944f2-ec98-481d-a086-78f3280b763e None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:33:29.732263 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118b326-799a-4923-a887-62e172e0de74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:33:29.732885 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118b326-799a-4923-a887-62e172e0de74 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:33:29.733168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118b326-799a-4923-a887-62e172e0de74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:33:29.733442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118b326-799a-4923-a887-62e172e0de74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:33:29.742660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118b326-799a-4923-a887-62e172e0de74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:33:29.744076 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118b326-799a-4923-a887-62e172e0de74 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:33:29.753158 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 749/1496] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:35:05.398684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19f2fb-7b9f-474f-a330-db2bb891fd31 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:05.399242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19f2fb-7b9f-474f-a330-db2bb891fd31 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:05.399242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19f2fb-7b9f-474f-a330-db2bb891fd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:05.417295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ef19f2fb-7b9f-474f-a330-db2bb891fd31 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:35:05.418513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ef19f2fb-7b9f-474f-a330-db2bb891fd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:35:05.426090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 748/1497] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:35:05.434929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261b58e-32e5-46f0-bb78-04a42a067712 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:05.435420 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261b58e-32e5-46f0-bb78-04a42a067712 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:05.435518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261b58e-32e5-46f0-bb78-04a42a067712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:05.453256 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a261b58e-32e5-46f0-bb78-04a42a067712 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:35:05.454694 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a261b58e-32e5-46f0-bb78-04a42a067712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:35:05.462261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 750/1498] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:35:05.467232 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19f2fb-7b9f-474f-a330-db2bb891fd31 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:35:05.476750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19f2fb-7b9f-474f-a330-db2bb891fd31 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:35:05.481067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e08ec-b5fd-4b14-bde7-2dcc2eeaa5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:35:05.481699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e08ec-b5fd-4b14-bde7-2dcc2eeaa5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:05.481980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e08ec-b5fd-4b14-bde7-2dcc2eeaa5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:05.482249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e08ec-b5fd-4b14-bde7-2dcc2eeaa5c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:05.482958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e08ec-b5fd-4b14-bde7-2dcc2eeaa5c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:35:05.483261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e08ec-b5fd-4b14-bde7-2dcc2eeaa5c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:35:05.484291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING py.warnings [None req-de2e08ec-b5fd-4b14-bde7-2dcc2eeaa5c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:35:05.484291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: warnings.warn(msg) Mar 08 15:35:05.484291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: Mar 08 15:35:05.485158 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e08ec-b5fd-4b14-bde7-2dcc2eeaa5c8 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:35:05.496239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 749/1499] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:35:05.504005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261b58e-32e5-46f0-bb78-04a42a067712 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:35:05.513383 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261b58e-32e5-46f0-bb78-04a42a067712 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:35:05.517865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc144a1-f3e6-4f36-8e6c-93ffa37fbb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:35:05.518500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc144a1-f3e6-4f36-8e6c-93ffa37fbb01 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:05.518784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc144a1-f3e6-4f36-8e6c-93ffa37fbb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:05.519089 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc144a1-f3e6-4f36-8e6c-93ffa37fbb01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:05.519774 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc144a1-f3e6-4f36-8e6c-93ffa37fbb01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:35:05.521507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING py.warnings [None req-8bc144a1-f3e6-4f36-8e6c-93ffa37fbb01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:35:05.521507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: warnings.warn(msg) Mar 08 15:35:05.521507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: Mar 08 15:35:05.522688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc144a1-f3e6-4f36-8e6c-93ffa37fbb01 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:35:05.621444 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 751/1500] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:35:05 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:35:05.626166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e08ec-b5fd-4b14-bde7-2dcc2eeaa5c8 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:35:05.635873 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e08ec-b5fd-4b14-bde7-2dcc2eeaa5c8 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:35:05.688540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b72e-b0bc-4ea3-ab9a-8cf73c8279ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:35:05.689163 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b72e-b0bc-4ea3-ab9a-8cf73c8279ca admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:05.689442 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b72e-b0bc-4ea3-ab9a-8cf73c8279ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:05.689714 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b72e-b0bc-4ea3-ab9a-8cf73c8279ca admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:05.690395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1b72e-b0bc-4ea3-ab9a-8cf73c8279ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:35:05.691408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING py.warnings [None req-c8b1b72e-b0bc-4ea3-ab9a-8cf73c8279ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:35:05.691408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: warnings.warn(msg) Mar 08 15:35:05.691408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: Mar 08 15:35:05.692643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1b72e-b0bc-4ea3-ab9a-8cf73c8279ca admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:35:05.775036 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 750/1501] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:35:05 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:35:05.779458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc144a1-f3e6-4f36-8e6c-93ffa37fbb01 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:35:05.789555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc144a1-f3e6-4f36-8e6c-93ffa37fbb01 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:35:05.794111 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc9867-125d-4048-bc64-ff1657ddbc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:35:05.794759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc9867-125d-4048-bc64-ff1657ddbc0f admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:05.799422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc9867-125d-4048-bc64-ff1657ddbc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:05.799422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc9867-125d-4048-bc64-ff1657ddbc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:05.799422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc9867-125d-4048-bc64-ff1657ddbc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:35:05.799422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING py.warnings [None req-c1bc9867-125d-4048-bc64-ff1657ddbc0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:35:05.799422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: warnings.warn(msg) Mar 08 15:35:05.799422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: Mar 08 15:35:05.799422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc9867-125d-4048-bc64-ff1657ddbc0f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:35:05.811238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 752/1502] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:35:05.815017 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b72e-b0bc-4ea3-ab9a-8cf73c8279ca admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:35:05.825513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b72e-b0bc-4ea3-ab9a-8cf73c8279ca admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:35:05.830251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c42aff-2ea3-4c8c-97d1-af3d731faf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:35:05.830891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42aff-2ea3-4c8c-97d1-af3d731faf56 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:05.831173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42aff-2ea3-4c8c-97d1-af3d731faf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:05.831451 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42aff-2ea3-4c8c-97d1-af3d731faf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:05.832186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c42aff-2ea3-4c8c-97d1-af3d731faf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:35:05.833198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING py.warnings [None req-d1c42aff-2ea3-4c8c-97d1-af3d731faf56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:35:05.833198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: warnings.warn(msg) Mar 08 15:35:05.833198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: Mar 08 15:35:05.834074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c42aff-2ea3-4c8c-97d1-af3d731faf56 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:35:05.847304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 751/1503] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:35:05.851198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc9867-125d-4048-bc64-ff1657ddbc0f admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:35:05.860993 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc9867-125d-4048-bc64-ff1657ddbc0f admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:35:05.865503 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a38a9-9bee-460e-9ce7-d11a1cb4ae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:35:05.866392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a38a9-9bee-460e-9ce7-d11a1cb4ae94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:05.866674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a38a9-9bee-460e-9ce7-d11a1cb4ae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:05.866945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a38a9-9bee-460e-9ce7-d11a1cb4ae94 admin admin] PATH_INFO: `/v3/projects/0141f1d4d2fc4273942d32500e59d5bf/users/0bf31dcbeb1e4a43b4f3debfe1289aa0/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:05.881282 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a38a9-9bee-460e-9ce7-d11a1cb4ae94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0141f1d4d2fc4273942d32500e59d5bf, user_id=0bf31dcbeb1e4a43b4f3debfe1289aa0, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:35:05.882299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING py.warnings [None req-7f4a38a9-9bee-460e-9ce7-d11a1cb4ae94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:35:05.882299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: warnings.warn(msg) Mar 08 15:35:05.882299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: Mar 08 15:35:05.884238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a38a9-9bee-460e-9ce7-d11a1cb4ae94 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:35:05.973120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 753/1504] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:35:05 2022] PUT /identity/v3/projects/0141f1d4d2fc4273942d32500e59d5bf/users/0bf31dcbeb1e4a43b4f3debfe1289aa0/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:35:05.984700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e06e1-38df-477b-a748-47c011362697 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:05.984995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e06e1-38df-477b-a748-47c011362697 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:05.985285 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e06e1-38df-477b-a748-47c011362697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:06.012000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-2b6e06e1-38df-477b-a748-47c011362697 None None] MFA Rules not processed for user `0bf31dcbeb1e4a43b4f3debfe1289aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:35:06.013234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2b6e06e1-38df-477b-a748-47c011362697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:35:06.073456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 752/1505] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:35:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:35:06.084701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a38a9-9bee-460e-9ce7-d11a1cb4ae94 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:35:06.152564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a38a9-9bee-460e-9ce7-d11a1cb4ae94 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:35:06.157967 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c9eb2-8a19-451e-90ed-1b09342b3deb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:35:06.158601 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c9eb2-8a19-451e-90ed-1b09342b3deb service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:06.158880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c9eb2-8a19-451e-90ed-1b09342b3deb service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:06.159155 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c9eb2-8a19-451e-90ed-1b09342b3deb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:06.166577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c9eb2-8a19-451e-90ed-1b09342b3deb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:35:06.168179 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c9eb2-8a19-451e-90ed-1b09342b3deb service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:35:06.177032 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 754/1506] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:35:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:35:06.249522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46daaf6-23b3-4a78-adec-014eb7e73c8c None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:06.249815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46daaf6-23b3-4a78-adec-014eb7e73c8c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:06.250090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46daaf6-23b3-4a78-adec-014eb7e73c8c None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:06.251823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 753/1507] 10.222.0.25 () {52 vars in 829 bytes} [Tue Mar 8 15:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:35:06.255484 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c9eb2-8a19-451e-90ed-1b09342b3deb service nova] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:35:06.316674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c9eb2-8a19-451e-90ed-1b09342b3deb service nova] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:35:06.321149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:35:06.322006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:06.322286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:06.322557 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] PATH_INFO: `/v3/users/0bf31dcbeb1e4a43b4f3debfe1289aa0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:06.323720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf31dcbeb1e4a43b4f3debfe1289aa0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:35:06.324753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING py.warnings [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:35:06.324753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: warnings.warn(msg) Mar 08 15:35:06.324753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: Mar 08 15:35:06.325970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:35:06.506758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf31dcbeb1e4a43b4f3debfe1289aa0'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:35:06.507383 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf31dcbeb1e4a43b4f3debfe1289aa0'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:35:06.552213 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf31dcbeb1e4a43b4f3debfe1289aa0'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:35:06.552978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf31dcbeb1e4a43b4f3debfe1289aa0'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:35:06.574820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf31dcbeb1e4a43b4f3debfe1289aa0'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:35:06.592955 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 755/1508] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:35:06 2022] DELETE /identity/v3/users/0bf31dcbeb1e4a43b4f3debfe1289aa0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:35:06.597327 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310a651-3d2b-4470-a3e8-91f864d80c50 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:06.598512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310a651-3d2b-4470-a3e8-91f864d80c50 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:06.598512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310a651-3d2b-4470-a3e8-91f864d80c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:06.616681 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-f310a651-3d2b-4470-a3e8-91f864d80c50 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:35:06.617856 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f310a651-3d2b-4470-a3e8-91f864d80c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:35:06.677199 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 754/1509] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:35:06.686954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:35:06.688403 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:35:06.742633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d0e37-e71b-4ec8-9efc-32b4d968b6bb admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:35:06.746400 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad4a83-9086-4381-adfd-fa921533ad78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:35:06.747048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad4a83-9086-4381-adfd-fa921533ad78 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:06.747327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad4a83-9086-4381-adfd-fa921533ad78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:06.747656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad4a83-9086-4381-adfd-fa921533ad78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:06.756520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad4a83-9086-4381-adfd-fa921533ad78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:35:06.758061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad4a83-9086-4381-adfd-fa921533ad78 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:35:06.768001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 756/1510] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:35:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:35:07.211613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310a651-3d2b-4470-a3e8-91f864d80c50 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:35:07.213311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f310a651-3d2b-4470-a3e8-91f864d80c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:35:07.228450 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310a651-3d2b-4470-a3e8-91f864d80c50 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:35:07.234035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:35:07.235258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:35:07.235537 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:35:07.235807 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] PATH_INFO: `/v3/projects/0141f1d4d2fc4273942d32500e59d5bf` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:35:07.237096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0141f1d4d2fc4273942d32500e59d5bf)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:35:07.238122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING py.warnings [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:35:07.238122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: warnings.warn(msg) Mar 08 15:35:07.238122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: Mar 08 15:35:07.240048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:35:07.355891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0141f1d4d2fc4273942d32500e59d5bf', 'request_id': 'req-3a04294d-d021-48be-9435-acd593389681'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:35:07.361664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0141f1d4d2fc4273942d32500e59d5bf', 'request_id': 'req-3a04294d-d021-48be-9435-acd593389681'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:35:07.375007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0141f1d4d2fc4273942d32500e59d5bf', 'request_id': 'req-3a04294d-d021-48be-9435-acd593389681'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:35:07.492832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] The token cache is being invalidate because project 0141f1d4d2fc4273942d32500e59d5bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:35:07.493159 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:35:07.493777 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3a04294d-d021-48be-9435-acd593389681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:35:07.495451 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 755/1511] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:35:07 2022] DELETE /identity/v3/projects/0141f1d4d2fc4273942d32500e59d5bf => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:36:44.269903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619308fb-e356-45fe-bb8a-2da37b44c87f None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:44.270478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619308fb-e356-45fe-bb8a-2da37b44c87f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:44.270478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619308fb-e356-45fe-bb8a-2da37b44c87f None None] PATH_INFO: `/v3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:44.271765 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 757/1512] 10.222.0.24 () {54 vars in 925 bytes} [Tue Mar 8 15:36:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:36:44.278060 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fad8b-c440-4a4e-8948-1603b9acdd93 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:44.278536 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fad8b-c440-4a4e-8948-1603b9acdd93 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:44.278642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fad8b-c440-4a4e-8948-1603b9acdd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:44.297302 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-2f9fad8b-c440-4a4e-8948-1603b9acdd93 None None] MFA Rules not processed for user `13471dce9430484ab46b355d1303f504`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:36:44.298491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2f9fad8b-c440-4a4e-8948-1603b9acdd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:36:44.359358 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 756/1513] 10.222.0.24 () {58 vars in 1015 bytes} [Tue Mar 8 15:36:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:36:44.423248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c5a69-01aa-4734-b9b9-6d2ca1ecd045 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:44.423487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c5a69-01aa-4734-b9b9-6d2ca1ecd045 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:44.423766 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c5a69-01aa-4734-b9b9-6d2ca1ecd045 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:44.426286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 15:36:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:36:44.431095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a43cf-bdf1-4e6b-924b-eb3a6c4c968c None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:44.431388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a43cf-bdf1-4e6b-924b-eb3a6c4c968c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:44.431663 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a43cf-bdf1-4e6b-924b-eb3a6c4c968c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:44.450256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-415a43cf-bdf1-4e6b-924b-eb3a6c4c968c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:36:44.451441 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-415a43cf-bdf1-4e6b-924b-eb3a6c4c968c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:36:44.507699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 15:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:36:44.663909 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c5a69-01aa-4734-b9b9-6d2ca1ecd045 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:36:44.665675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-256c5a69-01aa-4734-b9b9-6d2ca1ecd045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:36:44.738616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c5a69-01aa-4734-b9b9-6d2ca1ecd045 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:36:44.744381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515cdf1-8c50-4a55-8243-9e0fe904468c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:36:44.745029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515cdf1-8c50-4a55-8243-9e0fe904468c service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:44.745319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515cdf1-8c50-4a55-8243-9e0fe904468c service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:44.745604 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515cdf1-8c50-4a55-8243-9e0fe904468c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:44.754311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515cdf1-8c50-4a55-8243-9e0fe904468c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:36:44.755897 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515cdf1-8c50-4a55-8243-9e0fe904468c service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:36:44.765105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 759/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:36:46.043347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b818fc-b782-4aeb-94a9-c3089b6d7c0a None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:46.043994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b818fc-b782-4aeb-94a9-c3089b6d7c0a None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:46.043994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b818fc-b782-4aeb-94a9-c3089b6d7c0a None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:46.045690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 758/1517] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 15:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:36:46.051079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc879f-69f6-42c2-a143-5a3a57c57855 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:46.051504 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc879f-69f6-42c2-a143-5a3a57c57855 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:46.051639 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc879f-69f6-42c2-a143-5a3a57c57855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:46.069291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f3cc879f-69f6-42c2-a143-5a3a57c57855 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:36:46.070484 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f3cc879f-69f6-42c2-a143-5a3a57c57855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:36:46.078476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 760/1518] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 15:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:36:46.235074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b818fc-b782-4aeb-94a9-c3089b6d7c0a None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:36:46.250144 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b818fc-b782-4aeb-94a9-c3089b6d7c0a None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:36:46.255730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5958dd-75f0-4f07-a05d-37bf4d33a444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:36:46.256408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5958dd-75f0-4f07-a05d-37bf4d33a444 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:46.256702 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5958dd-75f0-4f07-a05d-37bf4d33a444 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:46.257068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5958dd-75f0-4f07-a05d-37bf4d33a444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:46.265404 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5958dd-75f0-4f07-a05d-37bf4d33a444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:36:46.266989 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5958dd-75f0-4f07-a05d-37bf4d33a444 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:36:46.276960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 759/1519] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:36:48.582028 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696863c-22cc-42de-8241-87535b565661 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:48.582550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696863c-22cc-42de-8241-87535b565661 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:48.582550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696863c-22cc-42de-8241-87535b565661 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:48.584266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 761/1520] 10.222.0.25 () {54 vars in 960 bytes} [Tue Mar 8 15:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:36:48.589196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab43daa-0195-4a1e-b90d-dc21ea965b40 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:48.589629 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab43daa-0195-4a1e-b90d-dc21ea965b40 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:48.589737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab43daa-0195-4a1e-b90d-dc21ea965b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:48.610045 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-0ab43daa-0195-4a1e-b90d-dc21ea965b40 None None] MFA Rules not processed for user `13471dce9430484ab46b355d1303f504`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:36:48.611261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0ab43daa-0195-4a1e-b90d-dc21ea965b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:36:48.619948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 760/1521] 10.222.0.25 () {58 vars in 1057 bytes} [Tue Mar 8 15:36:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:36:48.629136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696863c-22cc-42de-8241-87535b565661 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:36:48.642886 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696863c-22cc-42de-8241-87535b565661 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:36:48.648649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f63ffe-1ffc-486a-ba99-38a5da6cf436 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13471dce9430484ab46b355d1303f504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:36:48.649275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f63ffe-1ffc-486a-ba99-38a5da6cf436 service placement] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:48.649553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f63ffe-1ffc-486a-ba99-38a5da6cf436 service placement] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:48.649839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f63ffe-1ffc-486a-ba99-38a5da6cf436 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:48.658580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f63ffe-1ffc-486a-ba99-38a5da6cf436 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:36:48.662189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f63ffe-1ffc-486a-ba99-38a5da6cf436 service placement] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:36:48.670779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 762/1522] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:36:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:36:57.976526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904f3e5-de4e-4323-9169-b33ef15d1c98 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:57.977066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904f3e5-de4e-4323-9169-b33ef15d1c98 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:57.977066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904f3e5-de4e-4323-9169-b33ef15d1c98 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:57.978846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 761/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 15:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:36:57.983566 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020ea6a-964a-4d97-ab16-b8bcfe9341e3 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:57.983989 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020ea6a-964a-4d97-ab16-b8bcfe9341e3 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:57.984126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020ea6a-964a-4d97-ab16-b8bcfe9341e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:58.002165 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-0020ea6a-964a-4d97-ab16-b8bcfe9341e3 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:36:58.003345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0020ea6a-964a-4d97-ab16-b8bcfe9341e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:36:58.010967 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 763/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 15:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:36:58.162840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904f3e5-de4e-4323-9169-b33ef15d1c98 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:36:58.179370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904f3e5-de4e-4323-9169-b33ef15d1c98 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:36:58.185744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837341fa-0809-476c-9c5d-a1a4e312ece6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:36:58.186374 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837341fa-0809-476c-9c5d-a1a4e312ece6 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:58.186676 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837341fa-0809-476c-9c5d-a1a4e312ece6 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:58.186944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837341fa-0809-476c-9c5d-a1a4e312ece6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:58.195149 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837341fa-0809-476c-9c5d-a1a4e312ece6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:36:58.196786 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837341fa-0809-476c-9c5d-a1a4e312ece6 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:36:58.206663 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 762/1525] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:36:59.472299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d4d66-c21e-4178-a8c3-2be8f434fcf8 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:59.472824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d4d66-c21e-4178-a8c3-2be8f434fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:59.472824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d4d66-c21e-4178-a8c3-2be8f434fcf8 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:59.474533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 764/1526] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 15:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:36:59.479290 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e2f7b-f4d8-42be-8d8e-8231ed402cd2 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:59.479708 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e2f7b-f4d8-42be-8d8e-8231ed402cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:59.479823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e2f7b-f4d8-42be-8d8e-8231ed402cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:59.497880 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b49e2f7b-f4d8-42be-8d8e-8231ed402cd2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:36:59.499068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b49e2f7b-f4d8-42be-8d8e-8231ed402cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:36:59.506708 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 763/1527] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 15:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:36:59.657598 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d4d66-c21e-4178-a8c3-2be8f434fcf8 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:36:59.672108 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d4d66-c21e-4178-a8c3-2be8f434fcf8 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:36:59.677880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339cb946-3a88-4615-8098-a1b42b4cf754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:36:59.678499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cb946-3a88-4615-8098-a1b42b4cf754 service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:36:59.678779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cb946-3a88-4615-8098-a1b42b4cf754 service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:36:59.679051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339cb946-3a88-4615-8098-a1b42b4cf754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:36:59.687172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339cb946-3a88-4615-8098-a1b42b4cf754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:36:59.688871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339cb946-3a88-4615-8098-a1b42b4cf754 service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:36:59.699546 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 765/1528] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:37:04.024277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6102b-0a0a-4cd2-b39d-df0ba7da8f0d None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:04.024851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6102b-0a0a-4cd2-b39d-df0ba7da8f0d None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:04.024851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6102b-0a0a-4cd2-b39d-df0ba7da8f0d None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:04.026595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 764/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:37:04.031796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bbc97-661b-4532-8f12-548667b9ae96 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:04.032200 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bbc97-661b-4532-8f12-548667b9ae96 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:04.032390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bbc97-661b-4532-8f12-548667b9ae96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:04.050469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f12bbc97-661b-4532-8f12-548667b9ae96 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:37:04.052286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f12bbc97-661b-4532-8f12-548667b9ae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:37:04.059968 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 766/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:37:04.096497 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6102b-0a0a-4cd2-b39d-df0ba7da8f0d None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:37:04.098766 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a3e6102b-0a0a-4cd2-b39d-df0ba7da8f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:37:04.152971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6102b-0a0a-4cd2-b39d-df0ba7da8f0d None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:37:04.156488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d6793-d24c-4e8a-988d-565df916c09e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:37:04.157125 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d6793-d24c-4e8a-988d-565df916c09e service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:04.157410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d6793-d24c-4e8a-988d-565df916c09e service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:04.157685 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d6793-d24c-4e8a-988d-565df916c09e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:04.167654 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d6793-d24c-4e8a-988d-565df916c09e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:37:04.169119 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d6793-d24c-4e8a-988d-565df916c09e service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:37:04.178454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 765/1531] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:37:06.450511 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be7f2b-59ce-4491-82b6-93634aae1622 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:06.451045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be7f2b-59ce-4491-82b6-93634aae1622 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:06.451045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be7f2b-59ce-4491-82b6-93634aae1622 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:06.452768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 767/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:37:06.457918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662269c-922b-4014-9ead-bb3d03efc919 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:06.458343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662269c-922b-4014-9ead-bb3d03efc919 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:06.458455 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662269c-922b-4014-9ead-bb3d03efc919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:06.475551 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-9662269c-922b-4014-9ead-bb3d03efc919 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:37:06.476745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9662269c-922b-4014-9ead-bb3d03efc919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:37:06.484325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 766/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:37:06.519222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be7f2b-59ce-4491-82b6-93634aae1622 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:37:06.529557 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be7f2b-59ce-4491-82b6-93634aae1622 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:37:06.533014 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d33fea-09fa-4137-9385-0e11f8120de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:37:06.533628 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33fea-09fa-4137-9385-0e11f8120de7 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:06.533908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33fea-09fa-4137-9385-0e11f8120de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:06.534177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d33fea-09fa-4137-9385-0e11f8120de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:06.542729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d33fea-09fa-4137-9385-0e11f8120de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:37:06.544137 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d33fea-09fa-4137-9385-0e11f8120de7 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:37:06.553633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 768/1534] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:37:10.569743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7fd8c-16e2-4f2f-b25b-5374535c8932 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:10.570315 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7fd8c-16e2-4f2f-b25b-5374535c8932 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:10.570315 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7fd8c-16e2-4f2f-b25b-5374535c8932 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:10.572278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 767/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:37:10.577363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06def7-1dcb-48c2-8170-a55775f7474b None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:10.577806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06def7-1dcb-48c2-8170-a55775f7474b None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:10.577910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06def7-1dcb-48c2-8170-a55775f7474b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:10.596040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5f06def7-1dcb-48c2-8170-a55775f7474b None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:37:10.597232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5f06def7-1dcb-48c2-8170-a55775f7474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:37:10.604769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 769/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:37:10.861775 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7fd8c-16e2-4f2f-b25b-5374535c8932 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:37:10.863498 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3dc7fd8c-16e2-4f2f-b25b-5374535c8932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:37:10.919244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7fd8c-16e2-4f2f-b25b-5374535c8932 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:37:10.922920 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48fc02-c78f-42a0-b55a-16f93ac1fad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:37:10.923872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48fc02-c78f-42a0-b55a-16f93ac1fad0 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:10.924177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48fc02-c78f-42a0-b55a-16f93ac1fad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:10.924461 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48fc02-c78f-42a0-b55a-16f93ac1fad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:10.933988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48fc02-c78f-42a0-b55a-16f93ac1fad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:37:10.935480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48fc02-c78f-42a0-b55a-16f93ac1fad0 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:37:10.945357 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 768/1537] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:37:13.352665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00401d-d28f-4778-a301-85c5b10869ec None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:13.353212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00401d-d28f-4778-a301-85c5b10869ec None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:13.353212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00401d-d28f-4778-a301-85c5b10869ec None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:13.354992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 770/1538] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 15:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:37:13.360100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e5106-ab82-45b7-ad7f-a24ad07a8e4e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:13.360524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e5106-ab82-45b7-ad7f-a24ad07a8e4e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:13.360695 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e5106-ab82-45b7-ad7f-a24ad07a8e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:13.377927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-791e5106-ab82-45b7-ad7f-a24ad07a8e4e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:37:13.379114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-791e5106-ab82-45b7-ad7f-a24ad07a8e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:37:13.386839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 769/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:37:13.643264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c2175-0ad9-4a48-993e-bc7f694dbdf5 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:13.643551 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c2175-0ad9-4a48-993e-bc7f694dbdf5 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:13.643826 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c2175-0ad9-4a48-993e-bc7f694dbdf5 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:13.646248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 771/1540] 10.222.0.25 () {54 vars in 963 bytes} [Tue Mar 8 15:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:37:13.651247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e994-0517-443b-bc99-dc7fca282b66 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:13.651598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e994-0517-443b-bc99-dc7fca282b66 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:13.651879 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e994-0517-443b-bc99-dc7fca282b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:13.669980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-db19e994-0517-443b-bc99-dc7fca282b66 None None] MFA Rules not processed for user `7acd143470fb416c8adc57351c5d0324`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:37:13.671173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-db19e994-0517-443b-bc99-dc7fca282b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:37:13.677785 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 770/1541] 10.222.0.25 () {58 vars in 1060 bytes} [Tue Mar 8 15:37:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:37:13.685131 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c2175-0ad9-4a48-993e-bc7f694dbdf5 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:37:13.695877 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c2175-0ad9-4a48-993e-bc7f694dbdf5 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:37:13.699660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70863a0a-b326-40f8-b8fc-307831772317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:37:13.703286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70863a0a-b326-40f8-b8fc-307831772317 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:37:13.703286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70863a0a-b326-40f8-b8fc-307831772317 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:37:13.703286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70863a0a-b326-40f8-b8fc-307831772317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:37:13.710177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70863a0a-b326-40f8-b8fc-307831772317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:37:13.711586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70863a0a-b326-40f8-b8fc-307831772317 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:37:13.720761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 772/1542] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:38:44.469795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ff88-c6c6-440c-854b-a5fed3c80a7d None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:44.471775 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ff88-c6c6-440c-854b-a5fed3c80a7d None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:44.471775 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ff88-c6c6-440c-854b-a5fed3c80a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:44.497487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b2c5ff88-c6c6-440c-854b-a5fed3c80a7d None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:44.499161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b2c5ff88-c6c6-440c-854b-a5fed3c80a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:44.511621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 771/1543] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:44.520443 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdaad2e-d919-40c5-9297-d23a4454d6d4 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:44.521025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdaad2e-d919-40c5-9297-d23a4454d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:44.521025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdaad2e-d919-40c5-9297-d23a4454d6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:44.552499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-8cdaad2e-d919-40c5-9297-d23a4454d6d4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:44.553741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8cdaad2e-d919-40c5-9297-d23a4454d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:44.573232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 773/1544] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:44.577797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5ff88-c6c6-440c-854b-a5fed3c80a7d None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:44.589648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5ff88-c6c6-440c-854b-a5fed3c80a7d None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:44.600753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850c2e6-9122-4f05-a67d-7838749e8384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:44.601830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c2e6-9122-4f05-a67d-7838749e8384 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:44.602336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c2e6-9122-4f05-a67d-7838749e8384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:44.602832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850c2e6-9122-4f05-a67d-7838749e8384 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:44.603783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850c2e6-9122-4f05-a67d-7838749e8384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:38:44.604343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850c2e6-9122-4f05-a67d-7838749e8384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:44.610448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850c2e6-9122-4f05-a67d-7838749e8384 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:44.624337 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 772/1545] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:38:44.633523 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdaad2e-d919-40c5-9297-d23a4454d6d4 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:44.648861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdaad2e-d919-40c5-9297-d23a4454d6d4 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:44.662825 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8b12e-43da-47f1-98cd-c55bcd632fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:44.663825 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b12e-43da-47f1-98cd-c55bcd632fed admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:44.664172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b12e-43da-47f1-98cd-c55bcd632fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:44.664469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b12e-43da-47f1-98cd-c55bcd632fed admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:44.665185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8b12e-43da-47f1-98cd-c55bcd632fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:44.667312 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8b12e-43da-47f1-98cd-c55bcd632fed admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:44.746335 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715f68-acfb-4a2a-9ad0-a7ac045c1951 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:44.746994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715f68-acfb-4a2a-9ad0-a7ac045c1951 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:44.747640 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715f68-acfb-4a2a-9ad0-a7ac045c1951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:44.782529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b2715f68-acfb-4a2a-9ad0-a7ac045c1951 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:44.784217 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b2715f68-acfb-4a2a-9ad0-a7ac045c1951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:44.792827 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 774/1546] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:38:44 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:44.805006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e5c0b-4383-4276-a0f1-784d074a59b7 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:44.805006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e5c0b-4383-4276-a0f1-784d074a59b7 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:44.805006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e5c0b-4383-4276-a0f1-784d074a59b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:44.805320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 773/1547] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:38:44.805320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715f68-acfb-4a2a-9ad0-a7ac045c1951 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:44.822705 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715f68-acfb-4a2a-9ad0-a7ac045c1951 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:44.858500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c48e5c0b-4383-4276-a0f1-784d074a59b7 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:44.862595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c48e5c0b-4383-4276-a0f1-784d074a59b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:44.964254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50da35b-e065-4e26-910d-203b199d9796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:44.965375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50da35b-e065-4e26-910d-203b199d9796 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:44.965889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50da35b-e065-4e26-910d-203b199d9796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:44.966387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50da35b-e065-4e26-910d-203b199d9796 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:44.967335 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50da35b-e065-4e26-910d-203b199d9796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:44.970294 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50da35b-e065-4e26-910d-203b199d9796 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.008247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 775/1548] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.009394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72d658-626d-448c-ac0f-3881f119807a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.009685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72d658-626d-448c-ac0f-3881f119807a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.009960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72d658-626d-448c-ac0f-3881f119807a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.036589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-2e72d658-626d-448c-ac0f-3881f119807a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:45.037984 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2e72d658-626d-448c-ac0f-3881f119807a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:45.046012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 776/1549] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.047810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9d1ae-5d93-477d-ac6a-d6276d792efb None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.048093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9d1ae-5d93-477d-ac6a-d6276d792efb None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.048458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9d1ae-5d93-477d-ac6a-d6276d792efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.067852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 774/1550] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:38:44 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:45.069337 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b22851-4ef4-40a3-a2fb-171e82dc0373 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.069533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-cbb9d1ae-5d93-477d-ac6a-d6276d792efb None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:45.069948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b22851-4ef4-40a3-a2fb-171e82dc0373 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.070643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b22851-4ef4-40a3-a2fb-171e82dc0373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.070759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-cbb9d1ae-5d93-477d-ac6a-d6276d792efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:45.079645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 777/1551] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.082204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557c8b4-e6ec-4331-b650-c74e7b229e2a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.082520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557c8b4-e6ec-4331-b650-c74e7b229e2a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.082839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557c8b4-e6ec-4331-b650-c74e7b229e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.089421 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-d0b22851-4ef4-40a3-a2fb-171e82dc0373 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:45.090687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d0b22851-4ef4-40a3-a2fb-171e82dc0373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:45.098572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 775/1552] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.099802 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d60cf-1689-4799-90d5-91b4e91d12cc None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.100078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d60cf-1689-4799-90d5-91b4e91d12cc None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.100389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d60cf-1689-4799-90d5-91b4e91d12cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.102634 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-1557c8b4-e6ec-4331-b650-c74e7b229e2a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:45.103827 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-1557c8b4-e6ec-4331-b650-c74e7b229e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:45.111674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 778/1553] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.113033 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35edf8-9e6a-4930-b5ad-8ca642baa843 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.114316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35edf8-9e6a-4930-b5ad-8ca642baa843 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.114618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35edf8-9e6a-4930-b5ad-8ca642baa843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.117816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-0a7d60cf-1689-4799-90d5-91b4e91d12cc None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:45.118992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0a7d60cf-1689-4799-90d5-91b4e91d12cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:45.126691 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 776/1554] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.128252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d60cf-1689-4799-90d5-91b4e91d12cc None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.132413 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-fc35edf8-9e6a-4930-b5ad-8ca642baa843 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:45.133582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-fc35edf8-9e6a-4930-b5ad-8ca642baa843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:45.138283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d60cf-1689-4799-90d5-91b4e91d12cc None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.141392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 779/1555] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.142839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7f254-c897-497a-b0c3-d5a2cdc936e0 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.142934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7f254-c897-497a-b0c3-d5a2cdc936e0 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.143202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7f254-c897-497a-b0c3-d5a2cdc936e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.143673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0992b-f26c-477f-a61f-067687e7b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.144506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0992b-f26c-477f-a61f-067687e7b825 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.144717 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0992b-f26c-477f-a61f-067687e7b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.144991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0992b-f26c-477f-a61f-067687e7b825 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.145716 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0992b-f26c-477f-a61f-067687e7b825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:38:45.146022 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0992b-f26c-477f-a61f-067687e7b825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.147622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0992b-f26c-477f-a61f-067687e7b825 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.159454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 777/1556] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:38:45.160783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0992b-f26c-477f-a61f-067687e7b825 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.161399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f6a7f254-c897-497a-b0c3-d5a2cdc936e0 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:45.162582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f6a7f254-c897-497a-b0c3-d5a2cdc936e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:45.170232 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0992b-f26c-477f-a61f-067687e7b825 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.170781 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 780/1557] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.171938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c6512-9092-4a8e-b885-5499acc61234 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.172262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c6512-9092-4a8e-b885-5499acc61234 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.172533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c6512-9092-4a8e-b885-5499acc61234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.175054 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968a0f5-aa01-44a0-b29a-e60f5392c0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.175746 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a0f5-aa01-44a0-b29a-e60f5392c0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.176078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a0f5-aa01-44a0-b29a-e60f5392c0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.176342 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968a0f5-aa01-44a0-b29a-e60f5392c0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.177069 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968a0f5-aa01-44a0-b29a-e60f5392c0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.178674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968a0f5-aa01-44a0-b29a-e60f5392c0e6 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.189359 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 778/1558] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:45.190609 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b303197-1331-4b50-8699-906ee28d0c8e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.191698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b303197-1331-4b50-8699-906ee28d0c8e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.191823 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-d54c6512-9092-4a8e-b885-5499acc61234 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:45.192000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b303197-1331-4b50-8699-906ee28d0c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.193013 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d54c6512-9092-4a8e-b885-5499acc61234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:45.201999 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 781/1559] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.203710 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a4f07-d285-4fc9-b511-454699afe3f3 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.204333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a4f07-d285-4fc9-b511-454699afe3f3 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.204333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a4f07-d285-4fc9-b511-454699afe3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.209756 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-3b303197-1331-4b50-8699-906ee28d0c8e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:45.210931 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3b303197-1331-4b50-8699-906ee28d0c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:45.218851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 779/1560] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.219831 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b303197-1331-4b50-8699-906ee28d0c8e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.221765 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f58a4f07-d285-4fc9-b511-454699afe3f3 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:45.223139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f58a4f07-d285-4fc9-b511-454699afe3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:45.229852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b303197-1331-4b50-8699-906ee28d0c8e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.230880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 782/1561] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.232140 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ba895-b2c3-4774-91b9-a330bc2bd5f8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.232507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ba895-b2c3-4774-91b9-a330bc2bd5f8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.232738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ba895-b2c3-4774-91b9-a330bc2bd5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.235100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ef583-751b-4162-bbcf-380707d2095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.235734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ef583-751b-4162-bbcf-380707d2095d admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.236045 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ef583-751b-4162-bbcf-380707d2095d admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.236345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ef583-751b-4162-bbcf-380707d2095d admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.237059 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ef583-751b-4162-bbcf-380707d2095d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:38:45.237359 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ef583-751b-4162-bbcf-380707d2095d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.239488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ef583-751b-4162-bbcf-380707d2095d admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.250336 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-0f8ba895-b2c3-4774-91b9-a330bc2bd5f8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:45.254820 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 780/1562] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:38:45.254820 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ef583-751b-4162-bbcf-380707d2095d admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.255040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0f8ba895-b2c3-4774-91b9-a330bc2bd5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:45.263565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 783/1563] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.264787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190613b-8afd-4d0e-9041-eb7ede0fabbc None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.265077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190613b-8afd-4d0e-9041-eb7ede0fabbc None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.265353 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190613b-8afd-4d0e-9041-eb7ede0fabbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.267298 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ef583-751b-4162-bbcf-380707d2095d admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.272727 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07952012-d3ae-4eb5-9e9d-fc1f4b80eaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.273488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07952012-d3ae-4eb5-9e9d-fc1f4b80eaad admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.273771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07952012-d3ae-4eb5-9e9d-fc1f4b80eaad admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.274042 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07952012-d3ae-4eb5-9e9d-fc1f4b80eaad admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.274722 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07952012-d3ae-4eb5-9e9d-fc1f4b80eaad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.275732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING py.warnings [None req-07952012-d3ae-4eb5-9e9d-fc1f4b80eaad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:38:45.275732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: warnings.warn(msg) Mar 08 15:38:45.275732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: Mar 08 15:38:45.276943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07952012-d3ae-4eb5-9e9d-fc1f4b80eaad admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.282975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-7190613b-8afd-4d0e-9041-eb7ede0fabbc None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:45.284133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7190613b-8afd-4d0e-9041-eb7ede0fabbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:45.292486 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 784/1564] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:45.293288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190613b-8afd-4d0e-9041-eb7ede0fabbc None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.302626 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190613b-8afd-4d0e-9041-eb7ede0fabbc None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.307086 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89622-d3fc-4e21-8b45-3f9c93f2a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.307715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89622-d3fc-4e21-8b45-3f9c93f2a783 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.307993 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89622-d3fc-4e21-8b45-3f9c93f2a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.308296 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89622-d3fc-4e21-8b45-3f9c93f2a783 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.309001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd89622-d3fc-4e21-8b45-3f9c93f2a783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.310586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd89622-d3fc-4e21-8b45-3f9c93f2a783 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.320321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 785/1565] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:45.321085 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89622-d3fc-4e21-8b45-3f9c93f2a783 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.330370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89622-d3fc-4e21-8b45-3f9c93f2a783 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.335289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101c05a-c1cb-4a7b-aed6-bd780e53ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.335888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101c05a-c1cb-4a7b-aed6-bd780e53ce54 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.336196 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101c05a-c1cb-4a7b-aed6-bd780e53ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.336474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101c05a-c1cb-4a7b-aed6-bd780e53ce54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.337167 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101c05a-c1cb-4a7b-aed6-bd780e53ce54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:38:45.337471 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101c05a-c1cb-4a7b-aed6-bd780e53ce54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.338446 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING py.warnings [None req-5101c05a-c1cb-4a7b-aed6-bd780e53ce54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:38:45.338446 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: warnings.warn(msg) Mar 08 15:38:45.338446 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: Mar 08 15:38:45.339302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101c05a-c1cb-4a7b-aed6-bd780e53ce54 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.350977 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 786/1566] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:38:45.351717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101c05a-c1cb-4a7b-aed6-bd780e53ce54 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.360871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101c05a-c1cb-4a7b-aed6-bd780e53ce54 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.366342 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 781/1567] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:45.366342 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07952012-d3ae-4eb5-9e9d-fc1f4b80eaad admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.417779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd329b4e-d7a8-4dbf-a9e8-8f9b02d1c22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.418462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd329b4e-d7a8-4dbf-a9e8-8f9b02d1c22e admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.418767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd329b4e-d7a8-4dbf-a9e8-8f9b02d1c22e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.419048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd329b4e-d7a8-4dbf-a9e8-8f9b02d1c22e admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.419760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd329b4e-d7a8-4dbf-a9e8-8f9b02d1c22e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:38:45.420066 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd329b4e-d7a8-4dbf-a9e8-8f9b02d1c22e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.421698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd329b4e-d7a8-4dbf-a9e8-8f9b02d1c22e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.421840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07952012-d3ae-4eb5-9e9d-fc1f4b80eaad admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.426519 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48100d7c-1385-44f6-83b9-7d4853ef7342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.427160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48100d7c-1385-44f6-83b9-7d4853ef7342 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.427440 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48100d7c-1385-44f6-83b9-7d4853ef7342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.427709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48100d7c-1385-44f6-83b9-7d4853ef7342 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.428453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48100d7c-1385-44f6-83b9-7d4853ef7342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:38:45.428753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48100d7c-1385-44f6-83b9-7d4853ef7342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.430318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48100d7c-1385-44f6-83b9-7d4853ef7342 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.432929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 787/1568] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:38:45.433701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd329b4e-d7a8-4dbf-a9e8-8f9b02d1c22e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.441992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 782/1569] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:38:45.442638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48100d7c-1385-44f6-83b9-7d4853ef7342 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.452316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48100d7c-1385-44f6-83b9-7d4853ef7342 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.453093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd329b4e-d7a8-4dbf-a9e8-8f9b02d1c22e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.457535 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e48b9-9bdf-4586-9c79-566702fb6044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.458182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e48b9-9bdf-4586-9c79-566702fb6044 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.458459 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e48b9-9bdf-4586-9c79-566702fb6044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.458569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea54f0-dc10-4669-9257-acb63d36e4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.458760 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e48b9-9bdf-4586-9c79-566702fb6044 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.459097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea54f0-dc10-4669-9257-acb63d36e4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.459383 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea54f0-dc10-4669-9257-acb63d36e4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.459486 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e48b9-9bdf-4586-9c79-566702fb6044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:38:45.459663 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea54f0-dc10-4669-9257-acb63d36e4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.459768 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e48b9-9bdf-4586-9c79-566702fb6044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.460510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea54f0-dc10-4669-9257-acb63d36e4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.461362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e48b9-9bdf-4586-9c79-566702fb6044 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.462410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea54f0-dc10-4669-9257-acb63d36e4e8 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.478855 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 783/1570] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:38:45.480417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e48b9-9bdf-4586-9c79-566702fb6044 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.489924 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e48b9-9bdf-4586-9c79-566702fb6044 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.494482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbef11-8811-4a5d-8868-0a801a9f7f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.495115 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbef11-8811-4a5d-8868-0a801a9f7f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.495395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbef11-8811-4a5d-8868-0a801a9f7f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.495666 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbef11-8811-4a5d-8868-0a801a9f7f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.496417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbef11-8811-4a5d-8868-0a801a9f7f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:38:45.496709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbef11-8811-4a5d-8868-0a801a9f7f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.498286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbef11-8811-4a5d-8868-0a801a9f7f29 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.509380 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 784/1571] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:38:45.515130 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbef11-8811-4a5d-8868-0a801a9f7f29 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.519849 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbef11-8811-4a5d-8868-0a801a9f7f29 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.524361 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891225c9-6e5c-4b37-b099-c6f3fb471d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.525187 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891225c9-6e5c-4b37-b099-c6f3fb471d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.525468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891225c9-6e5c-4b37-b099-c6f3fb471d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.525741 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891225c9-6e5c-4b37-b099-c6f3fb471d6c admin admin] PATH_INFO: `/v3/projects/59ab38d879c841aeb11a9c18728a251e/users/fb710b14dbb44ea3b8d8942e89088b17/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.540234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891225c9-6e5c-4b37-b099-c6f3fb471d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ab38d879c841aeb11a9c18728a251e, user_id=fb710b14dbb44ea3b8d8942e89088b17, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.541265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING py.warnings [None req-891225c9-6e5c-4b37-b099-c6f3fb471d6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:38:45.541265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: warnings.warn(msg) Mar 08 15:38:45.541265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: Mar 08 15:38:45.541884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 788/1572] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:45.542692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea54f0-dc10-4669-9257-acb63d36e4e8 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.543318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891225c9-6e5c-4b37-b099-c6f3fb471d6c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.603556 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea54f0-dc10-4669-9257-acb63d36e4e8 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.608138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b4e53-897d-43fc-abaa-8f848ebeba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.608804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b4e53-897d-43fc-abaa-8f848ebeba0d admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.609085 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b4e53-897d-43fc-abaa-8f848ebeba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.609358 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b4e53-897d-43fc-abaa-8f848ebeba0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.610038 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b4e53-897d-43fc-abaa-8f848ebeba0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.611942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b4e53-897d-43fc-abaa-8f848ebeba0d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.631956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 785/1573] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:45 2022] PUT /identity/v3/projects/59ab38d879c841aeb11a9c18728a251e/users/fb710b14dbb44ea3b8d8942e89088b17/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:45.635662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891225c9-6e5c-4b37-b099-c6f3fb471d6c admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.687333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 789/1574] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:45.688137 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b4e53-897d-43fc-abaa-8f848ebeba0d admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.694834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891225c9-6e5c-4b37-b099-c6f3fb471d6c admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.748587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b4e53-897d-43fc-abaa-8f848ebeba0d admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.749182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbf21f-b5ff-42f0-8177-2a4205f35a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.749844 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbf21f-b5ff-42f0-8177-2a4205f35a76 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.750221 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbf21f-b5ff-42f0-8177-2a4205f35a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.750499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbf21f-b5ff-42f0-8177-2a4205f35a76 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.751181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbf21f-b5ff-42f0-8177-2a4205f35a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.753170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbf21f-b5ff-42f0-8177-2a4205f35a76 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.753327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6270607-c72a-49dc-9b6f-2e4528695e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.754472 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6270607-c72a-49dc-9b6f-2e4528695e30 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.754760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6270607-c72a-49dc-9b6f-2e4528695e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.755036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6270607-c72a-49dc-9b6f-2e4528695e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.755719 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6270607-c72a-49dc-9b6f-2e4528695e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.757642 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6270607-c72a-49dc-9b6f-2e4528695e30 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.854841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 786/1575] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:45.855763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbf21f-b5ff-42f0-8177-2a4205f35a76 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.864706 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 790/1576] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:45.865582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6270607-c72a-49dc-9b6f-2e4528695e30 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:45.865813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbf21f-b5ff-42f0-8177-2a4205f35a76 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.920153 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cb7aa-547c-492d-98ab-f6fa268611cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.920858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cb7aa-547c-492d-98ab-f6fa268611cc admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.921166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cb7aa-547c-492d-98ab-f6fa268611cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.921445 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cb7aa-547c-492d-98ab-f6fa268611cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.922141 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cb7aa-547c-492d-98ab-f6fa268611cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.923732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6270607-c72a-49dc-9b6f-2e4528695e30 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:45.924182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cb7aa-547c-492d-98ab-f6fa268611cc admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:45.928415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3e7ba-3e66-4b23-9fd0-4b6ab40a882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:45.929059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3e7ba-3e66-4b23-9fd0-4b6ab40a882e admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:45.929343 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3e7ba-3e66-4b23-9fd0-4b6ab40a882e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:45.929622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3e7ba-3e66-4b23-9fd0-4b6ab40a882e admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:45.930304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3e7ba-3e66-4b23-9fd0-4b6ab40a882e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:45.932218 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3e7ba-3e66-4b23-9fd0-4b6ab40a882e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.053169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 787/1577] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:46.054170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cb7aa-547c-492d-98ab-f6fa268611cc admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.064568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 791/1578] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:38:45 2022] POST /identity/v3/projects => generated 389 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:46.065481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3e7ba-3e66-4b23-9fd0-4b6ab40a882e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.115296 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cb7aa-547c-492d-98ab-f6fa268611cc admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.126340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3e7ba-3e66-4b23-9fd0-4b6ab40a882e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.131616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484520c2-e17d-4846-b205-c18a6fc6c31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.132407 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484520c2-e17d-4846-b205-c18a6fc6c31a admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.132761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484520c2-e17d-4846-b205-c18a6fc6c31a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.133039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484520c2-e17d-4846-b205-c18a6fc6c31a admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.133722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484520c2-e17d-4846-b205-c18a6fc6c31a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.134732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING py.warnings [None req-484520c2-e17d-4846-b205-c18a6fc6c31a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:38:46.134732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: warnings.warn(msg) Mar 08 15:38:46.134732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: Mar 08 15:38:46.135977 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484520c2-e17d-4846-b205-c18a6fc6c31a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.168785 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da56a24-b489-4e71-960e-7dfc619bac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.169453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da56a24-b489-4e71-960e-7dfc619bac53 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.169735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da56a24-b489-4e71-960e-7dfc619bac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.170011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da56a24-b489-4e71-960e-7dfc619bac53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.170703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da56a24-b489-4e71-960e-7dfc619bac53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.172686 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da56a24-b489-4e71-960e-7dfc619bac53 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.235100 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 792/1579] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:38:46 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:46.236563 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8341b88-3498-4489-8a2d-70aa2fb61f3d None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.236850 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8341b88-3498-4489-8a2d-70aa2fb61f3d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.237128 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8341b88-3498-4489-8a2d-70aa2fb61f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.253506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a8341b88-3498-4489-8a2d-70aa2fb61f3d None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:46.254677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a8341b88-3498-4489-8a2d-70aa2fb61f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:46.262016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 793/1580] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:46.262883 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8341b88-3498-4489-8a2d-70aa2fb61f3d None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.270501 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 788/1581] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:38:46 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:46.270501 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da56a24-b489-4e71-960e-7dfc619bac53 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.275894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8341b88-3498-4489-8a2d-70aa2fb61f3d None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.329488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da56a24-b489-4e71-960e-7dfc619bac53 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.331061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c98d5c-0fc8-4ac2-938f-579adde3975d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.332419 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c98d5c-0fc8-4ac2-938f-579adde3975d admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.332701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c98d5c-0fc8-4ac2-938f-579adde3975d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.332974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c98d5c-0fc8-4ac2-938f-579adde3975d admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.333649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c98d5c-0fc8-4ac2-938f-579adde3975d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.334684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa1587-4415-49bc-b142-b1ef6a282207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.335353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa1587-4415-49bc-b142-b1ef6a282207 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.335540 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c98d5c-0fc8-4ac2-938f-579adde3975d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.335646 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa1587-4415-49bc-b142-b1ef6a282207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.335883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa1587-4415-49bc-b142-b1ef6a282207 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.336636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa1587-4415-49bc-b142-b1ef6a282207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.338220 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa1587-4415-49bc-b142-b1ef6a282207 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.347865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 789/1582] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.348676 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa1587-4415-49bc-b142-b1ef6a282207 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.357760 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa1587-4415-49bc-b142-b1ef6a282207 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.362251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cd6b8-6ac2-46da-96b9-31ad9ecbf623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.362884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cd6b8-6ac2-46da-96b9-31ad9ecbf623 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.363166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cd6b8-6ac2-46da-96b9-31ad9ecbf623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.363440 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cd6b8-6ac2-46da-96b9-31ad9ecbf623 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.364102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cd6b8-6ac2-46da-96b9-31ad9ecbf623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.366037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cd6b8-6ac2-46da-96b9-31ad9ecbf623 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.435043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 794/1583] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:38:46 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:46.435966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c98d5c-0fc8-4ac2-938f-579adde3975d admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.446629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c98d5c-0fc8-4ac2-938f-579adde3975d admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.451475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 790/1584] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:38:46 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:46.451475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cd6b8-6ac2-46da-96b9-31ad9ecbf623 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.455095 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd37c7-dfe9-4b6f-823e-7fce61913834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.455754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd37c7-dfe9-4b6f-823e-7fce61913834 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.456038 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd37c7-dfe9-4b6f-823e-7fce61913834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.456347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd37c7-dfe9-4b6f-823e-7fce61913834 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.457673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd37c7-dfe9-4b6f-823e-7fce61913834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.459680 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd37c7-dfe9-4b6f-823e-7fce61913834 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.461910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cd6b8-6ac2-46da-96b9-31ad9ecbf623 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.466737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ad9a5-39cd-475c-a8b6-e96b45088237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.469984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ad9a5-39cd-475c-a8b6-e96b45088237 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.469984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ad9a5-39cd-475c-a8b6-e96b45088237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.469984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ad9a5-39cd-475c-a8b6-e96b45088237 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.469984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ad9a5-39cd-475c-a8b6-e96b45088237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.470672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ad9a5-39cd-475c-a8b6-e96b45088237 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.546664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 795/1585] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:38:46 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:46.547635 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd37c7-dfe9-4b6f-823e-7fce61913834 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.558776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 791/1586] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:38:46 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:46.558776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ad9a5-39cd-475c-a8b6-e96b45088237 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.559732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd37c7-dfe9-4b6f-823e-7fce61913834 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.562204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf74ce-a4ee-498d-a7a5-a5f351506424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.562854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf74ce-a4ee-498d-a7a5-a5f351506424 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.563132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf74ce-a4ee-498d-a7a5-a5f351506424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.563411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf74ce-a4ee-498d-a7a5-a5f351506424 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.564130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf74ce-a4ee-498d-a7a5-a5f351506424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.566593 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf74ce-a4ee-498d-a7a5-a5f351506424 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.567442 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ad9a5-39cd-475c-a8b6-e96b45088237 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.572405 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93740061-215c-4f14-b916-0327217364bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.573141 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93740061-215c-4f14-b916-0327217364bd admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.573549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93740061-215c-4f14-b916-0327217364bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.573909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93740061-215c-4f14-b916-0327217364bd admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.574703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93740061-215c-4f14-b916-0327217364bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.576757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93740061-215c-4f14-b916-0327217364bd admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.576991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 796/1587] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.578843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf74ce-a4ee-498d-a7a5-a5f351506424 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.630368 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf74ce-a4ee-498d-a7a5-a5f351506424 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.634036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f04f-912a-403a-b37e-81cf972063ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.636292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f04f-912a-403a-b37e-81cf972063ee service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.636292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f04f-912a-403a-b37e-81cf972063ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.636292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21f04f-912a-403a-b37e-81cf972063ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.644599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21f04f-912a-403a-b37e-81cf972063ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.646036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21f04f-912a-403a-b37e-81cf972063ee service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.655164 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 797/1588] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:46.655941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f04f-912a-403a-b37e-81cf972063ee service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.667228 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 792/1589] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:38:46 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:46.667228 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93740061-215c-4f14-b916-0327217364bd admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.670276 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21f04f-912a-403a-b37e-81cf972063ee service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.674454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93740061-215c-4f14-b916-0327217364bd admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.675500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431df219-03b9-4a74-ab34-c2a1ff7d73f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.676186 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431df219-03b9-4a74-ab34-c2a1ff7d73f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.676466 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431df219-03b9-4a74-ab34-c2a1ff7d73f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.676805 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431df219-03b9-4a74-ab34-c2a1ff7d73f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.677463 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431df219-03b9-4a74-ab34-c2a1ff7d73f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.679095 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431df219-03b9-4a74-ab34-c2a1ff7d73f7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.679905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49375a-43e8-4a3d-a1c0-9100be4ebef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.680661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49375a-43e8-4a3d-a1c0-9100be4ebef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.680943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49375a-43e8-4a3d-a1c0-9100be4ebef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.681219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49375a-43e8-4a3d-a1c0-9100be4ebef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.682259 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49375a-43e8-4a3d-a1c0-9100be4ebef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.683890 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49375a-43e8-4a3d-a1c0-9100be4ebef7 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.689198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 798/1590] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.690142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431df219-03b9-4a74-ab34-c2a1ff7d73f7 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.695505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 793/1591] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.696640 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49375a-43e8-4a3d-a1c0-9100be4ebef7 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.703395 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431df219-03b9-4a74-ab34-c2a1ff7d73f7 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.706105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49375a-43e8-4a3d-a1c0-9100be4ebef7 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.713066 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ffe40-07c3-482a-b214-d12e09f6805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.713066 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ffe40-07c3-482a-b214-d12e09f6805f admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.713066 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ffe40-07c3-482a-b214-d12e09f6805f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.713066 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ffe40-07c3-482a-b214-d12e09f6805f admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.713590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ffe40-07c3-482a-b214-d12e09f6805f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.713737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fde20-ba9f-4308-9eaf-87dc5a5b75f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.713737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fde20-ba9f-4308-9eaf-87dc5a5b75f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.713737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fde20-ba9f-4308-9eaf-87dc5a5b75f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.713992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ffe40-07c3-482a-b214-d12e09f6805f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.714097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fde20-ba9f-4308-9eaf-87dc5a5b75f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.714097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fde20-ba9f-4308-9eaf-87dc5a5b75f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.714749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fde20-ba9f-4308-9eaf-87dc5a5b75f6 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.723193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 799/1592] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.724231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ffe40-07c3-482a-b214-d12e09f6805f admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.725048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 794/1593] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.725696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fde20-ba9f-4308-9eaf-87dc5a5b75f6 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.735312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fde20-ba9f-4308-9eaf-87dc5a5b75f6 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.737584 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ffe40-07c3-482a-b214-d12e09f6805f admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.740363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a3242-389e-416a-9fb4-203c0e8c51d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.741683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a3242-389e-416a-9fb4-203c0e8c51d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.741683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a3242-389e-416a-9fb4-203c0e8c51d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.741683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a3242-389e-416a-9fb4-203c0e8c51d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.742222 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a3242-389e-416a-9fb4-203c0e8c51d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.743057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c48c33-7880-4aa6-83b5-b0d2d523ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.743701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c48c33-7880-4aa6-83b5-b0d2d523ea6f admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.743807 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a3242-389e-416a-9fb4-203c0e8c51d5 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.743980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c48c33-7880-4aa6-83b5-b0d2d523ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.744292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c48c33-7880-4aa6-83b5-b0d2d523ea6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.745022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c48c33-7880-4aa6-83b5-b0d2d523ea6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.746760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c48c33-7880-4aa6-83b5-b0d2d523ea6f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.754099 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 795/1594] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.757171 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a3242-389e-416a-9fb4-203c0e8c51d5 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.761142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 800/1595] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.761142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c48c33-7880-4aa6-83b5-b0d2d523ea6f admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.767507 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a3242-389e-416a-9fb4-203c0e8c51d5 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.769135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c48c33-7880-4aa6-83b5-b0d2d523ea6f admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.773121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4478-4a89-41dc-bc72-f7823994112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.773121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4478-4a89-41dc-bc72-f7823994112a admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.773349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4478-4a89-41dc-bc72-f7823994112a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.773533 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4478-4a89-41dc-bc72-f7823994112a admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.774238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03781-6180-4707-b75d-e928e86474c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.774361 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b4478-4a89-41dc-bc72-f7823994112a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.775175 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03781-6180-4707-b75d-e928e86474c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.775464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03781-6180-4707-b75d-e928e86474c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.775715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03781-6180-4707-b75d-e928e86474c3 admin admin] PATH_INFO: `/v3/projects/915876653e4646c783541ff6a50a9d4c/users/548b57ab3785438aa623526705f22d87/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.776067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b4478-4a89-41dc-bc72-f7823994112a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.791067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 796/1596] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.791067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4478-4a89-41dc-bc72-f7823994112a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.794228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03781-6180-4707-b75d-e928e86474c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=915876653e4646c783541ff6a50a9d4c, user_id=548b57ab3785438aa623526705f22d87, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.797041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b03781-6180-4707-b75d-e928e86474c3 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.803283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4478-4a89-41dc-bc72-f7823994112a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.808339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5969a5-884b-4a41-93f7-13dc972be738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.808999 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5969a5-884b-4a41-93f7-13dc972be738 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.809286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5969a5-884b-4a41-93f7-13dc972be738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.809593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5969a5-884b-4a41-93f7-13dc972be738 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.810314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5969a5-884b-4a41-93f7-13dc972be738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.811945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5969a5-884b-4a41-93f7-13dc972be738 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.824614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 797/1597] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.825847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5969a5-884b-4a41-93f7-13dc972be738 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.836251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5969a5-884b-4a41-93f7-13dc972be738 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.840795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b8ed4-6c8b-4a4d-89ed-e89faab53a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.841457 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b8ed4-6c8b-4a4d-89ed-e89faab53a9c admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.841736 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b8ed4-6c8b-4a4d-89ed-e89faab53a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.842007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b8ed4-6c8b-4a4d-89ed-e89faab53a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.842754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b8ed4-6c8b-4a4d-89ed-e89faab53a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.844377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b8ed4-6c8b-4a4d-89ed-e89faab53a9c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.854464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 798/1598] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.855304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b8ed4-6c8b-4a4d-89ed-e89faab53a9c admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.865227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b8ed4-6c8b-4a4d-89ed-e89faab53a9c admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.869657 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f53ed6-fd84-41e9-b672-dbc9691bc3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.870314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f53ed6-fd84-41e9-b672-dbc9691bc3af admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.870596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f53ed6-fd84-41e9-b672-dbc9691bc3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.870895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f53ed6-fd84-41e9-b672-dbc9691bc3af admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.871596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f53ed6-fd84-41e9-b672-dbc9691bc3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.873183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f53ed6-fd84-41e9-b672-dbc9691bc3af admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.883364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 799/1599] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.884365 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f53ed6-fd84-41e9-b672-dbc9691bc3af admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.892115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 801/1600] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:46 2022] PUT /identity/v3/projects/915876653e4646c783541ff6a50a9d4c/users/548b57ab3785438aa623526705f22d87/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:46.893129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03781-6180-4707-b75d-e928e86474c3 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.902764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f53ed6-fd84-41e9-b672-dbc9691bc3af admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.949475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe6ab3-f595-4123-b54e-cb11b6ecf7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.950363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe6ab3-f595-4123-b54e-cb11b6ecf7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.950643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe6ab3-f595-4123-b54e-cb11b6ecf7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.950917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe6ab3-f595-4123-b54e-cb11b6ecf7c1 admin admin] PATH_INFO: `/v3/projects/6b83b48440aa422ba663063db5a5e460/users/afba7f815e4f492da69c5f8463229c32/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.953454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03781-6180-4707-b75d-e928e86474c3 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.958102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5099271-9328-4e45-b2a7-8cd8e28ec1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.958757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5099271-9328-4e45-b2a7-8cd8e28ec1ce admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.959039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5099271-9328-4e45-b2a7-8cd8e28ec1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.959314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5099271-9328-4e45-b2a7-8cd8e28ec1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.960039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5099271-9328-4e45-b2a7-8cd8e28ec1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.961664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5099271-9328-4e45-b2a7-8cd8e28ec1ce admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.965316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe6ab3-f595-4123-b54e-cb11b6ecf7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b83b48440aa422ba663063db5a5e460, user_id=afba7f815e4f492da69c5f8463229c32, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.968076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe6ab3-f595-4123-b54e-cb11b6ecf7c1 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:46.974003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 802/1601] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:46.974003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5099271-9328-4e45-b2a7-8cd8e28ec1ce admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:46.983406 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5099271-9328-4e45-b2a7-8cd8e28ec1ce admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:46.988710 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fdc08-a530-455c-8d49-93683737694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:46.989244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fdc08-a530-455c-8d49-93683737694e admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:46.989525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fdc08-a530-455c-8d49-93683737694e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:46.989794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fdc08-a530-455c-8d49-93683737694e admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:46.990544 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fdc08-a530-455c-8d49-93683737694e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:46.992162 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fdc08-a530-455c-8d49-93683737694e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:47.002833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 803/1602] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:47.003134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fdc08-a530-455c-8d49-93683737694e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:47.013307 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fdc08-a530-455c-8d49-93683737694e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:47.018000 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a2308-a9da-48b3-82f7-8ca9b2d88402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:47.018865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a2308-a9da-48b3-82f7-8ca9b2d88402 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.019176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a2308-a9da-48b3-82f7-8ca9b2d88402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.019449 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a2308-a9da-48b3-82f7-8ca9b2d88402 admin admin] PATH_INFO: `/v3/projects/2d5c333d8ce9410db1ca673622320774/users/02c102f762cd498198f882dcbd660aff/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.033805 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a2308-a9da-48b3-82f7-8ca9b2d88402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5c333d8ce9410db1ca673622320774, user_id=02c102f762cd498198f882dcbd660aff, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:47.037557 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a2308-a9da-48b3-82f7-8ca9b2d88402 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:47.055739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 800/1603] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:46 2022] PUT /identity/v3/projects/6b83b48440aa422ba663063db5a5e460/users/afba7f815e4f492da69c5f8463229c32/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:47.056801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe6ab3-f595-4123-b54e-cb11b6ecf7c1 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:47.111994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 804/1604] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:47 2022] PUT /identity/v3/projects/2d5c333d8ce9410db1ca673622320774/users/02c102f762cd498198f882dcbd660aff/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:47.113684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a2308-a9da-48b3-82f7-8ca9b2d88402 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:47.136902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe6ab3-f595-4123-b54e-cb11b6ecf7c1 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:47.181079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a2308-a9da-48b3-82f7-8ca9b2d88402 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:47.186033 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb513d-31e9-4bf5-8a1e-c1bf6a346769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:47.186923 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb513d-31e9-4bf5-8a1e-c1bf6a346769 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.187214 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb513d-31e9-4bf5-8a1e-c1bf6a346769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.187497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb513d-31e9-4bf5-8a1e-c1bf6a346769 admin admin] PATH_INFO: `/v3/projects/440f47b2c0b142f59c450a209cf70dd7/users/50ed755c0c5948f49bea60a748bd531b/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.202857 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb513d-31e9-4bf5-8a1e-c1bf6a346769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440f47b2c0b142f59c450a209cf70dd7, user_id=50ed755c0c5948f49bea60a748bd531b, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:47.203806 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22b0e4-d1d4-43b2-b9f5-ae61189636cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:47.204747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22b0e4-d1d4-43b2-b9f5-ae61189636cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.205028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22b0e4-d1d4-43b2-b9f5-ae61189636cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.205310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22b0e4-d1d4-43b2-b9f5-ae61189636cc admin admin] PATH_INFO: `/v3/projects/75fae950dc53423496a47a74e509f8c6/users/9d396a40388f45a8a4222eff05e2b84d/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.205684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb513d-31e9-4bf5-8a1e-c1bf6a346769 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:47.220556 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22b0e4-d1d4-43b2-b9f5-ae61189636cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=75fae950dc53423496a47a74e509f8c6, user_id=9d396a40388f45a8a4222eff05e2b84d, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:47.223784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22b0e4-d1d4-43b2-b9f5-ae61189636cc admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:47.292785 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 805/1605] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:47 2022] PUT /identity/v3/projects/440f47b2c0b142f59c450a209cf70dd7/users/50ed755c0c5948f49bea60a748bd531b/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:47.297178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 801/1606] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:47 2022] PUT /identity/v3/projects/75fae950dc53423496a47a74e509f8c6/users/9d396a40388f45a8a4222eff05e2b84d/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:47.297178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22b0e4-d1d4-43b2-b9f5-ae61189636cc admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:47.298901 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f721b1e-0bc7-4ec5-8728-76fe4562a0d1 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.299204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f721b1e-0bc7-4ec5-8728-76fe4562a0d1 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.299507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f721b1e-0bc7-4ec5-8728-76fe4562a0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.326475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5f721b1e-0bc7-4ec5-8728-76fe4562a0d1 None None] MFA Rules not processed for user `548b57ab3785438aa623526705f22d87`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:47.327664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5f721b1e-0bc7-4ec5-8728-76fe4562a0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:47.356653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22b0e4-d1d4-43b2-b9f5-ae61189636cc admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:47.362007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee1a28-5ace-4058-9dc5-282796c9304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:47.362961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee1a28-5ace-4058-9dc5-282796c9304b admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.363245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee1a28-5ace-4058-9dc5-282796c9304b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.363527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee1a28-5ace-4058-9dc5-282796c9304b admin admin] PATH_INFO: `/v3/projects/9ac62b56e40d4f0981ee3ca2bb898333/users/af4907a2aa8b48b0a0810f23d75f9eaf/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.379984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee1a28-5ace-4058-9dc5-282796c9304b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac62b56e40d4f0981ee3ca2bb898333, user_id=af4907a2aa8b48b0a0810f23d75f9eaf, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:47.382734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee1a28-5ace-4058-9dc5-282796c9304b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:47.395421 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 806/1607] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:47.396202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f721b1e-0bc7-4ec5-8728-76fe4562a0d1 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:47.406475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f721b1e-0bc7-4ec5-8728-76fe4562a0d1 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:47.411429 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f053a-de94-498f-be80-ef0e9e212788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:47.412351 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f053a-de94-498f-be80-ef0e9e212788 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.412633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f053a-de94-498f-be80-ef0e9e212788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.412908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f053a-de94-498f-be80-ef0e9e212788 admin admin] PATH_INFO: `/v3/projects/3bb6b423f7d54004a9d1b77e9379c670/users/b5745e593f834e7db5e51f872493624b/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.428554 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f053a-de94-498f-be80-ef0e9e212788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb6b423f7d54004a9d1b77e9379c670, user_id=b5745e593f834e7db5e51f872493624b, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:47.431317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f053a-de94-498f-be80-ef0e9e212788 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:47.466071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 802/1608] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:47 2022] PUT /identity/v3/projects/9ac62b56e40d4f0981ee3ca2bb898333/users/af4907a2aa8b48b0a0810f23d75f9eaf/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:47.467638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d2323-d4ac-4609-8158-2c7d1ab65cfa None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.467927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d2323-d4ac-4609-8158-2c7d1ab65cfa None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.468231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d2323-d4ac-4609-8158-2c7d1ab65cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.493855 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-2d2d2323-d4ac-4609-8158-2c7d1ab65cfa None None] MFA Rules not processed for user `afba7f815e4f492da69c5f8463229c32`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:47.495043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2d2d2323-d4ac-4609-8158-2c7d1ab65cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:47.540804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 807/1609] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:47 2022] PUT /identity/v3/projects/3bb6b423f7d54004a9d1b77e9379c670/users/b5745e593f834e7db5e51f872493624b/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:47.542498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b0b06-3c5d-471b-9d87-aa1db5143ee3 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.543008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b0b06-3c5d-471b-9d87-aa1db5143ee3 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.543512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b0b06-3c5d-471b-9d87-aa1db5143ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.558984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 803/1610] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:47.560299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1653f75-268d-42f8-9ee3-67485ffed9cc None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.560646 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1653f75-268d-42f8-9ee3-67485ffed9cc None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.560930 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1653f75-268d-42f8-9ee3-67485ffed9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.573498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-fd7b0b06-3c5d-471b-9d87-aa1db5143ee3 None None] MFA Rules not processed for user `02c102f762cd498198f882dcbd660aff`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:47.574686 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-fd7b0b06-3c5d-471b-9d87-aa1db5143ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:47.578082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-a1653f75-268d-42f8-9ee3-67485ffed9cc None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:47.579273 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a1653f75-268d-42f8-9ee3-67485ffed9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:47.639924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 808/1611] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:47.644387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 804/1612] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:47.645507 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7ab2-60c5-46a4-91d8-a3428c9dc5c4 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.645738 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7ab2-60c5-46a4-91d8-a3428c9dc5c4 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.646012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7ab2-60c5-46a4-91d8-a3428c9dc5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.647106 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5c68-c461-4dee-8491-b52d6f3b8adc None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.647550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5c68-c461-4dee-8491-b52d6f3b8adc None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.647975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5c68-c461-4dee-8491-b52d6f3b8adc None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.650199 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 809/1613] 10.222.0.25 () {54 vars in 961 bytes} [Tue Mar 8 15:38:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:38:47.656461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5ae00-a918-4c03-afc2-26345254513c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.656461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5ae00-a918-4c03-afc2-26345254513c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.656461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5ae00-a918-4c03-afc2-26345254513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.670831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b4e5ae00-a918-4c03-afc2-26345254513c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:47.672049 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b4e5ae00-a918-4c03-afc2-26345254513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:47.681192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 810/1614] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:47.688742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf17ff-ca95-455c-99a4-e17c4d98322d None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.688742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf17ff-ca95-455c-99a4-e17c4d98322d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.688742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf17ff-ca95-455c-99a4-e17c4d98322d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.689146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-48ec7ab2-60c5-46a4-91d8-a3428c9dc5c4 None None] MFA Rules not processed for user `50ed755c0c5948f49bea60a748bd531b`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:47.689146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-48ec7ab2-60c5-46a4-91d8-a3428c9dc5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:47.711963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-8cbf17ff-ca95-455c-99a4-e17c4d98322d None None] MFA Rules not processed for user `b5745e593f834e7db5e51f872493624b`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:47.713205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8cbf17ff-ca95-455c-99a4-e17c4d98322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:47.751167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 805/1615] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:47.751776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7ab2-60c5-46a4-91d8-a3428c9dc5c4 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:47.764214 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7ab2-60c5-46a4-91d8-a3428c9dc5c4 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:47.769245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9eb9-cf7b-453c-863f-9bbd385266b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:47.769891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9eb9-cf7b-453c-863f-9bbd385266b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.770174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9eb9-cf7b-453c-863f-9bbd385266b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.770451 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9eb9-cf7b-453c-863f-9bbd385266b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.771149 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d9eb9-cf7b-453c-863f-9bbd385266b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:47.773085 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d9eb9-cf7b-453c-863f-9bbd385266b6 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:47.775991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 811/1616] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:47.781466 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf17ff-ca95-455c-99a4-e17c4d98322d None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:47.782756 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8cbf17ff-ca95-455c-99a4-e17c4d98322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:47.836230 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf17ff-ca95-455c-99a4-e17c4d98322d None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:47.840004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc7ac9-8344-43d1-bc78-0cb55470451e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:47.847652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc7ac9-8344-43d1-bc78-0cb55470451e service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.847652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc7ac9-8344-43d1-bc78-0cb55470451e service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.847652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc7ac9-8344-43d1-bc78-0cb55470451e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.850678 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc7ac9-8344-43d1-bc78-0cb55470451e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:47.852116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc7ac9-8344-43d1-bc78-0cb55470451e service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:47.861362 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 812/1617] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:47.862544 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94c4b-af84-4762-a435-6658561f1358 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.863411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94c4b-af84-4762-a435-6658561f1358 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.863696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f94c4b-af84-4762-a435-6658561f1358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.877080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 806/1618] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:38:47 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:47.877080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c5d6-3cdb-4371-b3ae-68d02cf53831 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.877080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c5d6-3cdb-4371-b3ae-68d02cf53831 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.877080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361c5d6-3cdb-4371-b3ae-68d02cf53831 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:47.885939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-17f94c4b-af84-4762-a435-6658561f1358 None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:47.886799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-17f94c4b-af84-4762-a435-6658561f1358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:47.888303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 807/1619] 10.222.0.25 () {54 vars in 961 bytes} [Tue Mar 8 15:38:47 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:38:47.889265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361c5d6-3cdb-4371-b3ae-68d02cf53831 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:47.957299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 813/1620] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Mar 8 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:47.958227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94c4b-af84-4762-a435-6658561f1358 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:47.962029 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361c5d6-3cdb-4371-b3ae-68d02cf53831 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:47.967760 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2df1-c111-420e-a8d1-bfa3a9ee8751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:47.968659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2df1-c111-420e-a8d1-bfa3a9ee8751 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:47.968950 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2df1-c111-420e-a8d1-bfa3a9ee8751 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:47.969604 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2df1-c111-420e-a8d1-bfa3a9ee8751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.043883 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f94c4b-af84-4762-a435-6658561f1358 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:48.049694 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e7f77-ae3a-4e5a-b5f4-ce7d75db195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:48.051502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e7f77-ae3a-4e5a-b5f4-ce7d75db195c admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:48.051502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e7f77-ae3a-4e5a-b5f4-ce7d75db195c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:48.051502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e7f77-ae3a-4e5a-b5f4-ce7d75db195c admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.052391 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e7f77-ae3a-4e5a-b5f4-ce7d75db195c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:48.054443 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd2df1-c111-420e-a8d1-bfa3a9ee8751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:48.054596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e7f77-ae3a-4e5a-b5f4-ce7d75db195c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:48.056317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd2df1-c111-420e-a8d1-bfa3a9ee8751 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:48.071879 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 808/1621] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:48.071879 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2df1-c111-420e-a8d1-bfa3a9ee8751 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:48.080881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2df1-c111-420e-a8d1-bfa3a9ee8751 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:48.085688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38850a-3896-498d-9e25-686092b867ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:48.086743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38850a-3896-498d-9e25-686092b867ba admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:48.087028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38850a-3896-498d-9e25-686092b867ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:48.087306 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38850a-3896-498d-9e25-686092b867ba admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.087997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38850a-3896-498d-9e25-686092b867ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:48.089951 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38850a-3896-498d-9e25-686092b867ba admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:48.168347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 814/1622] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:38:47 2022] POST /identity/v3/projects => generated 363 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:48.170275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ed38-d61d-4c83-b787-af0e6dd7950a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:48.171461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ed38-d61d-4c83-b787-af0e6dd7950a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:48.171955 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0ed38-d61d-4c83-b787-af0e6dd7950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.197889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-4ac0ed38-d61d-4c83-b787-af0e6dd7950a None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:48.199579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4ac0ed38-d61d-4c83-b787-af0e6dd7950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:48.208984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 809/1623] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:38:48 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:48.208984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38850a-3896-498d-9e25-686092b867ba admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:48.223595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38850a-3896-498d-9e25-686092b867ba admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:48.302924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 815/1624] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Mar 8 15:38:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:48.308159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0ed38-d61d-4c83-b787-af0e6dd7950a None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:48.360984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc610ba7-f2a8-4d54-8c00-82c284d7fe9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:48.364686 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc610ba7-f2a8-4d54-8c00-82c284d7fe9a service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:48.364686 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc610ba7-f2a8-4d54-8c00-82c284d7fe9a service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:48.364686 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc610ba7-f2a8-4d54-8c00-82c284d7fe9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.413832 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0ed38-d61d-4c83-b787-af0e6dd7950a None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:48.421292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fad3f6-6d2b-4f14-8efe-13a519ec2bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:48.424278 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fad3f6-6d2b-4f14-8efe-13a519ec2bdd admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:48.424856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fad3f6-6d2b-4f14-8efe-13a519ec2bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:48.425424 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fad3f6-6d2b-4f14-8efe-13a519ec2bdd admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.426757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fad3f6-6d2b-4f14-8efe-13a519ec2bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:48.429012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc610ba7-f2a8-4d54-8c00-82c284d7fe9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:48.429413 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fad3f6-6d2b-4f14-8efe-13a519ec2bdd admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:48.433569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc610ba7-f2a8-4d54-8c00-82c284d7fe9a service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:48.444795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 810/1625] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:48.445933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc610ba7-f2a8-4d54-8c00-82c284d7fe9a service nova] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:48.459168 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc610ba7-f2a8-4d54-8c00-82c284d7fe9a service nova] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:48.464728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28285463-2ca6-40ef-aeff-b5e2c4e1ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:48.467962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28285463-2ca6-40ef-aeff-b5e2c4e1ea15 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:48.467962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28285463-2ca6-40ef-aeff-b5e2c4e1ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:48.467962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28285463-2ca6-40ef-aeff-b5e2c4e1ea15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.467962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28285463-2ca6-40ef-aeff-b5e2c4e1ea15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:48.469371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28285463-2ca6-40ef-aeff-b5e2c4e1ea15 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:48.480665 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 811/1626] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:48.484609 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28285463-2ca6-40ef-aeff-b5e2c4e1ea15 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:48.506346 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28285463-2ca6-40ef-aeff-b5e2c4e1ea15 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:48.506729 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a474e92-ee5e-45a2-a0a6-2cbace6daea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:48.507457 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a474e92-ee5e-45a2-a0a6-2cbace6daea6 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:48.507814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a474e92-ee5e-45a2-a0a6-2cbace6daea6 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:48.508277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a474e92-ee5e-45a2-a0a6-2cbace6daea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.536330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 816/1627] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:38:48 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:48.542633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fad3f6-6d2b-4f14-8efe-13a519ec2bdd admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:48.554023 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fad3f6-6d2b-4f14-8efe-13a519ec2bdd admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:48.570762 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992632b1-c6cd-4997-ad77-21323b44531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:48.574775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992632b1-c6cd-4997-ad77-21323b44531c admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:48.574775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992632b1-c6cd-4997-ad77-21323b44531c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:48.574775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992632b1-c6cd-4997-ad77-21323b44531c admin admin] PATH_INFO: `/v3/projects/564452f548974006a5d738e4cf00d781/users/494e6062c300471fbb99db9cd5c78957/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.578267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a474e92-ee5e-45a2-a0a6-2cbace6daea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:48.580084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a474e92-ee5e-45a2-a0a6-2cbace6daea6 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:48.601718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992632b1-c6cd-4997-ad77-21323b44531c admin admin] RBAC: Authorizing `identity:create_grant(project_id=564452f548974006a5d738e4cf00d781, user_id=494e6062c300471fbb99db9cd5c78957, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:48.607234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992632b1-c6cd-4997-ad77-21323b44531c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:48.616223 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 812/1628] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:48.617963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a474e92-ee5e-45a2-a0a6-2cbace6daea6 service nova] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:48.650934 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a474e92-ee5e-45a2-a0a6-2cbace6daea6 service nova] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:48.668904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eac7e-a45f-46fe-bcfa-cd830208c99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:48.669765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eac7e-a45f-46fe-bcfa-cd830208c99a admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:48.670349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eac7e-a45f-46fe-bcfa-cd830208c99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:48.670964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0eac7e-a45f-46fe-bcfa-cd830208c99a admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.671872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0eac7e-a45f-46fe-bcfa-cd830208c99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:48.673694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0eac7e-a45f-46fe-bcfa-cd830208c99a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:48.706074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 813/1629] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:48.707735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eac7e-a45f-46fe-bcfa-cd830208c99a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:48.712959 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 817/1630] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:48 2022] PUT /identity/v3/projects/564452f548974006a5d738e4cf00d781/users/494e6062c300471fbb99db9cd5c78957/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:48.716936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992632b1-c6cd-4997-ad77-21323b44531c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:48.718978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0eac7e-a45f-46fe-bcfa-cd830208c99a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:48.885240 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411d477-e4f4-4fa8-b436-54431926310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:48.886163 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411d477-e4f4-4fa8-b436-54431926310b admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:48.886436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411d477-e4f4-4fa8-b436-54431926310b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:48.886713 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411d477-e4f4-4fa8-b436-54431926310b admin admin] PATH_INFO: `/v3/projects/d76d3a9d9ade4b5f873466d35584bdad/users/06e23d208b1649138ee0a5042574f719/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.914756 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992632b1-c6cd-4997-ad77-21323b44531c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:48.927580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a27d58-01c3-4601-8a9f-b6a83953fe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:48.928427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a27d58-01c3-4601-8a9f-b6a83953fe20 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:48.928570 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a27d58-01c3-4601-8a9f-b6a83953fe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:48.928871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a27d58-01c3-4601-8a9f-b6a83953fe20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.929578 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a27d58-01c3-4601-8a9f-b6a83953fe20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:48.944133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a27d58-01c3-4601-8a9f-b6a83953fe20 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:48.947700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411d477-e4f4-4fa8-b436-54431926310b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76d3a9d9ade4b5f873466d35584bdad, user_id=06e23d208b1649138ee0a5042574f719, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:48.951182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411d477-e4f4-4fa8-b436-54431926310b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:48.955533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 818/1631] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:48.956911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5fa54-9599-4bb4-9e40-2310cb75d3a5 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:48.957286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5fa54-9599-4bb4-9e40-2310cb75d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:48.957643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5fa54-9599-4bb4-9e40-2310cb75d3a5 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:48.961116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 819/1632] 10.222.0.25 () {54 vars in 912 bytes} [Tue Mar 8 15:38:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:38:48.962144 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5fa54-9599-4bb4-9e40-2310cb75d3a5 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:49.054722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5fa54-9599-4bb4-9e40-2310cb75d3a5 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:49.062985 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 814/1633] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:48 2022] PUT /identity/v3/projects/d76d3a9d9ade4b5f873466d35584bdad/users/06e23d208b1649138ee0a5042574f719/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:49.064055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411d477-e4f4-4fa8-b436-54431926310b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:49.197944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411d477-e4f4-4fa8-b436-54431926310b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:49.208930 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c408b-146b-481e-8f69-7b2190608b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:49.210408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c408b-146b-481e-8f69-7b2190608b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:49.212798 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c408b-146b-481e-8f69-7b2190608b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:49.213529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c408b-146b-481e-8f69-7b2190608b4c admin admin] PATH_INFO: `/v3/projects/564452f548974006a5d738e4cf00d781/users/494e6062c300471fbb99db9cd5c78957/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:49.215166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3b6f1-f949-451f-88e1-8cb517b1d840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:49.216060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3b6f1-f949-451f-88e1-8cb517b1d840 service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:49.216516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c408b-146b-481e-8f69-7b2190608b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=564452f548974006a5d738e4cf00d781, user_id=494e6062c300471fbb99db9cd5c78957, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:49.216903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3b6f1-f949-451f-88e1-8cb517b1d840 service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:49.217490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3b6f1-f949-451f-88e1-8cb517b1d840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:49.219485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c408b-146b-481e-8f69-7b2190608b4c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:49.238678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 815/1634] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:49 2022] PUT /identity/v3/projects/564452f548974006a5d738e4cf00d781/users/494e6062c300471fbb99db9cd5c78957/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:49.249402 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2466442-5a38-478b-99f1-34b8fb28a5f3 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:49.249765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2466442-5a38-478b-99f1-34b8fb28a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:49.250100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2466442-5a38-478b-99f1-34b8fb28a5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:49.279162 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-a2466442-5a38-478b-99f1-34b8fb28a5f3 None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:49.280938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a2466442-5a38-478b-99f1-34b8fb28a5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:49.301281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3b6f1-f949-451f-88e1-8cb517b1d840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:49.301281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3b6f1-f949-451f-88e1-8cb517b1d840 service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:49.318137 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 820/1635] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:49.319282 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3b6f1-f949-451f-88e1-8cb517b1d840 service nova] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:49.330327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3b6f1-f949-451f-88e1-8cb517b1d840 service nova] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:49.459191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fe640-9b65-4bf0-a6be-f6630654baf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:49.460009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe640-9b65-4bf0-a6be-f6630654baf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:49.460317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe640-9b65-4bf0-a6be-f6630654baf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:49.461877 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe640-9b65-4bf0-a6be-f6630654baf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:49.462099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fe640-9b65-4bf0-a6be-f6630654baf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:49.465509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fe640-9b65-4bf0-a6be-f6630654baf7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:49.475780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 816/1636] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:49.476954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc24c8f-4b10-4832-92b4-bb1aa0ca2642 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:49.477211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc24c8f-4b10-4832-92b4-bb1aa0ca2642 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:49.477490 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc24c8f-4b10-4832-92b4-bb1aa0ca2642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:49.484023 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 821/1637] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:49.490521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bfe19-5027-4936-ae51-a5685f4e8a65 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:49.490521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bfe19-5027-4936-ae51-a5685f4e8a65 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:49.490785 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bfe19-5027-4936-ae51-a5685f4e8a65 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:49.496504 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 822/1638] 10.222.0.25 () {54 vars in 912 bytes} [Tue Mar 8 15:38:49 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:38:49.497609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bfe19-5027-4936-ae51-a5685f4e8a65 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:49.520017 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bfe19-5027-4936-ae51-a5685f4e8a65 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:49.525752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8470f3-5b16-4961-b947-37fee0559f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:49.526707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8470f3-5b16-4961-b947-37fee0559f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:49.526988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8470f3-5b16-4961-b947-37fee0559f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:49.527262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8470f3-5b16-4961-b947-37fee0559f05 admin admin] PATH_INFO: `/v3/projects/d76d3a9d9ade4b5f873466d35584bdad/users/06e23d208b1649138ee0a5042574f719/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:49.531550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8470f3-5b16-4961-b947-37fee0559f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76d3a9d9ade4b5f873466d35584bdad, user_id=06e23d208b1649138ee0a5042574f719, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:49.546034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8470f3-5b16-4961-b947-37fee0559f05 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:49.546774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-5bc24c8f-4b10-4832-92b4-bb1aa0ca2642 None None] MFA Rules not processed for user `494e6062c300471fbb99db9cd5c78957`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:49.546774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-5bc24c8f-4b10-4832-92b4-bb1aa0ca2642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:49.556137 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 823/1639] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:49 2022] PUT /identity/v3/projects/d76d3a9d9ade4b5f873466d35584bdad/users/06e23d208b1649138ee0a5042574f719/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:49.557218 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8470f3-5b16-4961-b947-37fee0559f05 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:49.625137 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8470f3-5b16-4961-b947-37fee0559f05 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:49.629890 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1818c-92d7-490b-a6dd-30af7a5d378a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:49.630634 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1818c-92d7-490b-a6dd-30af7a5d378a service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:49.630990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1818c-92d7-490b-a6dd-30af7a5d378a service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:49.631345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1818c-92d7-490b-a6dd-30af7a5d378a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:49.642217 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 817/1640] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:49.646387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f7c0a-2f8e-41ed-8b74-d1490108eef2 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:49.646862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f7c0a-2f8e-41ed-8b74-d1490108eef2 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:49.647152 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f7c0a-2f8e-41ed-8b74-d1490108eef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:49.674664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-547f7c0a-2f8e-41ed-8b74-d1490108eef2 None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:49.675983 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-547f7c0a-2f8e-41ed-8b74-d1490108eef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:49.734908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1818c-92d7-490b-a6dd-30af7a5d378a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:49.736436 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1818c-92d7-490b-a6dd-30af7a5d378a service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:49.761786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 824/1641] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:49.766231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2325de8-654d-4d6b-9446-7fbe1ca65850 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:49.767268 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2325de8-654d-4d6b-9446-7fbe1ca65850 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:49.768304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2325de8-654d-4d6b-9446-7fbe1ca65850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:49.769442 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 818/1642] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:49.778757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f7c0a-2f8e-41ed-8b74-d1490108eef2 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:49.780559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f7c0a-2f8e-41ed-8b74-d1490108eef2 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:49.787918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8e891-6884-4fd6-82a2-ec4cae9c84ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:49.788659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8e891-6884-4fd6-82a2-ec4cae9c84ce service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:49.789027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8e891-6884-4fd6-82a2-ec4cae9c84ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:49.789310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8e891-6884-4fd6-82a2-ec4cae9c84ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:49.801863 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8e891-6884-4fd6-82a2-ec4cae9c84ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:49.803483 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8e891-6884-4fd6-82a2-ec4cae9c84ce service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:49.814299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 819/1643] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:49.819269 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c2325de8-654d-4d6b-9446-7fbe1ca65850 None None] MFA Rules not processed for user `06e23d208b1649138ee0a5042574f719`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:49.820549 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c2325de8-654d-4d6b-9446-7fbe1ca65850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:49.975950 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8e891-6884-4fd6-82a2-ec4cae9c84ce service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:49.990836 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8e891-6884-4fd6-82a2-ec4cae9c84ce service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:50.000613 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 825/1644] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:49 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:50.001643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266142c-6269-4433-b1c0-8cf3a2a2e5b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:50.002545 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266142c-6269-4433-b1c0-8cf3a2a2e5b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:50.002984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266142c-6269-4433-b1c0-8cf3a2a2e5b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:50.003712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266142c-6269-4433-b1c0-8cf3a2a2e5b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:50.030506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266142c-6269-4433-b1c0-8cf3a2a2e5b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:50.032136 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266142c-6269-4433-b1c0-8cf3a2a2e5b5 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:50.061069 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 820/1645] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:38:50.277412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc0e0d-fd7c-4d68-8140-832767a15945 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:50.277704 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc0e0d-fd7c-4d68-8140-832767a15945 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:50.278071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc0e0d-fd7c-4d68-8140-832767a15945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:50.327031 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b0fc0e0d-fd7c-4d68-8140-832767a15945 None None] MFA Rules not processed for user `9d396a40388f45a8a4222eff05e2b84d`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:50.331954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b0fc0e0d-fd7c-4d68-8140-832767a15945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:50.452833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 826/1646] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:50.455335 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90c546-e598-47a0-9b55-445ea7022905 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:50.455824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90c546-e598-47a0-9b55-445ea7022905 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:50.456896 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90c546-e598-47a0-9b55-445ea7022905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:50.478233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-cf90c546-e598-47a0-9b55-445ea7022905 None None] MFA Rules not processed for user `9d396a40388f45a8a4222eff05e2b84d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:50.480366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-cf90c546-e598-47a0-9b55-445ea7022905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:50.489320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 821/1647] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:51.103679 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc0e0d-fd7c-4d68-8140-832767a15945 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:51.116694 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc0e0d-fd7c-4d68-8140-832767a15945 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:51.129140 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e9e37-4e7b-473f-a019-6cc917631c2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:51.129986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e9e37-4e7b-473f-a019-6cc917631c2e service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:51.130276 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e9e37-4e7b-473f-a019-6cc917631c2e service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:51.130552 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e9e37-4e7b-473f-a019-6cc917631c2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:51.144441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e9e37-4e7b-473f-a019-6cc917631c2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:51.146124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e9e37-4e7b-473f-a019-6cc917631c2e service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:51.171298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 827/1648] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:51 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:51.390140 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90c546-e598-47a0-9b55-445ea7022905 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:51.415109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90c546-e598-47a0-9b55-445ea7022905 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:51.434015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33592e0d-cd2e-46e3-b641-f5e94c953962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:51.434701 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592e0d-cd2e-46e3-b641-f5e94c953962 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:51.434987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592e0d-cd2e-46e3-b641-f5e94c953962 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:51.435269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592e0d-cd2e-46e3-b641-f5e94c953962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:51.458645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33592e0d-cd2e-46e3-b641-f5e94c953962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:51.463375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33592e0d-cd2e-46e3-b641-f5e94c953962 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:51.514530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 822/1649] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:51.700699 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e9e37-4e7b-473f-a019-6cc917631c2e service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:51.715418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e9e37-4e7b-473f-a019-6cc917631c2e service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:51.725497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb59f63-0b4a-4286-8b07-8e5634d6e508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:51.726416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb59f63-0b4a-4286-8b07-8e5634d6e508 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:51.735408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb59f63-0b4a-4286-8b07-8e5634d6e508 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:51.735408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb59f63-0b4a-4286-8b07-8e5634d6e508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:51.874865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb59f63-0b4a-4286-8b07-8e5634d6e508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:51.880097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb59f63-0b4a-4286-8b07-8e5634d6e508 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:51.908202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 828/1650] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:52.180823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33592e0d-cd2e-46e3-b641-f5e94c953962 service nova] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:52.280372 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61328000-0676-4d92-b086-a5b672d5f880 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:52.280954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61328000-0676-4d92-b086-a5b672d5f880 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:52.281050 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61328000-0676-4d92-b086-a5b672d5f880 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:52.282834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 829/1651] 10.222.0.25 () {54 vars in 912 bytes} [Tue Mar 8 15:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:38:52.291735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033e11b-c630-41f8-bab1-e118e8196e71 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:52.292048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033e11b-c630-41f8-bab1-e118e8196e71 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:52.292370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033e11b-c630-41f8-bab1-e118e8196e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:52.351529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-2033e11b-c630-41f8-bab1-e118e8196e71 None None] MFA Rules not processed for user `028d499ea279442d822c6723c367f459`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:52.352004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2033e11b-c630-41f8-bab1-e118e8196e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:52.361264 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33592e0d-cd2e-46e3-b641-f5e94c953962 service nova] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:52.366669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e44bdf-acb7-4861-b671-196a8c326fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:52.367629 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e44bdf-acb7-4861-b671-196a8c326fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:52.367985 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e44bdf-acb7-4861-b671-196a8c326fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:52.368362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e44bdf-acb7-4861-b671-196a8c326fb6 admin admin] PATH_INFO: `/v3/users/02c102f762cd498198f882dcbd660aff` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:52.369803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e44bdf-acb7-4861-b671-196a8c326fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c102f762cd498198f882dcbd660aff)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:52.370884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: WARNING py.warnings [None req-92e44bdf-acb7-4861-b671-196a8c326fb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:38:52.370884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: warnings.warn(msg) Mar 08 15:38:52.370884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: Mar 08 15:38:52.372090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e44bdf-acb7-4861-b671-196a8c326fb6 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:52.423433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 830/1652] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:38:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:52.509657 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033e11b-c630-41f8-bab1-e118e8196e71 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:52.519756 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033e11b-c630-41f8-bab1-e118e8196e71 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:52.525117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fadea-8728-4dd2-b420-02a7970c4277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:52.525938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fadea-8728-4dd2-b420-02a7970c4277 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:52.526820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fadea-8728-4dd2-b420-02a7970c4277 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:52.527441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fadea-8728-4dd2-b420-02a7970c4277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:52.541866 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fadea-8728-4dd2-b420-02a7970c4277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:52.543643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fadea-8728-4dd2-b420-02a7970c4277 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:52.553463 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 831/1653] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:52.727232 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-92e44bdf-acb7-4861-b671-196a8c326fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c102f762cd498198f882dcbd660aff'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:52.774091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fadea-8728-4dd2-b420-02a7970c4277 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:52.788690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-92e44bdf-acb7-4861-b671-196a8c326fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c102f762cd498198f882dcbd660aff'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:52.797978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fadea-8728-4dd2-b420-02a7970c4277 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:52.800289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148910cd-9522-4218-a126-e244332ebbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:52.801129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148910cd-9522-4218-a126-e244332ebbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:52.801415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148910cd-9522-4218-a126-e244332ebbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:52.801688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148910cd-9522-4218-a126-e244332ebbeb admin admin] PATH_INFO: `/v3/users/afba7f815e4f492da69c5f8463229c32` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:52.804971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148910cd-9522-4218-a126-e244332ebbeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=afba7f815e4f492da69c5f8463229c32)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:52.811503 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148910cd-9522-4218-a126-e244332ebbeb admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:52.829659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-92e44bdf-acb7-4861-b671-196a8c326fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c102f762cd498198f882dcbd660aff'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:52.832537 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-92e44bdf-acb7-4861-b671-196a8c326fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c102f762cd498198f882dcbd660aff'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:52.897484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-92e44bdf-acb7-4861-b671-196a8c326fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c102f762cd498198f882dcbd660aff'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:52.897484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 823/1654] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:38:52 2022] DELETE /identity/v3/users/02c102f762cd498198f882dcbd660aff => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:52.900371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2fdd0-f4c8-48d8-86f9-1ab68a75ada5 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:52.900653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2fdd0-f4c8-48d8-86f9-1ab68a75ada5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:52.904052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2fdd0-f4c8-48d8-86f9-1ab68a75ada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:52.949241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-80a2fdd0-f4c8-48d8-86f9-1ab68a75ada5 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:52.950558 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-80a2fdd0-f4c8-48d8-86f9-1ab68a75ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:53.057737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 824/1655] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:38:53.077671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2fdd0-f4c8-48d8-86f9-1ab68a75ada5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:53.081951 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-80a2fdd0-f4c8-48d8-86f9-1ab68a75ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:53.208675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-148910cd-9522-4218-a126-e244332ebbeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afba7f815e4f492da69c5f8463229c32'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:53.208675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-148910cd-9522-4218-a126-e244332ebbeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afba7f815e4f492da69c5f8463229c32'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:53.220562 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2fdd0-f4c8-48d8-86f9-1ab68a75ada5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:53.240435 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354bc53-4d84-404d-8888-6dcac77c1945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:53.241126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354bc53-4d84-404d-8888-6dcac77c1945 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:53.241409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354bc53-4d84-404d-8888-6dcac77c1945 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:53.241735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354bc53-4d84-404d-8888-6dcac77c1945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:53.251970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4354bc53-4d84-404d-8888-6dcac77c1945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:53.281474 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354bc53-4d84-404d-8888-6dcac77c1945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:53.288040 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354bc53-4d84-404d-8888-6dcac77c1945 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:53.318547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-148910cd-9522-4218-a126-e244332ebbeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afba7f815e4f492da69c5f8463229c32'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:53.321498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-148910cd-9522-4218-a126-e244332ebbeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afba7f815e4f492da69c5f8463229c32'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:53.347375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 825/1656] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:38:53.350275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-148910cd-9522-4218-a126-e244332ebbeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afba7f815e4f492da69c5f8463229c32'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:53.384848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 832/1657] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:38:52 2022] DELETE /identity/v3/users/afba7f815e4f492da69c5f8463229c32 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:53.400570 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ad605-ac27-43e8-bb9d-39afb6325a85 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:53.403251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ad605-ac27-43e8-bb9d-39afb6325a85 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:53.405506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ad605-ac27-43e8-bb9d-39afb6325a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:53.510830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ac9ad605-ac27-43e8-bb9d-39afb6325a85 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:53.512114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ac9ad605-ac27-43e8-bb9d-39afb6325a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:53.634954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d81e58-2379-48fc-ba79-cedbbc0426c7 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:53.635242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d81e58-2379-48fc-ba79-cedbbc0426c7 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:53.636172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d81e58-2379-48fc-ba79-cedbbc0426c7 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:53.638228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 833/1658] 10.222.0.25 () {54 vars in 960 bytes} [Tue Mar 8 15:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:38:53.686538 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ff002-bd03-4bb4-b5a9-35bdcdd127e5 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:53.687042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ff002-bd03-4bb4-b5a9-35bdcdd127e5 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:53.687495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ff002-bd03-4bb4-b5a9-35bdcdd127e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:53.741959 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-100ff002-bd03-4bb4-b5a9-35bdcdd127e5 None None] MFA Rules not processed for user `13471dce9430484ab46b355d1303f504`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:53.744338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-100ff002-bd03-4bb4-b5a9-35bdcdd127e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:53.765486 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 826/1659] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:53.804104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ad605-ac27-43e8-bb9d-39afb6325a85 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:53.809667 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ac9ad605-ac27-43e8-bb9d-39afb6325a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:53.937741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 834/1660] 10.222.0.25 () {58 vars in 1057 bytes} [Tue Mar 8 15:38:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:53.946053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ff002-bd03-4bb4-b5a9-35bdcdd127e5 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:53.957650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ff002-bd03-4bb4-b5a9-35bdcdd127e5 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:53.969602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72b004-8389-446f-b52a-6896886b858e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13471dce9430484ab46b355d1303f504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:53.970825 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72b004-8389-446f-b52a-6896886b858e service placement] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:53.971383 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72b004-8389-446f-b52a-6896886b858e service placement] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:53.973002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72b004-8389-446f-b52a-6896886b858e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:53.975473 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-bb72b004-8389-446f-b52a-6896886b858e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:53.994900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72b004-8389-446f-b52a-6896886b858e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:53.996882 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb72b004-8389-446f-b52a-6896886b858e service placement] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:54.015906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 835/1661] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:38:54.027621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ad605-ac27-43e8-bb9d-39afb6325a85 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:54.039406 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e3586-fb11-484e-826c-b43132ab37aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:54.040078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e3586-fb11-484e-826c-b43132ab37aa service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:54.040390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e3586-fb11-484e-826c-b43132ab37aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:54.040860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e3586-fb11-484e-826c-b43132ab37aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:54.062339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e3586-fb11-484e-826c-b43132ab37aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:54.063970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e3586-fb11-484e-826c-b43132ab37aa service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:54.083729 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 827/1662] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:54.921493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72b004-8389-446f-b52a-6896886b858e service placement] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:54.923587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-bb72b004-8389-446f-b52a-6896886b858e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:54.967204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72b004-8389-446f-b52a-6896886b858e service placement] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:54.983017 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:54.984364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:54.984779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:54.985187 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] PATH_INFO: `/v3/projects/2d5c333d8ce9410db1ca673622320774` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:54.988354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5c333d8ce9410db1ca673622320774)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:54.989778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: WARNING py.warnings [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 15:38:54.989778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: warnings.warn(msg) Mar 08 15:38:54.989778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: Mar 08 15:38:54.992931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:55.162943 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5c333d8ce9410db1ca673622320774', 'request_id': 'req-fb7f3586-0d04-433c-90e9-0a1484430bb3'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:55.174314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5c333d8ce9410db1ca673622320774', 'request_id': 'req-fb7f3586-0d04-433c-90e9-0a1484430bb3'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:55.262991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5c333d8ce9410db1ca673622320774', 'request_id': 'req-fb7f3586-0d04-433c-90e9-0a1484430bb3'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:55.332979 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] The token cache is being invalidate because project 2d5c333d8ce9410db1ca673622320774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:38:55.333281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:55.336719 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-fb7f3586-0d04-433c-90e9-0a1484430bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:55.340525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 836/1663] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:38:54 2022] DELETE /identity/v3/projects/2d5c333d8ce9410db1ca673622320774 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:38:55.347467 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec13eac-0a4d-45a9-a527-4b271a4e534d None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:55.348526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec13eac-0a4d-45a9-a527-4b271a4e534d None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:55.348733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec13eac-0a4d-45a9-a527-4b271a4e534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:55.399444 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-9ec13eac-0a4d-45a9-a527-4b271a4e534d None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:55.401806 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9ec13eac-0a4d-45a9-a527-4b271a4e534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:55.623975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 828/1664] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:38:55.635970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838bbd3-e227-48b8-97f4-614dfbb96cd7 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:55.637210 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838bbd3-e227-48b8-97f4-614dfbb96cd7 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:55.637629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838bbd3-e227-48b8-97f4-614dfbb96cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:55.658568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-2838bbd3-e227-48b8-97f4-614dfbb96cd7 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:55.661070 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2838bbd3-e227-48b8-97f4-614dfbb96cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:55.676134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 837/1665] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:55.682064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec13eac-0a4d-45a9-a527-4b271a4e534d None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:55.702149 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec13eac-0a4d-45a9-a527-4b271a4e534d None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:55.709343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9296fdd-be16-425f-bec1-cd30bee76b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:55.711530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9296fdd-be16-425f-bec1-cd30bee76b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:55.712009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9296fdd-be16-425f-bec1-cd30bee76b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:55.712620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9296fdd-be16-425f-bec1-cd30bee76b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:55.713513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9296fdd-be16-425f-bec1-cd30bee76b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:38:55.714036 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9296fdd-be16-425f-bec1-cd30bee76b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:55.716642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9296fdd-be16-425f-bec1-cd30bee76b90 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:55.734588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 829/1666] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:38:55.745140 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838bbd3-e227-48b8-97f4-614dfbb96cd7 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:55.752118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbe323-0000-4741-b544-2f6cda42ceb6 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:55.752636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbe323-0000-4741-b544-2f6cda42ceb6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:55.753098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbe323-0000-4741-b544-2f6cda42ceb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:55.767888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838bbd3-e227-48b8-97f4-614dfbb96cd7 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:55.785661 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836c7a-2f92-4920-8b7a-58f84ba5d572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:55.788846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836c7a-2f92-4920-8b7a-58f84ba5d572 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:55.789134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836c7a-2f92-4920-8b7a-58f84ba5d572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:55.790715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836c7a-2f92-4920-8b7a-58f84ba5d572 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:55.795929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b836c7a-2f92-4920-8b7a-58f84ba5d572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:55.795929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b836c7a-2f92-4920-8b7a-58f84ba5d572 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:55.817708 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-fedbe323-0000-4741-b544-2f6cda42ceb6 None None] MFA Rules not processed for user `fb710b14dbb44ea3b8d8942e89088b17`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:55.819256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-fedbe323-0000-4741-b544-2f6cda42ceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:55.922687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 830/1667] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:55.923759 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbe323-0000-4741-b544-2f6cda42ceb6 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:55.925146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-fedbe323-0000-4741-b544-2f6cda42ceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:55.934805 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 838/1668] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:38:55 2022] POST /identity/v3/projects => generated 409 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:55.938834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836c7a-2f92-4920-8b7a-58f84ba5d572 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:55.942719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbe323-0000-4741-b544-2f6cda42ceb6 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:56.021517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836c7a-2f92-4920-8b7a-58f84ba5d572 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:56.037364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10d3f2-19f8-4922-879f-e08f40e07d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:56.038240 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10d3f2-19f8-4922-879f-e08f40e07d3f admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:56.038667 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10d3f2-19f8-4922-879f-e08f40e07d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:56.041641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10d3f2-19f8-4922-879f-e08f40e07d3f admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:56.041641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10d3f2-19f8-4922-879f-e08f40e07d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:56.042544 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10d3f2-19f8-4922-879f-e08f40e07d3f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:56.060758 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:56.061770 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:56.062122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:56.062737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] PATH_INFO: `/v3/projects/6b83b48440aa422ba663063db5a5e460` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:56.063809 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b83b48440aa422ba663063db5a5e460)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:56.068089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:56.159146 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 839/1669] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:38:55 2022] POST /identity/v3/users => generated 305 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:38:56.160738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10d3f2-19f8-4922-879f-e08f40e07d3f admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:56.163237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-fc10d3f2-19f8-4922-879f-e08f40e07d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:56.205208 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b83b48440aa422ba663063db5a5e460', 'request_id': 'req-c2250509-74b1-40e2-b88f-e2fae42f40af'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:56.217533 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b83b48440aa422ba663063db5a5e460', 'request_id': 'req-c2250509-74b1-40e2-b88f-e2fae42f40af'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:56.225482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b83b48440aa422ba663063db5a5e460', 'request_id': 'req-c2250509-74b1-40e2-b88f-e2fae42f40af'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:56.310754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] The token cache is being invalidate because project 6b83b48440aa422ba663063db5a5e460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:38:56.311048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:56.312663 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:56.317047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 831/1670] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:38:55 2022] DELETE /identity/v3/projects/6b83b48440aa422ba663063db5a5e460 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:56.322424 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:56.327259 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:56.329588 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10d3f2-19f8-4922-879f-e08f40e07d3f admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:56.446016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d31ff4-cb95-4ecf-8bdf-4e129c57e9b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:56.446264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d31ff4-cb95-4ecf-8bdf-4e129c57e9b8 service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:56.446555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d31ff4-cb95-4ecf-8bdf-4e129c57e9b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:56.446829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d31ff4-cb95-4ecf-8bdf-4e129c57e9b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:56.453532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d5d31ff4-cb95-4ecf-8bdf-4e129c57e9b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:56.477138 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2250509-74b1-40e2-b88f-e2fae42f40af admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:56.493355 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21affbc7-20ab-48ee-93c6-2a3077ce38f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:56.494333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21affbc7-20ab-48ee-93c6-2a3077ce38f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:56.494842 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21affbc7-20ab-48ee-93c6-2a3077ce38f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:56.495182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21affbc7-20ab-48ee-93c6-2a3077ce38f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:56.496166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21affbc7-20ab-48ee-93c6-2a3077ce38f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:56.499119 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21affbc7-20ab-48ee-93c6-2a3077ce38f2 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:56.525083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 832/1671] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:56.527664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21affbc7-20ab-48ee-93c6-2a3077ce38f2 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:56.532593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-21affbc7-20ab-48ee-93c6-2a3077ce38f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:56.540643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d31ff4-cb95-4ecf-8bdf-4e129c57e9b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:56.542556 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d31ff4-cb95-4ecf-8bdf-4e129c57e9b8 service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:56.554911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 840/1672] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:56.555979 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d31ff4-cb95-4ecf-8bdf-4e129c57e9b8 service nova] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:56.569040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d31ff4-cb95-4ecf-8bdf-4e129c57e9b8 service nova] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:56.573362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21affbc7-20ab-48ee-93c6-2a3077ce38f2 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:56.575713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c999b-24d4-42b1-872f-1d7e5d97c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:56.576675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c999b-24d4-42b1-872f-1d7e5d97c8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:56.577252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c999b-24d4-42b1-872f-1d7e5d97c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:56.577798 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c999b-24d4-42b1-872f-1d7e5d97c8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:56.578920 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c999b-24d4-42b1-872f-1d7e5d97c8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:56.579527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc72b6-7cc4-4ac8-9ba8-b7c9b2a0254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:56.582435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c999b-24d4-42b1-872f-1d7e5d97c8f0 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:56.590374 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc72b6-7cc4-4ac8-9ba8-b7c9b2a0254a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:56.592794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc72b6-7cc4-4ac8-9ba8-b7c9b2a0254a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:56.592794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc72b6-7cc4-4ac8-9ba8-b7c9b2a0254a admin admin] PATH_INFO: `/v3/users/494e6062c300471fbb99db9cd5c78957` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:56.597702 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc72b6-7cc4-4ac8-9ba8-b7c9b2a0254a admin admin] RBAC: Authorizing `identity:delete_user(user_id=494e6062c300471fbb99db9cd5c78957)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:56.602200 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 841/1673] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:56.602316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc72b6-7cc4-4ac8-9ba8-b7c9b2a0254a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:56.602507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c999b-24d4-42b1-872f-1d7e5d97c8f0 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:56.621318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c999b-24d4-42b1-872f-1d7e5d97c8f0 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:56.634215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe581e-03ad-41cb-a072-0cb14f1c4c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:56.635127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe581e-03ad-41cb-a072-0cb14f1c4c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:56.635407 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe581e-03ad-41cb-a072-0cb14f1c4c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:56.636295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe581e-03ad-41cb-a072-0cb14f1c4c19 admin admin] PATH_INFO: `/v3/projects/b0398b90899d4f50b17f8ec82c3add06/users/210c4e319c2848f493a77d1b35fef1aa/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:56.661895 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe581e-03ad-41cb-a072-0cb14f1c4c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0398b90899d4f50b17f8ec82c3add06, user_id=210c4e319c2848f493a77d1b35fef1aa, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:56.665082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe581e-03ad-41cb-a072-0cb14f1c4c19 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:56.784727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 842/1674] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:56 2022] PUT /identity/v3/projects/b0398b90899d4f50b17f8ec82c3add06/users/210c4e319c2848f493a77d1b35fef1aa/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:56.784727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe581e-03ad-41cb-a072-0cb14f1c4c19 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:56.790753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-adbe581e-03ad-41cb-a072-0cb14f1c4c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:56.891872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6dcc72b6-7cc4-4ac8-9ba8-b7c9b2a0254a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '494e6062c300471fbb99db9cd5c78957'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:56.905197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe581e-03ad-41cb-a072-0cb14f1c4c19 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:56.913447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d00292-89cb-43b2-bf9c-83ece23f049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:56.914290 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d00292-89cb-43b2-bf9c-83ece23f049f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:56.914584 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d00292-89cb-43b2-bf9c-83ece23f049f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:56.914863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d00292-89cb-43b2-bf9c-83ece23f049f admin admin] PATH_INFO: `/v3/users/50ed755c0c5948f49bea60a748bd531b` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:56.916173 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d00292-89cb-43b2-bf9c-83ece23f049f admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ed755c0c5948f49bea60a748bd531b)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:56.919364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d00292-89cb-43b2-bf9c-83ece23f049f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:57.127261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6dcc72b6-7cc4-4ac8-9ba8-b7c9b2a0254a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '494e6062c300471fbb99db9cd5c78957'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:57.153350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6dcc72b6-7cc4-4ac8-9ba8-b7c9b2a0254a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '494e6062c300471fbb99db9cd5c78957'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:57.153350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6dcc72b6-7cc4-4ac8-9ba8-b7c9b2a0254a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '494e6062c300471fbb99db9cd5c78957'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:57.162909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6dcc72b6-7cc4-4ac8-9ba8-b7c9b2a0254a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '494e6062c300471fbb99db9cd5c78957'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:57.173166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 833/1675] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:38:56 2022] DELETE /identity/v3/users/494e6062c300471fbb99db9cd5c78957 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:57.180369 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707d258-94dc-4603-9bf4-cc8ee9282c06 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:57.186576 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707d258-94dc-4603-9bf4-cc8ee9282c06 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:57.186576 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707d258-94dc-4603-9bf4-cc8ee9282c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:57.227324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-2707d258-94dc-4603-9bf4-cc8ee9282c06 None None] MFA Rules not processed for user `210c4e319c2848f493a77d1b35fef1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:57.228284 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2707d258-94dc-4603-9bf4-cc8ee9282c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:57.273529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-a2d00292-89cb-43b2-bf9c-83ece23f049f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ed755c0c5948f49bea60a748bd531b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:57.274859 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-a2d00292-89cb-43b2-bf9c-83ece23f049f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ed755c0c5948f49bea60a748bd531b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:57.307585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 834/1676] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:57.313135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707d258-94dc-4603-9bf4-cc8ee9282c06 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:57.316881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2707d258-94dc-4603-9bf4-cc8ee9282c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:57.385904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-a2d00292-89cb-43b2-bf9c-83ece23f049f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ed755c0c5948f49bea60a748bd531b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:57.387244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-a2d00292-89cb-43b2-bf9c-83ece23f049f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ed755c0c5948f49bea60a748bd531b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:57.421326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-a2d00292-89cb-43b2-bf9c-83ece23f049f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ed755c0c5948f49bea60a748bd531b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:57.451579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 843/1677] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:38:56 2022] DELETE /identity/v3/users/50ed755c0c5948f49bea60a748bd531b => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:57.452482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707d258-94dc-4603-9bf4-cc8ee9282c06 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:57.457664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f09672-66cd-4ed6-8204-2d5f35ba866a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:57.460212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f09672-66cd-4ed6-8204-2d5f35ba866a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:57.460212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f09672-66cd-4ed6-8204-2d5f35ba866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:57.505984 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-47f09672-66cd-4ed6-8204-2d5f35ba866a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:57.518915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-47f09672-66cd-4ed6-8204-2d5f35ba866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:57.576220 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b4042-5bb4-483c-a7f5-4494991f09f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:57.581789 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b4042-5bb4-483c-a7f5-4494991f09f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:57.581789 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b4042-5bb4-483c-a7f5-4494991f09f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:57.581789 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b4042-5bb4-483c-a7f5-4494991f09f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:57.581789 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b4042-5bb4-483c-a7f5-4494991f09f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:57.581789 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b4042-5bb4-483c-a7f5-4494991f09f0 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:57.747974 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 835/1678] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:38:57 2022] POST /identity/v3/projects => generated 407 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:57.754901 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b4042-5bb4-483c-a7f5-4494991f09f0 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:57.807691 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 844/1679] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:38:57.879645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b4042-5bb4-483c-a7f5-4494991f09f0 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:57.885507 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdde9b9-6ed3-41f4-b1ff-b73945c72463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:57.890218 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f09672-66cd-4ed6-8204-2d5f35ba866a None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:57.890343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde9b9-6ed3-41f4-b1ff-b73945c72463 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:57.890343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde9b9-6ed3-41f4-b1ff-b73945c72463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:57.890343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde9b9-6ed3-41f4-b1ff-b73945c72463 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:57.890530 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-47f09672-66cd-4ed6-8204-2d5f35ba866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:57.890594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdde9b9-6ed3-41f4-b1ff-b73945c72463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:57.890594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdde9b9-6ed3-41f4-b1ff-b73945c72463 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:57.986179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 836/1680] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:38:57 2022] POST /identity/v3/users => generated 310 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:38:57.990991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdde9b9-6ed3-41f4-b1ff-b73945c72463 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:58.023554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdde9b9-6ed3-41f4-b1ff-b73945c72463 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:58.043636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8a4e-06b7-4c40-b8b9-cb44fa5f3db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:58.049933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8a4e-06b7-4c40-b8b9-cb44fa5f3db1 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:58.049933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8a4e-06b7-4c40-b8b9-cb44fa5f3db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:58.049933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8a4e-06b7-4c40-b8b9-cb44fa5f3db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:58.054505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb8a4e-06b7-4c40-b8b9-cb44fa5f3db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:58.061988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb8a4e-06b7-4c40-b8b9-cb44fa5f3db1 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:58.082379 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 837/1681] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:58.083327 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8a4e-06b7-4c40-b8b9-cb44fa5f3db1 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:58.085343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-34eb8a4e-06b7-4c40-b8b9-cb44fa5f3db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:58.092351 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f09672-66cd-4ed6-8204-2d5f35ba866a None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:58.103841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8a4e-06b7-4c40-b8b9-cb44fa5f3db1 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:58.114997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:58.116348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:58.116803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:58.117271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] PATH_INFO: `/v3/users/b5745e593f834e7db5e51f872493624b` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:58.118867 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5745e593f834e7db5e51f872493624b)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:58.121131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:58.221965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d119a19-6bb1-433f-a9d0-ca9bb6dc03a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:58.222755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d119a19-6bb1-433f-a9d0-ca9bb6dc03a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:58.223159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d119a19-6bb1-433f-a9d0-ca9bb6dc03a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:58.223528 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d119a19-6bb1-433f-a9d0-ca9bb6dc03a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:58.238243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d119a19-6bb1-433f-a9d0-ca9bb6dc03a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:58.251500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d119a19-6bb1-433f-a9d0-ca9bb6dc03a9 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:58.277775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 845/1682] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:38:58.277775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d119a19-6bb1-433f-a9d0-ca9bb6dc03a9 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:58.289131 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d119a19-6bb1-433f-a9d0-ca9bb6dc03a9 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:58.294056 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e40436-ae8f-43b2-ac8e-d20b9f8c17ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:58.295060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40436-ae8f-43b2-ac8e-d20b9f8c17ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:58.295711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40436-ae8f-43b2-ac8e-d20b9f8c17ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:58.295887 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40436-ae8f-43b2-ac8e-d20b9f8c17ae admin admin] PATH_INFO: `/v3/projects/29b5d8a964f144249f346bd00b890118/users/b6ec0c14acd24b2eaf6e4d00dbf4ccc3/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:58.322306 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e40436-ae8f-43b2-ac8e-d20b9f8c17ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b5d8a964f144249f346bd00b890118, user_id=b6ec0c14acd24b2eaf6e4d00dbf4ccc3, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:58.334604 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e40436-ae8f-43b2-ac8e-d20b9f8c17ae admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:58.364972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5745e593f834e7db5e51f872493624b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:58.445702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 846/1683] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:58 2022] PUT /identity/v3/projects/29b5d8a964f144249f346bd00b890118/users/b6ec0c14acd24b2eaf6e4d00dbf4ccc3/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:58.445702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e40436-ae8f-43b2-ac8e-d20b9f8c17ae admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:58.452211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-04e40436-ae8f-43b2-ac8e-d20b9f8c17ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:58.536033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5745e593f834e7db5e51f872493624b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:58.567616 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5745e593f834e7db5e51f872493624b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:58.570241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5745e593f834e7db5e51f872493624b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:58.594687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5745e593f834e7db5e51f872493624b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:58.624380 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 838/1684] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:38:58 2022] DELETE /identity/v3/users/b5745e593f834e7db5e51f872493624b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:58.632685 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:58.645274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:58.660324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e40436-ae8f-43b2-ac8e-d20b9f8c17ae admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:58.805117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:58.805117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:58.805117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:58.805117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] PATH_INFO: `/v3/projects/564452f548974006a5d738e4cf00d781` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:58.813772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] RBAC: Authorizing `identity:delete_project(project_id=564452f548974006a5d738e4cf00d781)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:58.823018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:58.838179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10022153-e400-4796-8eb7-55baab0909f0 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:58.846289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881faaf-140a-4820-8724-75cffad36a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:58.848972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881faaf-140a-4820-8724-75cffad36a14 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:58.848972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881faaf-140a-4820-8724-75cffad36a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:58.849451 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881faaf-140a-4820-8724-75cffad36a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:58.852412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881faaf-140a-4820-8724-75cffad36a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:58.855231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881faaf-140a-4820-8724-75cffad36a14 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:58.888910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 839/1685] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:38:58.889318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364637f5-4c7f-42b0-8afb-118f838b5e36 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:58.889649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364637f5-4c7f-42b0-8afb-118f838b5e36 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:58.889973 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364637f5-4c7f-42b0-8afb-118f838b5e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:58.921347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-364637f5-4c7f-42b0-8afb-118f838b5e36 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:58.923526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-364637f5-4c7f-42b0-8afb-118f838b5e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:58.937572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 840/1686] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:58.939208 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c31887-bffa-4811-b82a-bae7a479eb1f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:58.939619 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c31887-bffa-4811-b82a-bae7a479eb1f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:58.940822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c31887-bffa-4811-b82a-bae7a479eb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:59.040074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-81c31887-bffa-4811-b82a-bae7a479eb1f None None] MFA Rules not processed for user `af4907a2aa8b48b0a0810f23d75f9eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:59.041505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-81c31887-bffa-4811-b82a-bae7a479eb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:59.084841 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '564452f548974006a5d738e4cf00d781', 'request_id': 'req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:59.096605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '564452f548974006a5d738e4cf00d781', 'request_id': 'req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:59.188215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '564452f548974006a5d738e4cf00d781', 'request_id': 'req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:59.205782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] The token cache is being invalidate because project 564452f548974006a5d738e4cf00d781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:38:59.208564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:59.209502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:38:59.213550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 847/1687] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:38:58 2022] DELETE /identity/v3/projects/564452f548974006a5d738e4cf00d781 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:59.217234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:59.228499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:59.279044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 841/1688] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:59.289345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c31887-bffa-4811-b82a-bae7a479eb1f None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:59.289345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-81c31887-bffa-4811-b82a-bae7a479eb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:59.399850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c31887-bffa-4811-b82a-bae7a479eb1f None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:59.404688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e4cf3-a34d-46b1-aeaa-299b3b699a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:59.405426 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e4cf3-a34d-46b1-aeaa-299b3b699a62 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:59.405784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e4cf3-a34d-46b1-aeaa-299b3b699a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:59.406135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e4cf3-a34d-46b1-aeaa-299b3b699a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:59.408866 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ba2e4cf3-a34d-46b1-aeaa-299b3b699a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:59.445397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b9e3e-1cb1-461c-a725-82a0f4fa859c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:59.450833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e4cf3-a34d-46b1-aeaa-299b3b699a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:59.452878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e4cf3-a34d-46b1-aeaa-299b3b699a62 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:59.453475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17523e-e6af-4d04-b0a6-6c7e067c5b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:59.460597 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17523e-e6af-4d04-b0a6-6c7e067c5b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:59.460597 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17523e-e6af-4d04-b0a6-6c7e067c5b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:59.460597 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17523e-e6af-4d04-b0a6-6c7e067c5b47 admin admin] PATH_INFO: `/v3/projects/29b5d8a964f144249f346bd00b890118/users/b6ec0c14acd24b2eaf6e4d00dbf4ccc3/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:59.461138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17523e-e6af-4d04-b0a6-6c7e067c5b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b5d8a964f144249f346bd00b890118, user_id=b6ec0c14acd24b2eaf6e4d00dbf4ccc3, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:59.467795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17523e-e6af-4d04-b0a6-6c7e067c5b47 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:59.489914 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 842/1689] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:38:59.490779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e4cf3-a34d-46b1-aeaa-299b3b699a62 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:59.503170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 848/1690] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:38:59 2022] PUT /identity/v3/projects/29b5d8a964f144249f346bd00b890118/users/b6ec0c14acd24b2eaf6e4d00dbf4ccc3/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:38:59.503170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f451036-4593-4ee7-964e-aa6791672263 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:59.503170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f451036-4593-4ee7-964e-aa6791672263 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:59.503170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f451036-4593-4ee7-964e-aa6791672263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:59.503967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ba2e4cf3-a34d-46b1-aeaa-299b3b699a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:59.536421 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e4cf3-a34d-46b1-aeaa-299b3b699a62 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:59.563795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5f451036-4593-4ee7-964e-aa6791672263 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:38:59.565545 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5f451036-4593-4ee7-964e-aa6791672263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:59.670262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 849/1691] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:38:59.671394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f451036-4593-4ee7-964e-aa6791672263 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:38:59.675948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5f451036-4593-4ee7-964e-aa6791672263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:38:59.780848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f5284-4d1b-45c2-b243-cd6a2519dd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:59.781730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f5284-4d1b-45c2-b243-cd6a2519dd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:59.782013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f5284-4d1b-45c2-b243-cd6a2519dd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:59.782290 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f5284-4d1b-45c2-b243-cd6a2519dd86 admin admin] PATH_INFO: `/v3/projects/440f47b2c0b142f59c450a209cf70dd7` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:38:59.783531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f5284-4d1b-45c2-b243-cd6a2519dd86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440f47b2c0b142f59c450a209cf70dd7)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:38:59.786697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f5284-4d1b-45c2-b243-cd6a2519dd86 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:38:59.897106 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f451036-4593-4ee7-964e-aa6791672263 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:38:59.910063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c72f4-a38f-4d6a-97ab-765ee22143ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:38:59.911647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c72f4-a38f-4d6a-97ab-765ee22143ba service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:38:59.912241 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c72f4-a38f-4d6a-97ab-765ee22143ba service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:38:59.917211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c72f4-a38f-4d6a-97ab-765ee22143ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:00.006451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c72f4-a38f-4d6a-97ab-765ee22143ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:00.010490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c72f4-a38f-4d6a-97ab-765ee22143ba service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:00.011738 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d11f5284-4d1b-45c2-b243-cd6a2519dd86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440f47b2c0b142f59c450a209cf70dd7', 'request_id': 'req-d11f5284-4d1b-45c2-b243-cd6a2519dd86'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:00.028077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d11f5284-4d1b-45c2-b243-cd6a2519dd86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440f47b2c0b142f59c450a209cf70dd7', 'request_id': 'req-d11f5284-4d1b-45c2-b243-cd6a2519dd86'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:00.033351 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 850/1692] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:38:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:00.097288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009d7a9-2119-4ebc-bc31-f130f11ff9f4 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:00.097288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009d7a9-2119-4ebc-bc31-f130f11ff9f4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:00.097288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009d7a9-2119-4ebc-bc31-f130f11ff9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:00.098240 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d11f5284-4d1b-45c2-b243-cd6a2519dd86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440f47b2c0b142f59c450a209cf70dd7', 'request_id': 'req-d11f5284-4d1b-45c2-b243-cd6a2519dd86'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:00.115800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c009d7a9-2119-4ebc-bc31-f130f11ff9f4 None None] MFA Rules not processed for user `b6ec0c14acd24b2eaf6e4d00dbf4ccc3`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:00.117088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c009d7a9-2119-4ebc-bc31-f130f11ff9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:00.232438 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d11f5284-4d1b-45c2-b243-cd6a2519dd86 admin admin] The token cache is being invalidate because project 440f47b2c0b142f59c450a209cf70dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:00.232780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d11f5284-4d1b-45c2-b243-cd6a2519dd86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:00.233864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d11f5284-4d1b-45c2-b243-cd6a2519dd86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:00.236073 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 843/1693] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:38:59 2022] DELETE /identity/v3/projects/440f47b2c0b142f59c450a209cf70dd7 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:00.241765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5457261-3927-4a6e-b9b6-9a19b2a54af8 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:00.242105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5457261-3927-4a6e-b9b6-9a19b2a54af8 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:00.242593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5457261-3927-4a6e-b9b6-9a19b2a54af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:00.275632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 851/1694] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:00.279739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7953b-28cc-49f2-8cea-89cbcc2917a8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:00.280413 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7953b-28cc-49f2-8cea-89cbcc2917a8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:00.280413 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7953b-28cc-49f2-8cea-89cbcc2917a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:00.294440 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b5457261-3927-4a6e-b9b6-9a19b2a54af8 None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:00.295654 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b5457261-3927-4a6e-b9b6-9a19b2a54af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:00.338610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-16a7953b-28cc-49f2-8cea-89cbcc2917a8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:00.341196 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-16a7953b-28cc-49f2-8cea-89cbcc2917a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:00.509561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 844/1695] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:00.510643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5457261-3927-4a6e-b9b6-9a19b2a54af8 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:00.513904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b5457261-3927-4a6e-b9b6-9a19b2a54af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:00.560218 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 852/1696] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:00.570107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7953b-28cc-49f2-8cea-89cbcc2917a8 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:00.570107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-16a7953b-28cc-49f2-8cea-89cbcc2917a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:00.740723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5457261-3927-4a6e-b9b6-9a19b2a54af8 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:00.758207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7953b-28cc-49f2-8cea-89cbcc2917a8 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:00.762896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40814b2-751e-413c-bb93-c08b0789b612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:00.763434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40814b2-751e-413c-bb93-c08b0789b612 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:00.763720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40814b2-751e-413c-bb93-c08b0789b612 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:00.764040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40814b2-751e-413c-bb93-c08b0789b612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:00.765376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:00.767167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:00.767556 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:00.767933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] PATH_INFO: `/v3/users/06e23d208b1649138ee0a5042574f719` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:00.769514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e23d208b1649138ee0a5042574f719)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:00.772778 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:00.786460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40814b2-751e-413c-bb93-c08b0789b612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:00.788057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40814b2-751e-413c-bb93-c08b0789b612 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:00.838608 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 853/1697] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:00 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:00.839751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40814b2-751e-413c-bb93-c08b0789b612 service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:00.866525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40814b2-751e-413c-bb93-c08b0789b612 service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:00.893360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61f9d0-bf51-4338-82e1-89e9b13d2b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:00.893515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61f9d0-bf51-4338-82e1-89e9b13d2b2c admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:00.893802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61f9d0-bf51-4338-82e1-89e9b13d2b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:00.894082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61f9d0-bf51-4338-82e1-89e9b13d2b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:00.895101 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61f9d0-bf51-4338-82e1-89e9b13d2b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:00.895339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61f9d0-bf51-4338-82e1-89e9b13d2b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:00.897078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61f9d0-bf51-4338-82e1-89e9b13d2b2c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:00.919317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 854/1698] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:00.919317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61f9d0-bf51-4338-82e1-89e9b13d2b2c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:00.921825 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-be61f9d0-bf51-4338-82e1-89e9b13d2b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:00.966385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61f9d0-bf51-4338-82e1-89e9b13d2b2c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:00.979047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:00.979937 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:00.980229 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:00.980509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] PATH_INFO: `/v3/projects/3bb6b423f7d54004a9d1b77e9379c670` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:00.982790 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb6b423f7d54004a9d1b77e9379c670)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:00.988448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:01.035073 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e23d208b1649138ee0a5042574f719'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.208767 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e23d208b1649138ee0a5042574f719'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.228281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e23d208b1649138ee0a5042574f719'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.229019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e23d208b1649138ee0a5042574f719'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.231363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb6b423f7d54004a9d1b77e9379c670', 'request_id': 'req-ad2198bb-8c24-4222-8b7e-72f7f749474c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.239800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb6b423f7d54004a9d1b77e9379c670', 'request_id': 'req-ad2198bb-8c24-4222-8b7e-72f7f749474c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.247799 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e23d208b1649138ee0a5042574f719'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.256183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 845/1699] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:00 2022] DELETE /identity/v3/users/06e23d208b1649138ee0a5042574f719 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:01.257083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:01.258443 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:01.366739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb6b423f7d54004a9d1b77e9379c670', 'request_id': 'req-ad2198bb-8c24-4222-8b7e-72f7f749474c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.381039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176421b-db95-4cc7-9ea4-f1ab0c04cf8b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:01.388871 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b9195-1e90-4260-abe5-6ee57fab7b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:01.390647 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b9195-1e90-4260-abe5-6ee57fab7b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:01.391088 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b9195-1e90-4260-abe5-6ee57fab7b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:01.408129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b9195-1e90-4260-abe5-6ee57fab7b96 admin admin] PATH_INFO: `/v3/users/548b57ab3785438aa623526705f22d87` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:01.408129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b9195-1e90-4260-abe5-6ee57fab7b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548b57ab3785438aa623526705f22d87)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:01.409225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] The token cache is being invalidate because project 3bb6b423f7d54004a9d1b77e9379c670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:01.411341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.413553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.414240 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b9195-1e90-4260-abe5-6ee57fab7b96 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:01.418329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 855/1700] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:00 2022] DELETE /identity/v3/projects/3bb6b423f7d54004a9d1b77e9379c670 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:01.422513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:01.427936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:01.541703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2198bb-8c24-4222-8b7e-72f7f749474c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:01.546936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e735e20-6071-4a9b-b858-8f62475b3aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:01.547744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735e20-6071-4a9b-b858-8f62475b3aba admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:01.548132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735e20-6071-4a9b-b858-8f62475b3aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:01.548516 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735e20-6071-4a9b-b858-8f62475b3aba admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:01.549413 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e735e20-6071-4a9b-b858-8f62475b3aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:01.551507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e735e20-6071-4a9b-b858-8f62475b3aba admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:01.673475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 856/1701] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:01 2022] POST /identity/v3/projects => generated 377 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:01.678874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e735e20-6071-4a9b-b858-8f62475b3aba admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:01.682181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7e735e20-6071-4a9b-b858-8f62475b3aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:01.696790 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-7a8b9195-1e90-4260-abe5-6ee57fab7b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548b57ab3785438aa623526705f22d87'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.799926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-7a8b9195-1e90-4260-abe5-6ee57fab7b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548b57ab3785438aa623526705f22d87'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.811686 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e735e20-6071-4a9b-b858-8f62475b3aba admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:01.817438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78b44c-c7e8-4b85-9e54-e1305a0a526d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:01.818944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78b44c-c7e8-4b85-9e54-e1305a0a526d service swift] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:01.819474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78b44c-c7e8-4b85-9e54-e1305a0a526d service swift] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:01.819854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78b44c-c7e8-4b85-9e54-e1305a0a526d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:01.821457 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-7a8b9195-1e90-4260-abe5-6ee57fab7b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548b57ab3785438aa623526705f22d87'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.822102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3b78b44c-c7e8-4b85-9e54-e1305a0a526d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:01.822312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-7a8b9195-1e90-4260-abe5-6ee57fab7b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548b57ab3785438aa623526705f22d87'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.831394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-7a8b9195-1e90-4260-abe5-6ee57fab7b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548b57ab3785438aa623526705f22d87'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:01.838701 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 846/1702] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:01 2022] DELETE /identity/v3/users/548b57ab3785438aa623526705f22d87 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:01.840184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5fc0a-4771-4871-827d-c7328140ddc5 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:01.840636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5fc0a-4771-4871-827d-c7328140ddc5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:01.841062 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5fc0a-4771-4871-827d-c7328140ddc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:01.863475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7fb5fc0a-4771-4871-827d-c7328140ddc5 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:01.865739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7fb5fc0a-4771-4871-827d-c7328140ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:01.913931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78b44c-c7e8-4b85-9e54-e1305a0a526d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:01.915829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78b44c-c7e8-4b85-9e54-e1305a0a526d service swift] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:01.926022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 857/1703] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:39:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:39:01.928034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0d77e-bf31-4184-bfef-1a75d06095e9 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:01.929002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0d77e-bf31-4184-bfef-1a75d06095e9 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:01.929002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0d77e-bf31-4184-bfef-1a75d06095e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:01.959038 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-2eb0d77e-bf31-4184-bfef-1a75d06095e9 None None] MFA Rules not processed for user `028d499ea279442d822c6723c367f459`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:01.960325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2eb0d77e-bf31-4184-bfef-1a75d06095e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:01.968850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 847/1704] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:01.969793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5fc0a-4771-4871-827d-c7328140ddc5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:01.976569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7fb5fc0a-4771-4871-827d-c7328140ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:02.075105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 858/1705] 10.222.0.24 () {58 vars in 1015 bytes} [Tue Mar 8 15:39:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:02.076289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0d77e-bf31-4184-bfef-1a75d06095e9 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:02.085060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2eb0d77e-bf31-4184-bfef-1a75d06095e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:02.134770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0d77e-bf31-4184-bfef-1a75d06095e9 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:02.135390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5fc0a-4771-4871-827d-c7328140ddc5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:02.148122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed2c46-1b27-4a27-9985-4aaff725a9c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:02.149122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed2c46-1b27-4a27-9985-4aaff725a9c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:02.149644 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed2c46-1b27-4a27-9985-4aaff725a9c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:02.150266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed2c46-1b27-4a27-9985-4aaff725a9c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:02.153186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-11ed2c46-1b27-4a27-9985-4aaff725a9c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:02.155953 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efdd0c-6761-4f03-8c2f-21e5318816cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:02.157646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efdd0c-6761-4f03-8c2f-21e5318816cc admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:02.159576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efdd0c-6761-4f03-8c2f-21e5318816cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:02.160315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efdd0c-6761-4f03-8c2f-21e5318816cc admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:02.162093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efdd0c-6761-4f03-8c2f-21e5318816cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:02.168991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efdd0c-6761-4f03-8c2f-21e5318816cc admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:02.321792 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed2c46-1b27-4a27-9985-4aaff725a9c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:02.323331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed2c46-1b27-4a27-9985-4aaff725a9c5 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:02.338662 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 859/1706] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:02 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:02.342072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2d211-b768-406e-bd83-61795f0910c4 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:02.345001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2d211-b768-406e-bd83-61795f0910c4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:02.345928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2d211-b768-406e-bd83-61795f0910c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:02.386229 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 848/1707] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:02.396712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714c2a1-1d10-4731-b21d-0c8e412eaadd None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:02.397009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714c2a1-1d10-4731-b21d-0c8e412eaadd None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:02.397286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714c2a1-1d10-4731-b21d-0c8e412eaadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:02.415209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-3dd2d211-b768-406e-bd83-61795f0910c4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:02.427373 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3dd2d211-b768-406e-bd83-61795f0910c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:02.459586 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-c714c2a1-1d10-4731-b21d-0c8e412eaadd None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:02.462094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 860/1708] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:02.465445 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2d211-b768-406e-bd83-61795f0910c4 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:02.465836 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c714c2a1-1d10-4731-b21d-0c8e412eaadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:02.467457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3dd2d211-b768-406e-bd83-61795f0910c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:02.508510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 849/1709] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:02.510034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2d211-b768-406e-bd83-61795f0910c4 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:02.511782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714c2a1-1d10-4731-b21d-0c8e412eaadd None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:02.514295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c714c2a1-1d10-4731-b21d-0c8e412eaadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:02.523588 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be2163-bdff-4de6-82dc-eeb0a580e5a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:02.524309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be2163-bdff-4de6-82dc-eeb0a580e5a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:02.524701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be2163-bdff-4de6-82dc-eeb0a580e5a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:02.524907 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be2163-bdff-4de6-82dc-eeb0a580e5a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:02.546492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714c2a1-1d10-4731-b21d-0c8e412eaadd None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:02.552795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be2163-bdff-4de6-82dc-eeb0a580e5a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:02.555161 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be2163-bdff-4de6-82dc-eeb0a580e5a4 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:02.565392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:02.566271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:02.566554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:02.566856 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] PATH_INFO: `/v3/projects/d76d3a9d9ade4b5f873466d35584bdad` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:02.571510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76d3a9d9ade4b5f873466d35584bdad)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:02.573600 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:02.576041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 861/1710] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:02.596761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be2163-bdff-4de6-82dc-eeb0a580e5a4 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:02.640112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be2163-bdff-4de6-82dc-eeb0a580e5a4 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:02.670535 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bcb47-0b96-4a4e-bc4e-facfd1440a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:02.671991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bcb47-0b96-4a4e-bc4e-facfd1440a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:02.673139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bcb47-0b96-4a4e-bc4e-facfd1440a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:02.673551 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bcb47-0b96-4a4e-bc4e-facfd1440a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:02.675494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bcb47-0b96-4a4e-bc4e-facfd1440a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:02.677052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bcb47-0b96-4a4e-bc4e-facfd1440a73 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:02.694947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 862/1711] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:02.694947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bcb47-0b96-4a4e-bc4e-facfd1440a73 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:02.741513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bcb47-0b96-4a4e-bc4e-facfd1440a73 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:02.752530 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c95b6c-1205-47a2-960d-bca75ded318e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:02.753291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95b6c-1205-47a2-960d-bca75ded318e service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:02.753676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95b6c-1205-47a2-960d-bca75ded318e service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:02.755963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c95b6c-1205-47a2-960d-bca75ded318e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:02.801215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c95b6c-1205-47a2-960d-bca75ded318e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:02.803921 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c95b6c-1205-47a2-960d-bca75ded318e service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:02.807637 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76d3a9d9ade4b5f873466d35584bdad', 'request_id': 'req-faf08ff6-4347-431f-8865-43f997fd6c87'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:02.838803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76d3a9d9ade4b5f873466d35584bdad', 'request_id': 'req-faf08ff6-4347-431f-8865-43f997fd6c87'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:02.858787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 863/1712] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:02.860039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c95b6c-1205-47a2-960d-bca75ded318e service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:02.871626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76d3a9d9ade4b5f873466d35584bdad', 'request_id': 'req-faf08ff6-4347-431f-8865-43f997fd6c87'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:02.881264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c95b6c-1205-47a2-960d-bca75ded318e service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:03.002000 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f65dbe-416c-401a-aa1f-c2e82f567c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:03.003002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f65dbe-416c-401a-aa1f-c2e82f567c68 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:03.003373 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f65dbe-416c-401a-aa1f-c2e82f567c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:03.003750 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f65dbe-416c-401a-aa1f-c2e82f567c68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:03.004570 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f65dbe-416c-401a-aa1f-c2e82f567c68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:03.004881 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f65dbe-416c-401a-aa1f-c2e82f567c68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:03.006534 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f65dbe-416c-401a-aa1f-c2e82f567c68 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:03.044696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 864/1713] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:03.044696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5267616-f7ce-46b3-83c0-fcd2e58f7150 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:03.044696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5267616-f7ce-46b3-83c0-fcd2e58f7150 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:03.044696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5267616-f7ce-46b3-83c0-fcd2e58f7150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:03.107720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f5267616-f7ce-46b3-83c0-fcd2e58f7150 None None] MFA Rules not processed for user `fb710b14dbb44ea3b8d8942e89088b17`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:03.109251 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f5267616-f7ce-46b3-83c0-fcd2e58f7150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:03.206763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 865/1714] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:03.214313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5267616-f7ce-46b3-83c0-fcd2e58f7150 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:03.235945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] The token cache is being invalidate because project d76d3a9d9ade4b5f873466d35584bdad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:03.237813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:03.239286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:03.242736 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 850/1715] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:02 2022] DELETE /identity/v3/projects/d76d3a9d9ade4b5f873466d35584bdad => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:03.244029 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:03.248988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5267616-f7ce-46b3-83c0-fcd2e58f7150 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:03.250058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:03.267684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a45781-ab01-4b1d-8b54-874e4c1408b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:03.270303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a45781-ab01-4b1d-8b54-874e4c1408b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:03.271023 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a45781-ab01-4b1d-8b54-874e4c1408b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:03.271534 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a45781-ab01-4b1d-8b54-874e4c1408b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:03.272522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a45781-ab01-4b1d-8b54-874e4c1408b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:03.275978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a45781-ab01-4b1d-8b54-874e4c1408b7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:03.287761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf08ff6-4347-431f-8865-43f997fd6c87 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:03.303971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 866/1716] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:03.305500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2853d03-96e8-481c-acfa-9d36dac7f619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:03.306727 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2853d03-96e8-481c-acfa-9d36dac7f619 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:03.307228 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2853d03-96e8-481c-acfa-9d36dac7f619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:03.307851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2853d03-96e8-481c-acfa-9d36dac7f619 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:03.308843 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2853d03-96e8-481c-acfa-9d36dac7f619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:03.312019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2853d03-96e8-481c-acfa-9d36dac7f619 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:03.314165 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03749056-d126-44b2-8532-d594e3f265d6 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:03.316345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03749056-d126-44b2-8532-d594e3f265d6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:03.317910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03749056-d126-44b2-8532-d594e3f265d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:03.381592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-03749056-d126-44b2-8532-d594e3f265d6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:03.386183 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-03749056-d126-44b2-8532-d594e3f265d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:03.416229 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 867/1717] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:03.417576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03749056-d126-44b2-8532-d594e3f265d6 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:03.420337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-03749056-d126-44b2-8532-d594e3f265d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:03.456523 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 851/1718] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:03 2022] POST /identity/v3/projects => generated 403 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:03.458808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e4d1-f677-4085-be76-d7a801054361 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:03.459587 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e4d1-f677-4085-be76-d7a801054361 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:03.461488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e4d1-f677-4085-be76-d7a801054361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:03.465821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03749056-d126-44b2-8532-d594e3f265d6 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:03.541120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-4311e4d1-f677-4085-be76-d7a801054361 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:03.546057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4311e4d1-f677-4085-be76-d7a801054361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:03.717050 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ff64a-89b9-46e7-a7a4-435cc9fb1f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:03.730088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ff64a-89b9-46e7-a7a4-435cc9fb1f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:03.730426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ff64a-89b9-46e7-a7a4-435cc9fb1f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:03.730711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ff64a-89b9-46e7-a7a4-435cc9fb1f3d admin admin] PATH_INFO: `/v3/projects/f5acc4db97534b5596ce5b75dde79609/users/b19643274a0c4d81b3c5e4632a19490a/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:03.785045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ff64a-89b9-46e7-a7a4-435cc9fb1f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5acc4db97534b5596ce5b75dde79609, user_id=b19643274a0c4d81b3c5e4632a19490a, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:03.799365 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ff64a-89b9-46e7-a7a4-435cc9fb1f3d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:03.806597 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 852/1719] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:03.807672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e4d1-f677-4085-be76-d7a801054361 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:03.854414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e4d1-f677-4085-be76-d7a801054361 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:03.884177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65839cee-29a8-4afd-8f51-f98d213a5703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:03.887671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65839cee-29a8-4afd-8f51-f98d213a5703 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:03.888975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65839cee-29a8-4afd-8f51-f98d213a5703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:03.890526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65839cee-29a8-4afd-8f51-f98d213a5703 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:03.898382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65839cee-29a8-4afd-8f51-f98d213a5703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:03.907280 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65839cee-29a8-4afd-8f51-f98d213a5703 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:03.925766 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 868/1720] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:03 2022] PUT /identity/v3/projects/f5acc4db97534b5596ce5b75dde79609/users/b19643274a0c4d81b3c5e4632a19490a/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:03.928249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ff64a-89b9-46e7-a7a4-435cc9fb1f3d admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:04.088033 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ff64a-89b9-46e7-a7a4-435cc9fb1f3d admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:04.101869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f5683-111a-4a5a-93f4-94fb9f7352bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:04.103427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f5683-111a-4a5a-93f4-94fb9f7352bc admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:04.103427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f5683-111a-4a5a-93f4-94fb9f7352bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:04.103427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f5683-111a-4a5a-93f4-94fb9f7352bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:04.104433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f5683-111a-4a5a-93f4-94fb9f7352bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:04.104788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f5683-111a-4a5a-93f4-94fb9f7352bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:04.106749 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f5683-111a-4a5a-93f4-94fb9f7352bc admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:04.147325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 869/1721] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:04.152862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7992a-3103-4139-8214-52f4164e87aa None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:04.153503 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7992a-3103-4139-8214-52f4164e87aa None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:04.153660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7992a-3103-4139-8214-52f4164e87aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:04.198409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 853/1722] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:03 2022] POST /identity/v3/users => generated 302 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:04.198409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05c293-ab23-4846-b827-97dcfca93eff None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:04.198409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05c293-ab23-4846-b827-97dcfca93eff None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:04.198409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05c293-ab23-4846-b827-97dcfca93eff None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:04.209365 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 854/1723] 10.222.0.25 () {54 vars in 912 bytes} [Tue Mar 8 15:39:04 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:39:04.211789 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05c293-ab23-4846-b827-97dcfca93eff None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:04.234837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5ce7992a-3103-4139-8214-52f4164e87aa None None] MFA Rules not processed for user `b19643274a0c4d81b3c5e4632a19490a`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:04.235885 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5ce7992a-3103-4139-8214-52f4164e87aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:04.270189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05c293-ab23-4846-b827-97dcfca93eff None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:04.288507 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d38249-5024-4e98-bd2d-1625f601f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:04.288746 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38249-5024-4e98-bd2d-1625f601f241 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:04.289347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38249-5024-4e98-bd2d-1625f601f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:04.289636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d38249-5024-4e98-bd2d-1625f601f241 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:04.290445 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d38249-5024-4e98-bd2d-1625f601f241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:04.292943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d38249-5024-4e98-bd2d-1625f601f241 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:04.333164 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 870/1724] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:04.334285 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7992a-3103-4139-8214-52f4164e87aa None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:04.354415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7992a-3103-4139-8214-52f4164e87aa None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:04.363887 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3537e4-4455-4e2f-b16f-683f8defedbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:04.364653 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3537e4-4455-4e2f-b16f-683f8defedbd admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:04.364936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3537e4-4455-4e2f-b16f-683f8defedbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:04.365730 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3537e4-4455-4e2f-b16f-683f8defedbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:04.366682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3537e4-4455-4e2f-b16f-683f8defedbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:04.368824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3537e4-4455-4e2f-b16f-683f8defedbd admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:04.384111 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 871/1725] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:04.385757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd57a7-e803-4be1-a134-2396f09a4649 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:04.386085 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd57a7-e803-4be1-a134-2396f09a4649 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:04.386721 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd57a7-e803-4be1-a134-2396f09a4649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:04.428654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-51cd57a7-e803-4be1-a134-2396f09a4649 None None] MFA Rules not processed for user `028d499ea279442d822c6723c367f459`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:04.434346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-51cd57a7-e803-4be1-a134-2396f09a4649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:04.462092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 855/1726] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:04 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:04.463022 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d38249-5024-4e98-bd2d-1625f601f241 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:04.594857 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 872/1727] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:04.595738 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d38249-5024-4e98-bd2d-1625f601f241 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:04.606953 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd57a7-e803-4be1-a134-2396f09a4649 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:04.625454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d88756-4784-43be-9316-09ec21143da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:04.626147 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d88756-4784-43be-9316-09ec21143da9 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:04.627617 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d88756-4784-43be-9316-09ec21143da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:04.627911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d88756-4784-43be-9316-09ec21143da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:04.628707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d88756-4784-43be-9316-09ec21143da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:04.635855 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d88756-4784-43be-9316-09ec21143da9 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:04.667120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd57a7-e803-4be1-a134-2396f09a4649 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:04.675447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36742-684f-40cd-ba75-07a50e5583ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:04.678987 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36742-684f-40cd-ba75-07a50e5583ac admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:04.680887 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36742-684f-40cd-ba75-07a50e5583ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:04.681801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36742-684f-40cd-ba75-07a50e5583ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:04.684953 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a36742-684f-40cd-ba75-07a50e5583ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:04.689499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a36742-684f-40cd-ba75-07a50e5583ac admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:04.711120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 873/1728] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:04.712238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36742-684f-40cd-ba75-07a50e5583ac admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:04.731510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36742-684f-40cd-ba75-07a50e5583ac admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:04.737906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35477efc-8fe6-4ac1-965e-cd8563edb6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:04.738732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35477efc-8fe6-4ac1-965e-cd8563edb6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:04.739020 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35477efc-8fe6-4ac1-965e-cd8563edb6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:04.739340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35477efc-8fe6-4ac1-965e-cd8563edb6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:04.740107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35477efc-8fe6-4ac1-965e-cd8563edb6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:04.742618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35477efc-8fe6-4ac1-965e-cd8563edb6d0 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:04.842062 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 856/1729] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:04 2022] POST /identity/v3/projects => generated 375 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:04.845309 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d88756-4784-43be-9316-09ec21143da9 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:04.865595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-24d88756-4784-43be-9316-09ec21143da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:04.987066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d88756-4784-43be-9316-09ec21143da9 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:04.987066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f8981-43a9-4153-a4a4-9300c9b061db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:04.987066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f8981-43a9-4153-a4a4-9300c9b061db service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:04.987066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f8981-43a9-4153-a4a4-9300c9b061db service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:04.995509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f8981-43a9-4153-a4a4-9300c9b061db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:05.011089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f8981-43a9-4153-a4a4-9300c9b061db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:05.012905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f8981-43a9-4153-a4a4-9300c9b061db service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:05.024970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 857/1730] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:05.025976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f8981-43a9-4153-a4a4-9300c9b061db service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:05.089580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 874/1731] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:04 2022] POST /identity/v3/users => generated 290 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:05.100616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35477efc-8fe6-4ac1-965e-cd8563edb6d0 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:05.109215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-35477efc-8fe6-4ac1-965e-cd8563edb6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:05.144368 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35477efc-8fe6-4ac1-965e-cd8563edb6d0 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:05.263129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f8981-43a9-4153-a4a4-9300c9b061db service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:05.280114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514fe94-a8ca-4879-933e-6fdf02098734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:05.281056 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514fe94-a8ca-4879-933e-6fdf02098734 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:05.281336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514fe94-a8ca-4879-933e-6fdf02098734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:05.281612 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514fe94-a8ca-4879-933e-6fdf02098734 admin admin] PATH_INFO: `/v3/projects/7a8f040966f642e8b57caf76bfcd7383/users/9888620c377a4b7f852ad37a1dbadbaa/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:05.282193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:05.288294 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:05.290767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:05.298777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] PATH_INFO: `/v3/projects/915876653e4646c783541ff6a50a9d4c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:05.315525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915876653e4646c783541ff6a50a9d4c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:05.315525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:05.325407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514fe94-a8ca-4879-933e-6fdf02098734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8f040966f642e8b57caf76bfcd7383, user_id=9888620c377a4b7f852ad37a1dbadbaa, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:05.329120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514fe94-a8ca-4879-933e-6fdf02098734 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:05.558207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 858/1732] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:05 2022] PUT /identity/v3/projects/7a8f040966f642e8b57caf76bfcd7383/users/9888620c377a4b7f852ad37a1dbadbaa/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:05.558207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514fe94-a8ca-4879-933e-6fdf02098734 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:05.691144 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514fe94-a8ca-4879-933e-6fdf02098734 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:05.730531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915876653e4646c783541ff6a50a9d4c', 'request_id': 'req-e8ab3be7-b317-47d1-bc78-58dfafbb5286'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:05.752607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915876653e4646c783541ff6a50a9d4c', 'request_id': 'req-e8ab3be7-b317-47d1-bc78-58dfafbb5286'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:05.904968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43eaf3-e1f8-4fd3-a968-527957782ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:05.905661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43eaf3-e1f8-4fd3-a968-527957782ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:05.905946 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43eaf3-e1f8-4fd3-a968-527957782ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:05.906225 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43eaf3-e1f8-4fd3-a968-527957782ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:05.906922 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43eaf3-e1f8-4fd3-a968-527957782ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:05.909585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43eaf3-e1f8-4fd3-a968-527957782ab2 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:05.917265 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915876653e4646c783541ff6a50a9d4c', 'request_id': 'req-e8ab3be7-b317-47d1-bc78-58dfafbb5286'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:05.937117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] The token cache is being invalidate because project 915876653e4646c783541ff6a50a9d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:05.937410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:05.938674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:05.940726 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 875/1733] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:05 2022] DELETE /identity/v3/projects/915876653e4646c783541ff6a50a9d4c => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:05.941573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:05.953407 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:05.984398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab3be7-b317-47d1-bc78-58dfafbb5286 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:06.004678 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a880e-0674-4123-a1ef-f5909ffd2455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:06.005401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a880e-0674-4123-a1ef-f5909ffd2455 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:06.005683 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a880e-0674-4123-a1ef-f5909ffd2455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:06.006251 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a880e-0674-4123-a1ef-f5909ffd2455 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:06.007190 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a880e-0674-4123-a1ef-f5909ffd2455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:06.032542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a880e-0674-4123-a1ef-f5909ffd2455 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:06.038740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 859/1734] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:05 2022] POST /identity/v3/users => generated 294 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:06.040852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d93f0-ae8a-4c92-93a9-343e07890975 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:06.041039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d93f0-ae8a-4c92-93a9-343e07890975 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:06.041333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d93f0-ae8a-4c92-93a9-343e07890975 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:06.049472 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 876/1735] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:06.056264 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 860/1736] 10.222.0.25 () {54 vars in 921 bytes} [Tue Mar 8 15:39:06 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:39:06.057905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc00b1-d243-4ddf-bd69-947953625ff3 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:06.058650 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc00b1-d243-4ddf-bd69-947953625ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:06.059068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc00b1-d243-4ddf-bd69-947953625ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:06.076017 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379db5-73cd-4f23-97ca-07f222f554b3 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:06.077747 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379db5-73cd-4f23-97ca-07f222f554b3 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:06.078071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379db5-73cd-4f23-97ca-07f222f554b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:06.096455 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-1ecc00b1-d243-4ddf-bd69-947953625ff3 None None] MFA Rules not processed for user `af4907a2aa8b48b0a0810f23d75f9eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:06.097808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1ecc00b1-d243-4ddf-bd69-947953625ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:06.152439 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-e7379db5-73cd-4f23-97ca-07f222f554b3 None None] MFA Rules not processed for user `9888620c377a4b7f852ad37a1dbadbaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:06.153970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e7379db5-73cd-4f23-97ca-07f222f554b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:06.376627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 861/1737] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:06.376627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d895e0-eca3-48bc-97fd-a633a37cda4f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:06.376627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d895e0-eca3-48bc-97fd-a633a37cda4f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:06.376627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d895e0-eca3-48bc-97fd-a633a37cda4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:06.378119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 877/1738] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:06.378119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7379db5-73cd-4f23-97ca-07f222f554b3 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:06.378119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e7379db5-73cd-4f23-97ca-07f222f554b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:06.378311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-f4d895e0-eca3-48bc-97fd-a633a37cda4f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:06.378311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f4d895e0-eca3-48bc-97fd-a633a37cda4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:06.382756 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7379db5-73cd-4f23-97ca-07f222f554b3 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:06.387832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 862/1739] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:06.395034 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d895e0-eca3-48bc-97fd-a633a37cda4f None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:06.400725 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fe5c5-ff68-492d-8165-95d1769dc374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:06.401420 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fe5c5-ff68-492d-8165-95d1769dc374 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:06.402812 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fe5c5-ff68-492d-8165-95d1769dc374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:06.403097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fe5c5-ff68-492d-8165-95d1769dc374 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:06.403856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fe5c5-ff68-492d-8165-95d1769dc374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:06.406837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fe5c5-ff68-492d-8165-95d1769dc374 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:06.440848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 878/1740] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:06.442278 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70517368-7107-4a02-bc17-c8aaf52878ff None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:06.442574 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70517368-7107-4a02-bc17-c8aaf52878ff None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:06.442855 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70517368-7107-4a02-bc17-c8aaf52878ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:06.445824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d895e0-eca3-48bc-97fd-a633a37cda4f None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:06.453011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26e32d-fbe0-4f87-a1d0-155b42c3a781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:06.454134 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26e32d-fbe0-4f87-a1d0-155b42c3a781 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:06.454523 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26e32d-fbe0-4f87-a1d0-155b42c3a781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:06.455121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26e32d-fbe0-4f87-a1d0-155b42c3a781 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:06.456180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26e32d-fbe0-4f87-a1d0-155b42c3a781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:06.460274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26e32d-fbe0-4f87-a1d0-155b42c3a781 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:06.480906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-70517368-7107-4a02-bc17-c8aaf52878ff None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:06.482142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-70517368-7107-4a02-bc17-c8aaf52878ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:06.490355 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 863/1741] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:06.491351 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26e32d-fbe0-4f87-a1d0-155b42c3a781 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:06.512707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7b26e32d-fbe0-4f87-a1d0-155b42c3a781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:06.558043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26e32d-fbe0-4f87-a1d0-155b42c3a781 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:06.572530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53905c-dc18-46ea-94df-648c0048b864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:06.574138 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53905c-dc18-46ea-94df-648c0048b864 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:06.574138 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53905c-dc18-46ea-94df-648c0048b864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:06.574138 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53905c-dc18-46ea-94df-648c0048b864 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:06.574659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53905c-dc18-46ea-94df-648c0048b864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:06.581984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53905c-dc18-46ea-94df-648c0048b864 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:06.628473 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 879/1742] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Mar 8 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:06.630185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4fd42-e228-4a3b-a4e3-f544d01a5ee6 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:06.631101 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4fd42-e228-4a3b-a4e3-f544d01a5ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:06.631642 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4fd42-e228-4a3b-a4e3-f544d01a5ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:06.660862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a2c4fd42-e228-4a3b-a4e3-f544d01a5ee6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:06.662540 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a2c4fd42-e228-4a3b-a4e3-f544d01a5ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:06.680437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 880/1743] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:06.683454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4fd42-e228-4a3b-a4e3-f544d01a5ee6 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:06.702813 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4fd42-e228-4a3b-a4e3-f544d01a5ee6 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:06.708108 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9dff1-ebc3-48ab-a140-da546a2dece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:06.709157 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9dff1-ebc3-48ab-a140-da546a2dece4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:06.709501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9dff1-ebc3-48ab-a140-da546a2dece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:06.709788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9dff1-ebc3-48ab-a140-da546a2dece4 admin admin] PATH_INFO: `/v3/projects/3c91dc5a59934f20847d2a43dbb919c5/users/d8f2b568582848b09b65497f14355b6e/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:06.728417 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9dff1-ebc3-48ab-a140-da546a2dece4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c91dc5a59934f20847d2a43dbb919c5, user_id=d8f2b568582848b09b65497f14355b6e, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:06.731615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9dff1-ebc3-48ab-a140-da546a2dece4 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:06.851766 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 864/1744] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:06 2022] POST /identity/v3/projects => generated 405 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:06.851766 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53905c-dc18-46ea-94df-648c0048b864 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:06.917374 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53905c-dc18-46ea-94df-648c0048b864 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:06.926652 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e3745-5522-4302-affb-bf595e024338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:06.926652 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3745-5522-4302-affb-bf595e024338 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:06.926652 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3745-5522-4302-affb-bf595e024338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:06.926652 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e3745-5522-4302-affb-bf595e024338 admin admin] PATH_INFO: `/v3/projects/27cec17880eb49589a90e5b3773e8950/users/75244b948278427798481c9d70c44ea1/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:06.938715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e3745-5522-4302-affb-bf595e024338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cec17880eb49589a90e5b3773e8950, user_id=75244b948278427798481c9d70c44ea1, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:06.942440 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e3745-5522-4302-affb-bf595e024338 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:07.008833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 881/1745] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:06 2022] PUT /identity/v3/projects/3c91dc5a59934f20847d2a43dbb919c5/users/d8f2b568582848b09b65497f14355b6e/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:07.009685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9dff1-ebc3-48ab-a140-da546a2dece4 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:07.011240 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-60f9dff1-ebc3-48ab-a140-da546a2dece4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:07.050009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 865/1746] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:06 2022] PUT /identity/v3/projects/27cec17880eb49589a90e5b3773e8950/users/75244b948278427798481c9d70c44ea1/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:07.061019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e3745-5522-4302-affb-bf595e024338 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:07.137872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9dff1-ebc3-48ab-a140-da546a2dece4 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:07.165522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e3745-5522-4302-affb-bf595e024338 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:07.176520 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea80bc-2cc9-4b27-9878-d0eceea5e563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:07.179321 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea80bc-2cc9-4b27-9878-d0eceea5e563 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:07.179703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea80bc-2cc9-4b27-9878-d0eceea5e563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:07.180823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea80bc-2cc9-4b27-9878-d0eceea5e563 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:07.187319 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea80bc-2cc9-4b27-9878-d0eceea5e563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:07.187319 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea80bc-2cc9-4b27-9878-d0eceea5e563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:07.187319 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea80bc-2cc9-4b27-9878-d0eceea5e563 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:07.211626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 866/1747] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:07.212576 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea80bc-2cc9-4b27-9878-d0eceea5e563 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:07.224090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea80bc-2cc9-4b27-9878-d0eceea5e563 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:07.229477 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525ff04-47a7-4531-9ede-7061d017fc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:07.230329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525ff04-47a7-4531-9ede-7061d017fc8e admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:07.230620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525ff04-47a7-4531-9ede-7061d017fc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:07.230908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525ff04-47a7-4531-9ede-7061d017fc8e admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:07.231599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525ff04-47a7-4531-9ede-7061d017fc8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:07.234901 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525ff04-47a7-4531-9ede-7061d017fc8e admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:07.269301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef325ac2-6feb-4d7c-a140-2e43ef4772df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:07.269994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef325ac2-6feb-4d7c-a140-2e43ef4772df service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:07.271208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef325ac2-6feb-4d7c-a140-2e43ef4772df service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:07.271208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef325ac2-6feb-4d7c-a140-2e43ef4772df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:07.295539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef325ac2-6feb-4d7c-a140-2e43ef4772df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:07.303142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef325ac2-6feb-4d7c-a140-2e43ef4772df service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:07.311818 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 882/1748] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:07.312828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef325ac2-6feb-4d7c-a140-2e43ef4772df service nova] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:07.331335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef325ac2-6feb-4d7c-a140-2e43ef4772df service nova] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:07.336859 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b38511-e005-475c-9c86-e6782514cb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:07.337790 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b38511-e005-475c-9c86-e6782514cb98 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:07.338232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b38511-e005-475c-9c86-e6782514cb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:07.338906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b38511-e005-475c-9c86-e6782514cb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:07.339765 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b38511-e005-475c-9c86-e6782514cb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:07.341561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b38511-e005-475c-9c86-e6782514cb98 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:07.353496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 867/1749] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:07 2022] POST /identity/v3/users => generated 309 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:07.355779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c6606-c66c-4c10-accb-4ffdbb34f1ea None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:07.355779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c6606-c66c-4c10-accb-4ffdbb34f1ea None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:07.356000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c6606-c66c-4c10-accb-4ffdbb34f1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:07.379305 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 883/1750] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:07.379305 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b38511-e005-475c-9c86-e6782514cb98 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:07.419316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b38511-e005-475c-9c86-e6782514cb98 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:07.423518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-a38c6606-c66c-4c10-accb-4ffdbb34f1ea None None] MFA Rules not processed for user `75244b948278427798481c9d70c44ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:07.426072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a38c6606-c66c-4c10-accb-4ffdbb34f1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:07.428328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f321b1-ae69-4363-9d06-9b432de11740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:07.434003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f321b1-ae69-4363-9d06-9b432de11740 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:07.434003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f321b1-ae69-4363-9d06-9b432de11740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:07.434003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f321b1-ae69-4363-9d06-9b432de11740 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:07.434003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f321b1-ae69-4363-9d06-9b432de11740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:07.451287 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f321b1-ae69-4363-9d06-9b432de11740 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:07.588187 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 868/1751] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:07.588187 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c6606-c66c-4c10-accb-4ffdbb34f1ea None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:07.618800 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c6606-c66c-4c10-accb-4ffdbb34f1ea None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:07.630515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceae74c-7bfd-4d75-9a12-7cb421f6af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:07.631211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceae74c-7bfd-4d75-9a12-7cb421f6af4e admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:07.631635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceae74c-7bfd-4d75-9a12-7cb421f6af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:07.631916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceae74c-7bfd-4d75-9a12-7cb421f6af4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:07.632906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceae74c-7bfd-4d75-9a12-7cb421f6af4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:07.638938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceae74c-7bfd-4d75-9a12-7cb421f6af4e admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:07.653261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 869/1752] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:07.654167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceae74c-7bfd-4d75-9a12-7cb421f6af4e admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:07.679340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 884/1753] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:07 2022] POST /identity/v3/projects => generated 371 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:07.680596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f321b1-ae69-4363-9d06-9b432de11740 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:07.687945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceae74c-7bfd-4d75-9a12-7cb421f6af4e admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:07.884448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f321b1-ae69-4363-9d06-9b432de11740 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:07.884748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174fd7b-458a-4789-a79e-97f900891d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:07.885870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174fd7b-458a-4789-a79e-97f900891d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:07.886286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174fd7b-458a-4789-a79e-97f900891d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:07.886705 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174fd7b-458a-4789-a79e-97f900891d9a admin admin] PATH_INFO: `/v3/projects/3c91dc5a59934f20847d2a43dbb919c5/users/d8f2b568582848b09b65497f14355b6e/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:07.890877 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358125ac-6e86-4a3f-a402-16cdbb150f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:07.891319 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174fd7b-458a-4789-a79e-97f900891d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c91dc5a59934f20847d2a43dbb919c5, user_id=d8f2b568582848b09b65497f14355b6e, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:07.891921 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358125ac-6e86-4a3f-a402-16cdbb150f37 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:07.892352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358125ac-6e86-4a3f-a402-16cdbb150f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:07.893293 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358125ac-6e86-4a3f-a402-16cdbb150f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:07.894328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358125ac-6e86-4a3f-a402-16cdbb150f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:07.896397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358125ac-6e86-4a3f-a402-16cdbb150f37 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:07.991055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174fd7b-458a-4789-a79e-97f900891d9a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:07.991055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 870/1754] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:07 2022] PUT /identity/v3/projects/3c91dc5a59934f20847d2a43dbb919c5/users/d8f2b568582848b09b65497f14355b6e/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:07.991055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174fd7b-458a-4789-a79e-97f900891d9a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:07.999527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174fd7b-458a-4789-a79e-97f900891d9a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:08.004862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642ca4d-57d4-48ed-b5dd-351b578733b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:08.005801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642ca4d-57d4-48ed-b5dd-351b578733b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.006085 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642ca4d-57d4-48ed-b5dd-351b578733b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.006362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642ca4d-57d4-48ed-b5dd-351b578733b3 admin admin] PATH_INFO: `/v3/projects/994005db41b54a31a3d18a4fb5c617b6/users/a43631f63b594a079f4db4261f43873f/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.020864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642ca4d-57d4-48ed-b5dd-351b578733b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=994005db41b54a31a3d18a4fb5c617b6, user_id=a43631f63b594a079f4db4261f43873f, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:08.023660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642ca4d-57d4-48ed-b5dd-351b578733b3 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:08.205960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 871/1755] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:07 2022] PUT /identity/v3/projects/994005db41b54a31a3d18a4fb5c617b6/users/a43631f63b594a079f4db4261f43873f/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:08.209387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642ca4d-57d4-48ed-b5dd-351b578733b3 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:08.209495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 885/1756] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:07 2022] POST /identity/v3/projects => generated 381 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:08.209495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65497e-2a27-4f0d-aa40-396c95fdd138 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.209495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65497e-2a27-4f0d-aa40-396c95fdd138 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.209495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65497e-2a27-4f0d-aa40-396c95fdd138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.235354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-ab65497e-2a27-4f0d-aa40-396c95fdd138 None None] MFA Rules not processed for user `d8f2b568582848b09b65497f14355b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:08.238102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ab65497e-2a27-4f0d-aa40-396c95fdd138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:08.273044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642ca4d-57d4-48ed-b5dd-351b578733b3 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:08.305960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 886/1757] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:08.307052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65497e-2a27-4f0d-aa40-396c95fdd138 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:08.331289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbc17c-fb81-468f-b5d5-e3ec7f22f156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:08.331964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbc17c-fb81-468f-b5d5-e3ec7f22f156 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.332285 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbc17c-fb81-468f-b5d5-e3ec7f22f156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.332566 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbc17c-fb81-468f-b5d5-e3ec7f22f156 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.333277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbc17c-fb81-468f-b5d5-e3ec7f22f156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:08.335199 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cbc17c-fb81-468f-b5d5-e3ec7f22f156 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:08.374076 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65497e-2a27-4f0d-aa40-396c95fdd138 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:08.378774 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008fe75-4b8d-45b0-8848-704c9f3718c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:08.379441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008fe75-4b8d-45b0-8848-704c9f3718c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.379718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008fe75-4b8d-45b0-8848-704c9f3718c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.379994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008fe75-4b8d-45b0-8848-704c9f3718c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.380763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008fe75-4b8d-45b0-8848-704c9f3718c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:08.382356 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008fe75-4b8d-45b0-8848-704c9f3718c6 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:08.392236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 887/1758] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:08.393176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008fe75-4b8d-45b0-8848-704c9f3718c6 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:08.402328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008fe75-4b8d-45b0-8848-704c9f3718c6 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:08.406869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488b679-7ab1-43fd-b022-95a2d7b9553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:08.409572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488b679-7ab1-43fd-b022-95a2d7b9553e admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.409572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488b679-7ab1-43fd-b022-95a2d7b9553e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.409572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488b679-7ab1-43fd-b022-95a2d7b9553e admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.409572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488b679-7ab1-43fd-b022-95a2d7b9553e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:08.411071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488b679-7ab1-43fd-b022-95a2d7b9553e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:08.428720 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 872/1759] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:08 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:08.433826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbc17c-fb81-468f-b5d5-e3ec7f22f156 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:08.433826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-19cbc17c-fb81-468f-b5d5-e3ec7f22f156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:08.488895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbc17c-fb81-468f-b5d5-e3ec7f22f156 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:08.492570 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75edfd-4f21-4376-a51d-3401fad0e07d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:08.493216 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75edfd-4f21-4376-a51d-3401fad0e07d service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.493505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75edfd-4f21-4376-a51d-3401fad0e07d service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.493786 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75edfd-4f21-4376-a51d-3401fad0e07d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.495585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7e75edfd-4f21-4376-a51d-3401fad0e07d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:08.513537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 888/1760] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:08 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:08.513537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488b679-7ab1-43fd-b022-95a2d7b9553e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:08.521642 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488b679-7ab1-43fd-b022-95a2d7b9553e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:08.526503 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb3d54-a800-4407-b03e-5547fc65cbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:08.527332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb3d54-a800-4407-b03e-5547fc65cbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.527595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb3d54-a800-4407-b03e-5547fc65cbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.527869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb3d54-a800-4407-b03e-5547fc65cbaf admin admin] PATH_INFO: `/v3/projects/994005db41b54a31a3d18a4fb5c617b6/users/a43631f63b594a079f4db4261f43873f/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.529995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb3d54-a800-4407-b03e-5547fc65cbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=994005db41b54a31a3d18a4fb5c617b6, user_id=a43631f63b594a079f4db4261f43873f, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:08.532970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb3d54-a800-4407-b03e-5547fc65cbaf admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:08.545663 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 889/1761] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:08 2022] PUT /identity/v3/projects/994005db41b54a31a3d18a4fb5c617b6/users/a43631f63b594a079f4db4261f43873f/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:08.546500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb3d54-a800-4407-b03e-5547fc65cbaf admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:08.562178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75edfd-4f21-4376-a51d-3401fad0e07d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:08.563629 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75edfd-4f21-4376-a51d-3401fad0e07d service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:08.573284 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 873/1762] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:08.574095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75edfd-4f21-4376-a51d-3401fad0e07d service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:08.584878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75edfd-4f21-4376-a51d-3401fad0e07d service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:08.612726 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb3d54-a800-4407-b03e-5547fc65cbaf admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:08.618071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802354a-1a95-4a4b-9afb-8dbc288c5961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:08.618936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802354a-1a95-4a4b-9afb-8dbc288c5961 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.619325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802354a-1a95-4a4b-9afb-8dbc288c5961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.619721 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802354a-1a95-4a4b-9afb-8dbc288c5961 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.620596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802354a-1a95-4a4b-9afb-8dbc288c5961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:08.622398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802354a-1a95-4a4b-9afb-8dbc288c5961 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:08.636215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 890/1763] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:08.636215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8286f-2204-4e4e-bea3-34ace76128ab None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.636215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8286f-2204-4e4e-bea3-34ace76128ab None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.636215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8286f-2204-4e4e-bea3-34ace76128ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.662929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-d4c8286f-2204-4e4e-bea3-34ace76128ab None None] MFA Rules not processed for user `a43631f63b594a079f4db4261f43873f`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:08.665795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d4c8286f-2204-4e4e-bea3-34ace76128ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:08.666452 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f429424-d03e-49ac-8691-238d7ec3240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:08.667123 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f429424-d03e-49ac-8691-238d7ec3240f admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.667419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f429424-d03e-49ac-8691-238d7ec3240f admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.667699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f429424-d03e-49ac-8691-238d7ec3240f admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.668468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f429424-d03e-49ac-8691-238d7ec3240f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:08.670082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f429424-d03e-49ac-8691-238d7ec3240f admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:08.683617 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 874/1764] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:08.683617 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f429424-d03e-49ac-8691-238d7ec3240f admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:08.692015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f429424-d03e-49ac-8691-238d7ec3240f admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:08.705626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd9e5-987e-4e37-969d-99bcc2bdf70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:08.705626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd9e5-987e-4e37-969d-99bcc2bdf70c admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.705626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd9e5-987e-4e37-969d-99bcc2bdf70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.705626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd9e5-987e-4e37-969d-99bcc2bdf70c admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.706049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fd9e5-987e-4e37-969d-99bcc2bdf70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:08.706049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fd9e5-987e-4e37-969d-99bcc2bdf70c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:08.716891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 875/1765] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:08.716891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd9e5-987e-4e37-969d-99bcc2bdf70c admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:08.740783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd9e5-987e-4e37-969d-99bcc2bdf70c admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:08.747242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc152b65-996d-404d-a9c3-92a4f9580688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:08.750425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc152b65-996d-404d-a9c3-92a4f9580688 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.750425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc152b65-996d-404d-a9c3-92a4f9580688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.750425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc152b65-996d-404d-a9c3-92a4f9580688 admin admin] PATH_INFO: `/v3/projects/9167975331474e109654464e296c5b60/users/196a1cd9e1e142cba22b131019e7d0ef/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.766110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 891/1766] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:08 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:08.766110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8286f-2204-4e4e-bea3-34ace76128ab None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:08.769803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc152b65-996d-404d-a9c3-92a4f9580688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9167975331474e109654464e296c5b60, user_id=196a1cd9e1e142cba22b131019e7d0ef, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:08.770956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc152b65-996d-404d-a9c3-92a4f9580688 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:08.781101 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8286f-2204-4e4e-bea3-34ace76128ab None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:08.787909 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858fd0a-de7d-4002-940a-a753d6d5fd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:08.788910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858fd0a-de7d-4002-940a-a753d6d5fd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.789192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858fd0a-de7d-4002-940a-a753d6d5fd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.789470 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858fd0a-de7d-4002-940a-a753d6d5fd9b admin admin] PATH_INFO: `/v3/projects/fadba8d7c7934bbfa7ba479edcda305f/users/d6655396ca7547e68d85ff81ffb9a666/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.808023 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858fd0a-de7d-4002-940a-a753d6d5fd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fadba8d7c7934bbfa7ba479edcda305f, user_id=d6655396ca7547e68d85ff81ffb9a666, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:08.808023 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858fd0a-de7d-4002-940a-a753d6d5fd9b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:08.873705 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 876/1767] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:08 2022] PUT /identity/v3/projects/9167975331474e109654464e296c5b60/users/196a1cd9e1e142cba22b131019e7d0ef/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:08.874549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc152b65-996d-404d-a9c3-92a4f9580688 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:08.876181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-bc152b65-996d-404d-a9c3-92a4f9580688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:08.932244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc152b65-996d-404d-a9c3-92a4f9580688 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:08.936082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523ead7-3db0-4e06-a068-eaf7930e6377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:08.936752 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523ead7-3db0-4e06-a068-eaf7930e6377 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:08.937038 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523ead7-3db0-4e06-a068-eaf7930e6377 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:08.937317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523ead7-3db0-4e06-a068-eaf7930e6377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:08.972748 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 892/1768] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:08 2022] PUT /identity/v3/projects/fadba8d7c7934bbfa7ba479edcda305f/users/d6655396ca7547e68d85ff81ffb9a666/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:08.972748 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858fd0a-de7d-4002-940a-a753d6d5fd9b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:09.038201 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523ead7-3db0-4e06-a068-eaf7930e6377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:09.040953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523ead7-3db0-4e06-a068-eaf7930e6377 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:09.060241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 877/1769] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:08 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:09.070396 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ce3a4-14ce-4fdf-b4dd-fa91837af992 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:09.070396 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ce3a4-14ce-4fdf-b4dd-fa91837af992 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:09.070396 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ce3a4-14ce-4fdf-b4dd-fa91837af992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:09.077526 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858fd0a-de7d-4002-940a-a753d6d5fd9b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:09.085941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56a573-942a-4d58-97c1-ba65371d2e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:09.086632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56a573-942a-4d58-97c1-ba65371d2e17 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:09.086916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56a573-942a-4d58-97c1-ba65371d2e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:09.087198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56a573-942a-4d58-97c1-ba65371d2e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:09.087935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56a573-942a-4d58-97c1-ba65371d2e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:09.089619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56a573-942a-4d58-97c1-ba65371d2e17 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:09.117526 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 893/1770] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:09.121800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56a573-942a-4d58-97c1-ba65371d2e17 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:09.129382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-8f8ce3a4-14ce-4fdf-b4dd-fa91837af992 None None] MFA Rules not processed for user `d6655396ca7547e68d85ff81ffb9a666`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:09.131865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8f8ce3a4-14ce-4fdf-b4dd-fa91837af992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:09.137722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56a573-942a-4d58-97c1-ba65371d2e17 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:09.150302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8217f-42d9-451b-936a-90fdfbaa6dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:09.151018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8217f-42d9-451b-936a-90fdfbaa6dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:09.151316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8217f-42d9-451b-936a-90fdfbaa6dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:09.151605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8217f-42d9-451b-936a-90fdfbaa6dc3 admin admin] PATH_INFO: `/v3/projects/9167975331474e109654464e296c5b60/users/196a1cd9e1e142cba22b131019e7d0ef/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:09.164408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8217f-42d9-451b-936a-90fdfbaa6dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9167975331474e109654464e296c5b60, user_id=196a1cd9e1e142cba22b131019e7d0ef, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:09.164408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8217f-42d9-451b-936a-90fdfbaa6dc3 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:09.227453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 894/1771] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:09 2022] PUT /identity/v3/projects/9167975331474e109654464e296c5b60/users/196a1cd9e1e142cba22b131019e7d0ef/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:09.240073 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f307e-2dc3-4d3c-a310-5363a40182ea None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:09.240832 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f307e-2dc3-4d3c-a310-5363a40182ea None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:09.242872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f307e-2dc3-4d3c-a310-5363a40182ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:09.285128 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-4d7f307e-2dc3-4d3c-a310-5363a40182ea None None] MFA Rules not processed for user `196a1cd9e1e142cba22b131019e7d0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:09.286402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4d7f307e-2dc3-4d3c-a310-5363a40182ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:09.327637 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 878/1772] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:09.339309 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ce3a4-14ce-4fdf-b4dd-fa91837af992 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:09.350832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ce3a4-14ce-4fdf-b4dd-fa91837af992 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:09.398047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 895/1773] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:09.399024 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f307e-2dc3-4d3c-a310-5363a40182ea None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:09.431245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f53481-ea07-4728-9f2b-525c5bbbb611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:09.431949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f53481-ea07-4728-9f2b-525c5bbbb611 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:09.432253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f53481-ea07-4728-9f2b-525c5bbbb611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:09.432707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f53481-ea07-4728-9f2b-525c5bbbb611 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:09.433260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f53481-ea07-4728-9f2b-525c5bbbb611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:09.435166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f53481-ea07-4728-9f2b-525c5bbbb611 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:09.472772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f307e-2dc3-4d3c-a310-5363a40182ea None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:09.477641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b03e0-4f5f-4dbb-808e-b2d86b74e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:09.478668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b03e0-4f5f-4dbb-808e-b2d86b74e118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:09.479017 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b03e0-4f5f-4dbb-808e-b2d86b74e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:09.479366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b03e0-4f5f-4dbb-808e-b2d86b74e118 admin admin] PATH_INFO: `/v3/users/9888620c377a4b7f852ad37a1dbadbaa` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:09.480811 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b03e0-4f5f-4dbb-808e-b2d86b74e118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9888620c377a4b7f852ad37a1dbadbaa)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:09.482864 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b03e0-4f5f-4dbb-808e-b2d86b74e118 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:09.803689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 879/1774] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:09 2022] POST /identity/v3/projects => generated 371 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:09.803689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f53481-ea07-4728-9f2b-525c5bbbb611 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:09.879040 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f53481-ea07-4728-9f2b-525c5bbbb611 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:09.886796 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802b6d9-3034-459a-9ee1-d95eb858532c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:09.904635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802b6d9-3034-459a-9ee1-d95eb858532c service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:09.904635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802b6d9-3034-459a-9ee1-d95eb858532c service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:09.904635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802b6d9-3034-459a-9ee1-d95eb858532c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:09.951396 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9a9b03e0-4f5f-4dbb-808e-b2d86b74e118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9888620c377a4b7f852ad37a1dbadbaa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:09.952185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9a9b03e0-4f5f-4dbb-808e-b2d86b74e118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9888620c377a4b7f852ad37a1dbadbaa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:09.981667 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802b6d9-3034-459a-9ee1-d95eb858532c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:09.984850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802b6d9-3034-459a-9ee1-d95eb858532c service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:09.995050 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 880/1775] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:09.996293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802b6d9-3034-459a-9ee1-d95eb858532c service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:10.034042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9a9b03e0-4f5f-4dbb-808e-b2d86b74e118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9888620c377a4b7f852ad37a1dbadbaa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:10.035600 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9a9b03e0-4f5f-4dbb-808e-b2d86b74e118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9888620c377a4b7f852ad37a1dbadbaa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:10.052378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9a9b03e0-4f5f-4dbb-808e-b2d86b74e118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9888620c377a4b7f852ad37a1dbadbaa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:10.088788 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802b6d9-3034-459a-9ee1-d95eb858532c service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:10.098507 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d0e2b-6d22-4ddb-8fea-1774a8d17267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:10.099198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d0e2b-6d22-4ddb-8fea-1774a8d17267 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:10.099498 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d0e2b-6d22-4ddb-8fea-1774a8d17267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:10.099761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d0e2b-6d22-4ddb-8fea-1774a8d17267 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:10.100496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d0e2b-6d22-4ddb-8fea-1774a8d17267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:10.102450 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d0e2b-6d22-4ddb-8fea-1774a8d17267 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:10.103972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 896/1776] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:09 2022] DELETE /identity/v3/users/9888620c377a4b7f852ad37a1dbadbaa => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:10.210799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e959c-03c7-46b3-bafe-f77637568321 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:10.210799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e959c-03c7-46b3-bafe-f77637568321 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:10.210799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e959c-03c7-46b3-bafe-f77637568321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:10.210799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-900e959c-03c7-46b3-bafe-f77637568321 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:10.210799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-900e959c-03c7-46b3-bafe-f77637568321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:10.221371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 897/1777] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:10.232759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e959c-03c7-46b3-bafe-f77637568321 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:10.235097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-900e959c-03c7-46b3-bafe-f77637568321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:10.320378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e959c-03c7-46b3-bafe-f77637568321 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:10.324650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae5b94-a33c-4182-8a64-c4474efb247f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:10.325309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae5b94-a33c-4182-8a64-c4474efb247f service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:10.325595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae5b94-a33c-4182-8a64-c4474efb247f service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:10.325875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae5b94-a33c-4182-8a64-c4474efb247f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:10.340692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae5b94-a33c-4182-8a64-c4474efb247f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:10.342804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae5b94-a33c-4182-8a64-c4474efb247f service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:10.375831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 898/1778] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:10.655700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 881/1779] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:09 2022] POST /identity/v3/users => generated 292 bytes in 660 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:10.660424 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae5b94-a33c-4182-8a64-c4474efb247f service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:10.661922 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b1ae5b94-a33c-4182-8a64-c4474efb247f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:10.676698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae5b94-a33c-4182-8a64-c4474efb247f service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:10.682241 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb91ae8-c829-44c3-b0b1-d2a4f31a7d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:10.683096 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb91ae8-c829-44c3-b0b1-d2a4f31a7d20 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:10.683483 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb91ae8-c829-44c3-b0b1-d2a4f31a7d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:10.683827 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb91ae8-c829-44c3-b0b1-d2a4f31a7d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:10.684653 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb91ae8-c829-44c3-b0b1-d2a4f31a7d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:10.686862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb91ae8-c829-44c3-b0b1-d2a4f31a7d20 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:10.702559 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 899/1780] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:10.703668 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d0e2b-6d22-4ddb-8fea-1774a8d17267 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:10.717967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d0e2b-6d22-4ddb-8fea-1774a8d17267 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:10.725186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307548b-15ad-42a1-b4e3-8d47f96f5be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:10.726409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307548b-15ad-42a1-b4e3-8d47f96f5be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:10.726685 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307548b-15ad-42a1-b4e3-8d47f96f5be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:10.726968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307548b-15ad-42a1-b4e3-8d47f96f5be1 admin admin] PATH_INFO: `/v3/projects/c0a59855787840a3a99707b54545954e/users/e832c254993848c1beb8f4116647af3f/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:10.747497 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307548b-15ad-42a1-b4e3-8d47f96f5be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a59855787840a3a99707b54545954e, user_id=e832c254993848c1beb8f4116647af3f, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:10.752648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307548b-15ad-42a1-b4e3-8d47f96f5be1 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:10.893360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb91ae8-c829-44c3-b0b1-d2a4f31a7d20 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:10.893917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 882/1781] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:10 2022] PUT /identity/v3/projects/c0a59855787840a3a99707b54545954e/users/e832c254993848c1beb8f4116647af3f/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:10.907029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb91ae8-c829-44c3-b0b1-d2a4f31a7d20 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:11.030156 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f6d0d-be92-4b6d-bf26-72ed1bb64a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:11.030827 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6d0d-be92-4b6d-bf26-72ed1bb64a37 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:11.031108 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6d0d-be92-4b6d-bf26-72ed1bb64a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:11.031485 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6d0d-be92-4b6d-bf26-72ed1bb64a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:11.032303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f6d0d-be92-4b6d-bf26-72ed1bb64a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:11.034949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f6d0d-be92-4b6d-bf26-72ed1bb64a37 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:11.057782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307548b-15ad-42a1-b4e3-8d47f96f5be1 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:11.069433 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307548b-15ad-42a1-b4e3-8d47f96f5be1 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:11.073216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 900/1782] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:11.077753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4478af-7cc8-4397-9476-0be04d2e9655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:11.078681 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4478af-7cc8-4397-9476-0be04d2e9655 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:11.078957 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4478af-7cc8-4397-9476-0be04d2e9655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:11.079237 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4478af-7cc8-4397-9476-0be04d2e9655 admin admin] PATH_INFO: `/v3/projects/c0a59855787840a3a99707b54545954e/users/e832c254993848c1beb8f4116647af3f/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:11.082943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4478af-7cc8-4397-9476-0be04d2e9655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a59855787840a3a99707b54545954e, user_id=e832c254993848c1beb8f4116647af3f, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:11.102441 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4478af-7cc8-4397-9476-0be04d2e9655 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:11.133975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 883/1783] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:11 2022] PUT /identity/v3/projects/c0a59855787840a3a99707b54545954e/users/e832c254993848c1beb8f4116647af3f/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:11.146699 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd940-6070-4383-8fc1-3fc0a2214402 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:11.147263 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd940-6070-4383-8fc1-3fc0a2214402 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:11.147835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd940-6070-4383-8fc1-3fc0a2214402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:11.184489 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a56bd940-6070-4383-8fc1-3fc0a2214402 None None] MFA Rules not processed for user `e832c254993848c1beb8f4116647af3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:11.185813 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a56bd940-6070-4383-8fc1-3fc0a2214402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:11.241088 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4478af-7cc8-4397-9476-0be04d2e9655 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:11.243623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-bd4478af-7cc8-4397-9476-0be04d2e9655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:11.291167 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 901/1784] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:11.345805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4478af-7cc8-4397-9476-0be04d2e9655 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:11.352046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:11.353401 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:11.353941 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:11.354491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] PATH_INFO: `/v3/projects/7a8f040966f642e8b57caf76bfcd7383` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:11.356195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8f040966f642e8b57caf76bfcd7383)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:11.358677 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:11.638462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8f040966f642e8b57caf76bfcd7383', 'request_id': 'req-e0e2829f-a2db-4b13-a432-1ed032e47c28'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:11.647267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8f040966f642e8b57caf76bfcd7383', 'request_id': 'req-e0e2829f-a2db-4b13-a432-1ed032e47c28'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:11.654096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8f040966f642e8b57caf76bfcd7383', 'request_id': 'req-e0e2829f-a2db-4b13-a432-1ed032e47c28'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:11.788494 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] The token cache is being invalidate because project 7a8f040966f642e8b57caf76bfcd7383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:11.789154 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:11.789451 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:11.795318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 884/1785] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:11 2022] DELETE /identity/v3/projects/7a8f040966f642e8b57caf76bfcd7383 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:11.804253 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd940-6070-4383-8fc1-3fc0a2214402 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:11.817615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd940-6070-4383-8fc1-3fc0a2214402 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:11.881571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:11.882448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:11.882951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:11.883302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] PATH_INFO: `/v3/users/a43631f63b594a079f4db4261f43873f` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:11.883868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:11.884487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43631f63b594a079f4db4261f43873f)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:11.885527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:11.886428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:11.963378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2829f-a2db-4b13-a432-1ed032e47c28 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:11.968772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0e91-42df-4f53-9b97-1aa6da88e160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:11.969541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0e91-42df-4f53-9b97-1aa6da88e160 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:11.969899 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0e91-42df-4f53-9b97-1aa6da88e160 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:11.971407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d0e91-42df-4f53-9b97-1aa6da88e160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:11.976220 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-700d0e91-42df-4f53-9b97-1aa6da88e160 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:12.043415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d0e91-42df-4f53-9b97-1aa6da88e160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:12.045110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d0e91-42df-4f53-9b97-1aa6da88e160 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:12.117516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 885/1786] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:39:12.570916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43631f63b594a079f4db4261f43873f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:12.572014 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43631f63b594a079f4db4261f43873f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:12.630711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0e91-42df-4f53-9b97-1aa6da88e160 service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:12.632089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-700d0e91-42df-4f53-9b97-1aa6da88e160 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:12.647926 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43631f63b594a079f4db4261f43873f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:12.653656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43631f63b594a079f4db4261f43873f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:12.672361 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43631f63b594a079f4db4261f43873f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:12.692457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 902/1787] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:11 2022] DELETE /identity/v3/users/a43631f63b594a079f4db4261f43873f => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:12.749775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:12.751440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:12.787281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d0e91-42df-4f53-9b97-1aa6da88e160 service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:12.885614 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da200882-0d78-4a57-8d18-452db261584c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:12.890733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f3f2f-d187-4e98-8436-98672f05b8e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:12.891637 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f3f2f-d187-4e98-8436-98672f05b8e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:12.892078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f3f2f-d187-4e98-8436-98672f05b8e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:12.896616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f3f2f-d187-4e98-8436-98672f05b8e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:12.899286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-da3f3f2f-d187-4e98-8436-98672f05b8e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:12.900382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bd6b-494a-4ff7-aa8e-0318134bac5e tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196a1cd9e1e142cba22b131019e7d0ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9167975331474e109654464e296c5b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:12.901093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bd6b-494a-4ff7-aa8e-0318134bac5e tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:12.905443 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bd6b-494a-4ff7-aa8e-0318134bac5e tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:12.905443 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bd6b-494a-4ff7-aa8e-0318134bac5e tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:12.905443 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359bd6b-494a-4ff7-aa8e-0318134bac5e tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:12.905443 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359bd6b-494a-4ff7-aa8e-0318134bac5e tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:12.905443 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359bd6b-494a-4ff7-aa8e-0318134bac5e tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:12.929831 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 886/1788] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:39:12.930819 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bd6b-494a-4ff7-aa8e-0318134bac5e tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:12.932641 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a359bd6b-494a-4ff7-aa8e-0318134bac5e tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:12.986387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bd6b-494a-4ff7-aa8e-0318134bac5e tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:13.008236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca5705-8e40-4587-81a8-96eb0106b636 tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196a1cd9e1e142cba22b131019e7d0ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9167975331474e109654464e296c5b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:13.014205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5705-8e40-4587-81a8-96eb0106b636 tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:13.014205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5705-8e40-4587-81a8-96eb0106b636 tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:13.014205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5705-8e40-4587-81a8-96eb0106b636 tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:13.014205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca5705-8e40-4587-81a8-96eb0106b636 tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:13.014205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca5705-8e40-4587-81a8-96eb0106b636 tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:13.028179 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f3f2f-d187-4e98-8436-98672f05b8e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:13.029746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f3f2f-d187-4e98-8436-98672f05b8e5 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:13.060125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 903/1789] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:13.141380 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 887/1790] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:12 2022] POST /identity/v3/projects => generated 354 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:13.146055 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f3f2f-d187-4e98-8436-98672f05b8e5 service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:13.158592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f3f2f-d187-4e98-8436-98672f05b8e5 service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:13.233015 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c36ec-11f9-4af3-b243-36bef838c4ec tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196a1cd9e1e142cba22b131019e7d0ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9167975331474e109654464e296c5b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:13.233989 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c36ec-11f9-4af3-b243-36bef838c4ec tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:13.234288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c36ec-11f9-4af3-b243-36bef838c4ec tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:13.235060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c36ec-11f9-4af3-b243-36bef838c4ec tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:13.245713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c36ec-11f9-4af3-b243-36bef838c4ec tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:13.246172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c36ec-11f9-4af3-b243-36bef838c4ec tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:13.247853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c36ec-11f9-4af3-b243-36bef838c4ec tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:13.268941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 904/1791] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:13.314517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca5705-8e40-4587-81a8-96eb0106b636 tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:13.328459 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca5705-8e40-4587-81a8-96eb0106b636 tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:13.335720 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85ec02-6445-450c-a20b-986080b95ceb tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '196a1cd9e1e142cba22b131019e7d0ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9167975331474e109654464e296c5b60', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:13.340191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85ec02-6445-450c-a20b-986080b95ceb tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:13.340191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85ec02-6445-450c-a20b-986080b95ceb tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:13.340191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85ec02-6445-450c-a20b-986080b95ceb tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] PATH_INFO: `/v3/projects/df808fb9177844d2b2f7ee72acb6b7d9` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:13.340191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85ec02-6445-450c-a20b-986080b95ceb tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: Authorizing `identity:delete_project(project_id=df808fb9177844d2b2f7ee72acb6b7d9)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:13.340713 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85ec02-6445-450c-a20b-986080b95ceb tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:13.513619 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9c85ec02-6445-450c-a20b-986080b95ceb tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df808fb9177844d2b2f7ee72acb6b7d9', 'request_id': 'req-9c85ec02-6445-450c-a20b-986080b95ceb'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:13.519438 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9c85ec02-6445-450c-a20b-986080b95ceb tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df808fb9177844d2b2f7ee72acb6b7d9', 'request_id': 'req-9c85ec02-6445-450c-a20b-986080b95ceb'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:13.525429 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9c85ec02-6445-450c-a20b-986080b95ceb tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df808fb9177844d2b2f7ee72acb6b7d9', 'request_id': 'req-9c85ec02-6445-450c-a20b-986080b95ceb'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:13.547599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c36ec-11f9-4af3-b243-36bef838c4ec tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:13.549571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a50c36ec-11f9-4af3-b243-36bef838c4ec tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:13.636106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9c85ec02-6445-450c-a20b-986080b95ceb tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] The token cache is being invalidate because project df808fb9177844d2b2f7ee72acb6b7d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:13.636665 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9c85ec02-6445-450c-a20b-986080b95ceb tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:13.637461 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9c85ec02-6445-450c-a20b-986080b95ceb tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:13.641906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 888/1792] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:13 2022] DELETE /identity/v3/projects/df808fb9177844d2b2f7ee72acb6b7d9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:13.647865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c36ec-11f9-4af3-b243-36bef838c4ec tempest-VolumeQuotaClassesTest-1378862414 tempest-VolumeQuotaClassesTest-1378862414-project-admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:13.707402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416398b-e2ff-4e68-8a18-b241dd3c2126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:13.708363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416398b-e2ff-4e68-8a18-b241dd3c2126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:13.708650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416398b-e2ff-4e68-8a18-b241dd3c2126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:13.708934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416398b-e2ff-4e68-8a18-b241dd3c2126 admin admin] PATH_INFO: `/v3/projects/994005db41b54a31a3d18a4fb5c617b6` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:13.710121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416398b-e2ff-4e68-8a18-b241dd3c2126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=994005db41b54a31a3d18a4fb5c617b6)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:13.712059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416398b-e2ff-4e68-8a18-b241dd3c2126 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:13.830795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0416398b-e2ff-4e68-8a18-b241dd3c2126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '994005db41b54a31a3d18a4fb5c617b6', 'request_id': 'req-0416398b-e2ff-4e68-8a18-b241dd3c2126'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:13.835982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0416398b-e2ff-4e68-8a18-b241dd3c2126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '994005db41b54a31a3d18a4fb5c617b6', 'request_id': 'req-0416398b-e2ff-4e68-8a18-b241dd3c2126'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:13.929735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0416398b-e2ff-4e68-8a18-b241dd3c2126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '994005db41b54a31a3d18a4fb5c617b6', 'request_id': 'req-0416398b-e2ff-4e68-8a18-b241dd3c2126'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:13.941759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0416398b-e2ff-4e68-8a18-b241dd3c2126 admin admin] The token cache is being invalidate because project 994005db41b54a31a3d18a4fb5c617b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:13.942050 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0416398b-e2ff-4e68-8a18-b241dd3c2126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:13.942673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0416398b-e2ff-4e68-8a18-b241dd3c2126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:13.944262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 905/1793] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:13 2022] DELETE /identity/v3/projects/994005db41b54a31a3d18a4fb5c617b6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:13.949207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc23be-876c-4ad3-b881-c6413bdc85b2 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:13.949693 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc23be-876c-4ad3-b881-c6413bdc85b2 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:13.949790 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc23be-876c-4ad3-b881-c6413bdc85b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:13.967753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b6fc23be-876c-4ad3-b881-c6413bdc85b2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:13.968988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b6fc23be-876c-4ad3-b881-c6413bdc85b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:14.025380 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 889/1794] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:14.033005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f668511-8326-4de9-b2ab-934457f9a4c3 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.033249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f668511-8326-4de9-b2ab-934457f9a4c3 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.033530 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f668511-8326-4de9-b2ab-934457f9a4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.053454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-8f668511-8326-4de9-b2ab-934457f9a4c3 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:14.054660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8f668511-8326-4de9-b2ab-934457f9a4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:14.063338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 906/1795] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:14.068080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc23be-876c-4ad3-b881-c6413bdc85b2 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:14.078437 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc23be-876c-4ad3-b881-c6413bdc85b2 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:14.083275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b5219-b938-48aa-95de-a58da8ec933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:14.083822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b5219-b938-48aa-95de-a58da8ec933a admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.084105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b5219-b938-48aa-95de-a58da8ec933a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.084412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b5219-b938-48aa-95de-a58da8ec933a admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.085136 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b5219-b938-48aa-95de-a58da8ec933a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:14.085441 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b5219-b938-48aa-95de-a58da8ec933a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:14.087108 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b5219-b938-48aa-95de-a58da8ec933a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:14.099384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 890/1796] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:14.103963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f668511-8326-4de9-b2ab-934457f9a4c3 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:14.115731 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f668511-8326-4de9-b2ab-934457f9a4c3 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:14.120547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3b0bb-0893-4ccc-bb6f-ee33baf79a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:14.121212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3b0bb-0893-4ccc-bb6f-ee33baf79a72 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.121494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3b0bb-0893-4ccc-bb6f-ee33baf79a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.121766 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3b0bb-0893-4ccc-bb6f-ee33baf79a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.122463 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3b0bb-0893-4ccc-bb6f-ee33baf79a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:14.124455 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3b0bb-0893-4ccc-bb6f-ee33baf79a72 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:14.229549 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 907/1797] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:14 2022] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:14.233763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b5219-b938-48aa-95de-a58da8ec933a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:14.244192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b5219-b938-48aa-95de-a58da8ec933a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:14.297608 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d4b84-f103-4933-935c-c454f7863e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:14.298247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d4b84-f103-4933-935c-c454f7863e40 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.299102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d4b84-f103-4933-935c-c454f7863e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.299628 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d4b84-f103-4933-935c-c454f7863e40 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.300354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d4b84-f103-4933-935c-c454f7863e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:14.302254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d4b84-f103-4933-935c-c454f7863e40 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:14.324394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3b0bb-0893-4ccc-bb6f-ee33baf79a72 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:14.326076 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-53b3b0bb-0893-4ccc-bb6f-ee33baf79a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:14.338254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3b0bb-0893-4ccc-bb6f-ee33baf79a72 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:14.342796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3859b-35f0-4b96-b059-508eb1a493d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:14.343640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3859b-35f0-4b96-b059-508eb1a493d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.343928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3859b-35f0-4b96-b059-508eb1a493d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.344262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3859b-35f0-4b96-b059-508eb1a493d6 admin admin] PATH_INFO: `/v3/users/75244b948278427798481c9d70c44ea1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.345967 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3859b-35f0-4b96-b059-508eb1a493d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75244b948278427798481c9d70c44ea1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:14.347876 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3859b-35f0-4b96-b059-508eb1a493d6 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:14.390954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 891/1798] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:14 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:14.392176 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d4b84-f103-4933-935c-c454f7863e40 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:14.401975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d4b84-f103-4933-935c-c454f7863e40 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:14.406630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd70de7-6206-4d05-928e-91d4b6b18d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:14.407285 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd70de7-6206-4d05-928e-91d4b6b18d0b admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.407568 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd70de7-6206-4d05-928e-91d4b6b18d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.408388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd70de7-6206-4d05-928e-91d4b6b18d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.409349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd70de7-6206-4d05-928e-91d4b6b18d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:14.410956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd70de7-6206-4d05-928e-91d4b6b18d0b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:14.421935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 892/1799] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:14.426415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd70de7-6206-4d05-928e-91d4b6b18d0b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:14.435920 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd70de7-6206-4d05-928e-91d4b6b18d0b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:14.440823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9adbc-0cfe-46f4-b020-8ce24a5b1b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:14.441465 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9adbc-0cfe-46f4-b020-8ce24a5b1b38 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.441749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9adbc-0cfe-46f4-b020-8ce24a5b1b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.442065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9adbc-0cfe-46f4-b020-8ce24a5b1b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.442777 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9adbc-0cfe-46f4-b020-8ce24a5b1b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:14.444506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9adbc-0cfe-46f4-b020-8ce24a5b1b38 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:14.455793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 893/1800] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:14.468981 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9adbc-0cfe-46f4-b020-8ce24a5b1b38 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:14.479704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9adbc-0cfe-46f4-b020-8ce24a5b1b38 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:14.484389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baf418-9cf6-466c-8f38-2948231950eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:14.485262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf418-9cf6-466c-8f38-2948231950eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.485539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf418-9cf6-466c-8f38-2948231950eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.485814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baf418-9cf6-466c-8f38-2948231950eb admin admin] PATH_INFO: `/v3/projects/0cdc45aa917a4394a6fb19e69c7369b0/users/fb083396ec184fca9ea04a217b3d7564/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.499949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baf418-9cf6-466c-8f38-2948231950eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdc45aa917a4394a6fb19e69c7369b0, user_id=fb083396ec184fca9ea04a217b3d7564, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:14.506930 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baf418-9cf6-466c-8f38-2948231950eb admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:14.589199 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-00b3859b-35f0-4b96-b059-508eb1a493d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75244b948278427798481c9d70c44ea1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:14.589786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-00b3859b-35f0-4b96-b059-508eb1a493d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75244b948278427798481c9d70c44ea1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:14.614916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 894/1801] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:14 2022] PUT /identity/v3/projects/0cdc45aa917a4394a6fb19e69c7369b0/users/fb083396ec184fca9ea04a217b3d7564/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:14.628961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df805b8-96e8-4a57-b1b8-4021cc30baed None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.629257 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df805b8-96e8-4a57-b1b8-4021cc30baed None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.629653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df805b8-96e8-4a57-b1b8-4021cc30baed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.656891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-4df805b8-96e8-4a57-b1b8-4021cc30baed None None] MFA Rules not processed for user `fb083396ec184fca9ea04a217b3d7564`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:14.658727 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4df805b8-96e8-4a57-b1b8-4021cc30baed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:14.661598 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-00b3859b-35f0-4b96-b059-508eb1a493d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75244b948278427798481c9d70c44ea1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:14.662318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-00b3859b-35f0-4b96-b059-508eb1a493d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75244b948278427798481c9d70c44ea1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:14.675124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-00b3859b-35f0-4b96-b059-508eb1a493d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75244b948278427798481c9d70c44ea1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:14.687150 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 908/1802] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:14 2022] DELETE /identity/v3/users/75244b948278427798481c9d70c44ea1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:14.696387 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c66c3-4353-46b1-919c-cc1b6085b5cd None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.696685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c66c3-4353-46b1-919c-cc1b6085b5cd None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.697020 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c66c3-4353-46b1-919c-cc1b6085b5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.716463 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-095c66c3-4353-46b1-919c-cc1b6085b5cd None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:14.718320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-095c66c3-4353-46b1-919c-cc1b6085b5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:14.729416 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 895/1803] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:14.730464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df805b8-96e8-4a57-b1b8-4021cc30baed None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:14.732188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4df805b8-96e8-4a57-b1b8-4021cc30baed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:14.783398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 909/1804] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:14.806088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c66c3-4353-46b1-919c-cc1b6085b5cd None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:14.806365 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df805b8-96e8-4a57-b1b8-4021cc30baed None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:14.807549 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-095c66c3-4353-46b1-919c-cc1b6085b5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:14.811047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadc7b7-33c1-4809-83d5-25537c625036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:14.811720 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadc7b7-33c1-4809-83d5-25537c625036 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.812082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadc7b7-33c1-4809-83d5-25537c625036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.812397 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadc7b7-33c1-4809-83d5-25537c625036 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.813089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadc7b7-33c1-4809-83d5-25537c625036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:14.815591 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadc7b7-33c1-4809-83d5-25537c625036 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:14.864739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c66c3-4353-46b1-919c-cc1b6085b5cd None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:14.868666 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075fa5e-ab03-4e42-9629-4fb4e69019f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:14.872517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075fa5e-ab03-4e42-9629-4fb4e69019f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.872517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075fa5e-ab03-4e42-9629-4fb4e69019f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.872517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075fa5e-ab03-4e42-9629-4fb4e69019f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.879478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075fa5e-ab03-4e42-9629-4fb4e69019f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:14.880934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075fa5e-ab03-4e42-9629-4fb4e69019f1 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:14.890076 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 910/1805] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:39:14.901066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 896/1806] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:14 2022] POST /identity/v3/projects => generated 389 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:14.905364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075fa5e-ab03-4e42-9629-4fb4e69019f1 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:14.915160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075fa5e-ab03-4e42-9629-4fb4e69019f1 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:14.969798 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5981ab-5089-43cb-bfa3-2ea26d84cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:14.970496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5981ab-5089-43cb-bfa3-2ea26d84cc5d admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:14.970774 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5981ab-5089-43cb-bfa3-2ea26d84cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:14.971049 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5981ab-5089-43cb-bfa3-2ea26d84cc5d admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:14.971741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5981ab-5089-43cb-bfa3-2ea26d84cc5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:14.973808 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5981ab-5089-43cb-bfa3-2ea26d84cc5d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:15.088003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 911/1807] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:14 2022] POST /identity/v3/users => generated 301 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:15.089113 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadc7b7-33c1-4809-83d5-25537c625036 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:15.104317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadc7b7-33c1-4809-83d5-25537c625036 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:15.109612 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3120c-2fcd-4804-900b-1364d8dd6740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:15.110252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3120c-2fcd-4804-900b-1364d8dd6740 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:15.110645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3120c-2fcd-4804-900b-1364d8dd6740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:15.111052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3120c-2fcd-4804-900b-1364d8dd6740 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:15.111905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3120c-2fcd-4804-900b-1364d8dd6740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:15.113648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3120c-2fcd-4804-900b-1364d8dd6740 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:15.128243 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 897/1808] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:15.129415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5981ab-5089-43cb-bfa3-2ea26d84cc5d admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:15.144399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5981ab-5089-43cb-bfa3-2ea26d84cc5d admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:15.149094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5d9fb-6eb1-4b2f-aaa8-412ae5e1e447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:15.150050 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5d9fb-6eb1-4b2f-aaa8-412ae5e1e447 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:15.150433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5d9fb-6eb1-4b2f-aaa8-412ae5e1e447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:15.151241 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5d9fb-6eb1-4b2f-aaa8-412ae5e1e447 admin admin] PATH_INFO: `/v3/projects/ef5d6051715c458cb84ac188825728e9/users/6b189cac441f4e30a6df113dcf3baaba/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:15.168475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5d9fb-6eb1-4b2f-aaa8-412ae5e1e447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5d6051715c458cb84ac188825728e9, user_id=6b189cac441f4e30a6df113dcf3baaba, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:15.171150 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5d9fb-6eb1-4b2f-aaa8-412ae5e1e447 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:15.276929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 912/1809] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:15 2022] PUT /identity/v3/projects/ef5d6051715c458cb84ac188825728e9/users/6b189cac441f4e30a6df113dcf3baaba/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:15.281105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3120c-2fcd-4804-900b-1364d8dd6740 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:15.291136 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3120c-2fcd-4804-900b-1364d8dd6740 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:15.311889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5d9fb-6eb1-4b2f-aaa8-412ae5e1e447 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:15.313801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-28f5d9fb-6eb1-4b2f-aaa8-412ae5e1e447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:15.358905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3242d-245a-4cc5-bdee-01c2e395c07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:15.360009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3242d-245a-4cc5-bdee-01c2e395c07a admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:15.360009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3242d-245a-4cc5-bdee-01c2e395c07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:15.366936 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3242d-245a-4cc5-bdee-01c2e395c07a admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:15.366936 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3242d-245a-4cc5-bdee-01c2e395c07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:15.366936 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3242d-245a-4cc5-bdee-01c2e395c07a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:15.376221 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 898/1810] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:15.378237 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3242d-245a-4cc5-bdee-01c2e395c07a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:15.389164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3242d-245a-4cc5-bdee-01c2e395c07a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:15.394335 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf283d7-20ce-49c5-96d9-1740ab5e8481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:15.395312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf283d7-20ce-49c5-96d9-1740ab5e8481 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:15.395672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf283d7-20ce-49c5-96d9-1740ab5e8481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:15.396028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf283d7-20ce-49c5-96d9-1740ab5e8481 admin admin] PATH_INFO: `/v3/projects/ef5d6051715c458cb84ac188825728e9/users/6b189cac441f4e30a6df113dcf3baaba/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:15.398178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf283d7-20ce-49c5-96d9-1740ab5e8481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5d6051715c458cb84ac188825728e9, user_id=6b189cac441f4e30a6df113dcf3baaba, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:15.400872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf283d7-20ce-49c5-96d9-1740ab5e8481 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:15.407956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5d9fb-6eb1-4b2f-aaa8-412ae5e1e447 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:15.412085 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:15.412981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:15.413291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:15.413571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] PATH_INFO: `/v3/projects/27cec17880eb49589a90e5b3773e8950` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:15.418334 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 899/1811] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:15 2022] PUT /identity/v3/projects/ef5d6051715c458cb84ac188825728e9/users/6b189cac441f4e30a6df113dcf3baaba/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:15.418480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27cec17880eb49589a90e5b3773e8950)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:15.418480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:15.424023 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f0968-68e5-4a32-8c88-6256084c76dd None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:15.424343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f0968-68e5-4a32-8c88-6256084c76dd None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:15.424622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f0968-68e5-4a32-8c88-6256084c76dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:15.452730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7f1f0968-68e5-4a32-8c88-6256084c76dd None None] MFA Rules not processed for user `6b189cac441f4e30a6df113dcf3baaba`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:15.453929 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7f1f0968-68e5-4a32-8c88-6256084c76dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:15.531486 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27cec17880eb49589a90e5b3773e8950', 'request_id': 'req-48f0fce3-0a07-4557-9149-1fb1fe2fc065'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:15.538322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27cec17880eb49589a90e5b3773e8950', 'request_id': 'req-48f0fce3-0a07-4557-9149-1fb1fe2fc065'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:15.548331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 900/1812] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:15.558176 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f0968-68e5-4a32-8c88-6256084c76dd None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:15.559914 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7f1f0968-68e5-4a32-8c88-6256084c76dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:15.619253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f0968-68e5-4a32-8c88-6256084c76dd None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:15.670517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd8839-17ce-496d-b305-f2d8d3e21a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:15.671232 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd8839-17ce-496d-b305-f2d8d3e21a8f service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:15.671579 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd8839-17ce-496d-b305-f2d8d3e21a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:15.671916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd8839-17ce-496d-b305-f2d8d3e21a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:15.677442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27cec17880eb49589a90e5b3773e8950', 'request_id': 'req-48f0fce3-0a07-4557-9149-1fb1fe2fc065'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:15.697025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] The token cache is being invalidate because project 27cec17880eb49589a90e5b3773e8950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:15.697457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:15.699497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:15.702932 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 913/1813] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:15 2022] DELETE /identity/v3/projects/27cec17880eb49589a90e5b3773e8950 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:15.708311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:15.712198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:15.774889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd8839-17ce-496d-b305-f2d8d3e21a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:15.776499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd8839-17ce-496d-b305-f2d8d3e21a8f service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:15.786945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0fce3-0a07-4557-9149-1fb1fe2fc065 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:15.793717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd65df-79c4-4285-9570-b1bef979bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:15.794603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd65df-79c4-4285-9570-b1bef979bc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:15.794890 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd65df-79c4-4285-9570-b1bef979bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:15.795169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd65df-79c4-4285-9570-b1bef979bc8f admin admin] PATH_INFO: `/v3/users/196a1cd9e1e142cba22b131019e7d0ef` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:15.796533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd65df-79c4-4285-9570-b1bef979bc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=196a1cd9e1e142cba22b131019e7d0ef)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:15.798006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 901/1814] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:39:15.798662 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd65df-79c4-4285-9570-b1bef979bc8f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:15.937220 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd8839-17ce-496d-b305-f2d8d3e21a8f service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:15.948184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd8839-17ce-496d-b305-f2d8d3e21a8f service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:15.953196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:15.959908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:15.959908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:15.959908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] PATH_INFO: `/v3/users/fb083396ec184fca9ea04a217b3d7564` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:15.959908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb083396ec184fca9ea04a217b3d7564)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:15.959908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:16.113374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-92fd65df-79c4-4285-9570-b1bef979bc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196a1cd9e1e142cba22b131019e7d0ef'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:16.114038 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-92fd65df-79c4-4285-9570-b1bef979bc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196a1cd9e1e142cba22b131019e7d0ef'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:16.221606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-92fd65df-79c4-4285-9570-b1bef979bc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196a1cd9e1e142cba22b131019e7d0ef'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:16.222242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-92fd65df-79c4-4285-9570-b1bef979bc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196a1cd9e1e142cba22b131019e7d0ef'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:16.243391 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-92fd65df-79c4-4285-9570-b1bef979bc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196a1cd9e1e142cba22b131019e7d0ef'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:16.246058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb083396ec184fca9ea04a217b3d7564'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:16.254970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 914/1815] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:15 2022] DELETE /identity/v3/users/196a1cd9e1e142cba22b131019e7d0ef => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:16.325179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb083396ec184fca9ea04a217b3d7564'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:16.343743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb083396ec184fca9ea04a217b3d7564'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:16.344560 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb083396ec184fca9ea04a217b3d7564'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:16.353318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb083396ec184fca9ea04a217b3d7564'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:16.361705 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 902/1816] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:15 2022] DELETE /identity/v3/users/fb083396ec184fca9ea04a217b3d7564 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:16.366357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a7c31-0a56-4b9f-9676-625ac8d6d619 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:16.366855 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a7c31-0a56-4b9f-9676-625ac8d6d619 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:16.367285 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a7c31-0a56-4b9f-9676-625ac8d6d619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:16.385752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f68a7c31-0a56-4b9f-9676-625ac8d6d619 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:16.387021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f68a7c31-0a56-4b9f-9676-625ac8d6d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:16.447875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 915/1817] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:16.460336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:16.461799 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:16.539718 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18359d-87ab-45c0-9e02-efc2b4a967fc admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:16.545991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed54cc-864d-40c4-a628-d653b009fa07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:16.550236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed54cc-864d-40c4-a628-d653b009fa07 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:16.550236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed54cc-864d-40c4-a628-d653b009fa07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:16.550236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed54cc-864d-40c4-a628-d653b009fa07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:16.562665 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed54cc-864d-40c4-a628-d653b009fa07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:16.564740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed54cc-864d-40c4-a628-d653b009fa07 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:16.577122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 903/1818] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:16.759138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a7c31-0a56-4b9f-9676-625ac8d6d619 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:16.763046 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f68a7c31-0a56-4b9f-9676-625ac8d6d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:16.790069 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed54cc-864d-40c4-a628-d653b009fa07 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:16.792294 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f1ed54cc-864d-40c4-a628-d653b009fa07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:16.812587 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed54cc-864d-40c4-a628-d653b009fa07 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:16.818884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a7c31-0a56-4b9f-9676-625ac8d6d619 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:16.824693 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4697e2a-48fc-4539-8d2a-6a8bafc8bba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:16.825495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4697e2a-48fc-4539-8d2a-6a8bafc8bba8 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:16.825974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4697e2a-48fc-4539-8d2a-6a8bafc8bba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:16.826224 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4697e2a-48fc-4539-8d2a-6a8bafc8bba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:16.831951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f4697e2a-48fc-4539-8d2a-6a8bafc8bba8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:16.835977 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926850ce-078d-4b61-98aa-2c86708c0440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:16.838852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926850ce-078d-4b61-98aa-2c86708c0440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:16.839157 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926850ce-078d-4b61-98aa-2c86708c0440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:16.839449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926850ce-078d-4b61-98aa-2c86708c0440 admin admin] PATH_INFO: `/v3/projects/9167975331474e109654464e296c5b60` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:16.841964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926850ce-078d-4b61-98aa-2c86708c0440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9167975331474e109654464e296c5b60)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:16.845837 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926850ce-078d-4b61-98aa-2c86708c0440 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:16.896476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4697e2a-48fc-4539-8d2a-6a8bafc8bba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:16.898024 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4697e2a-48fc-4539-8d2a-6a8bafc8bba8 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:16.908820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 916/1819] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:39:17.007212 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-926850ce-078d-4b61-98aa-2c86708c0440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9167975331474e109654464e296c5b60', 'request_id': 'req-926850ce-078d-4b61-98aa-2c86708c0440'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:17.014361 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-926850ce-078d-4b61-98aa-2c86708c0440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9167975331474e109654464e296c5b60', 'request_id': 'req-926850ce-078d-4b61-98aa-2c86708c0440'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:17.023412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-926850ce-078d-4b61-98aa-2c86708c0440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9167975331474e109654464e296c5b60', 'request_id': 'req-926850ce-078d-4b61-98aa-2c86708c0440'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:17.292893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-926850ce-078d-4b61-98aa-2c86708c0440 admin admin] The token cache is being invalidate because project 9167975331474e109654464e296c5b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:17.293684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-926850ce-078d-4b61-98aa-2c86708c0440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:17.294526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-926850ce-078d-4b61-98aa-2c86708c0440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:17.296406 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 904/1820] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:16 2022] DELETE /identity/v3/projects/9167975331474e109654464e296c5b60 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:17.301895 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5f730-8a65-4d6b-bcd0-6230dbee82af None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:17.302190 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5f730-8a65-4d6b-bcd0-6230dbee82af None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:17.302474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5f730-8a65-4d6b-bcd0-6230dbee82af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:17.321573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-d1f5f730-8a65-4d6b-bcd0-6230dbee82af None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:17.323033 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d1f5f730-8a65-4d6b-bcd0-6230dbee82af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:17.420062 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 917/1821] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:17.429515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fffdb-01b8-4b8d-bfc0-034f36711770 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:17.431210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fffdb-01b8-4b8d-bfc0-034f36711770 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:17.431210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fffdb-01b8-4b8d-bfc0-034f36711770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:17.433012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5f730-8a65-4d6b-bcd0-6230dbee82af None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:17.434951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d1f5f730-8a65-4d6b-bcd0-6230dbee82af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:17.460314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-515fffdb-01b8-4b8d-bfc0-034f36711770 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:17.461816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-515fffdb-01b8-4b8d-bfc0-034f36711770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:17.469259 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5f730-8a65-4d6b-bcd0-6230dbee82af None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:17.477016 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 905/1822] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:17.478362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fffdb-01b8-4b8d-bfc0-034f36711770 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:17.483527 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:17.484429 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:17.485037 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:17.485321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] PATH_INFO: `/v3/projects/0cdc45aa917a4394a6fb19e69c7369b0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:17.487594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdc45aa917a4394a6fb19e69c7369b0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:17.489707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:17.491097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fffdb-01b8-4b8d-bfc0-034f36711770 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:17.496719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101d1d3-4485-49ff-86ea-46a83bf9682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:17.497834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101d1d3-4485-49ff-86ea-46a83bf9682c admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:17.498323 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101d1d3-4485-49ff-86ea-46a83bf9682c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:17.499013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101d1d3-4485-49ff-86ea-46a83bf9682c admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:17.505246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101d1d3-4485-49ff-86ea-46a83bf9682c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:17.505246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101d1d3-4485-49ff-86ea-46a83bf9682c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:17.505246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101d1d3-4485-49ff-86ea-46a83bf9682c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:17.525261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 906/1823] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:17.530176 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101d1d3-4485-49ff-86ea-46a83bf9682c admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:17.543822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101d1d3-4485-49ff-86ea-46a83bf9682c admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:17.550141 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4348b2e-2400-430e-ae4e-fc69771fc6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:17.551539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4348b2e-2400-430e-ae4e-fc69771fc6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:17.551816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4348b2e-2400-430e-ae4e-fc69771fc6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:17.552776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4348b2e-2400-430e-ae4e-fc69771fc6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:17.553413 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4348b2e-2400-430e-ae4e-fc69771fc6f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:17.555599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4348b2e-2400-430e-ae4e-fc69771fc6f5 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:17.665374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdc45aa917a4394a6fb19e69c7369b0', 'request_id': 'req-4f815915-1d51-4c6d-90a8-169ffc76db7a'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:17.670871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdc45aa917a4394a6fb19e69c7369b0', 'request_id': 'req-4f815915-1d51-4c6d-90a8-169ffc76db7a'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:17.715634 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 907/1824] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:17 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:17.718393 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4348b2e-2400-430e-ae4e-fc69771fc6f5 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:17.796746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdc45aa917a4394a6fb19e69c7369b0', 'request_id': 'req-4f815915-1d51-4c6d-90a8-169ffc76db7a'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:17.810747 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] The token cache is being invalidate because project 0cdc45aa917a4394a6fb19e69c7369b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:17.811472 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:17.812402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:17.816204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 918/1825] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:17 2022] DELETE /identity/v3/projects/0cdc45aa917a4394a6fb19e69c7369b0 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:17.819663 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:17.823466 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:17.841958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4348b2e-2400-430e-ae4e-fc69771fc6f5 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:17.848372 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304600ef-870f-40dc-8e68-0fff8adce8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:17.849583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304600ef-870f-40dc-8e68-0fff8adce8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:17.849959 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304600ef-870f-40dc-8e68-0fff8adce8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:17.850309 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304600ef-870f-40dc-8e68-0fff8adce8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:17.851094 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304600ef-870f-40dc-8e68-0fff8adce8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:17.854076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304600ef-870f-40dc-8e68-0fff8adce8f8 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:17.954343 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815915-1d51-4c6d-90a8-169ffc76db7a admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:17.961095 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:17.962333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:17.962708 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:17.963084 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] PATH_INFO: `/v3/users/6b189cac441f4e30a6df113dcf3baaba` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:17.964658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b189cac441f4e30a6df113dcf3baaba)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:17.965284 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 908/1826] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:17 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:17.968071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:17.970184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304600ef-870f-40dc-8e68-0fff8adce8f8 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:17.971932 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-304600ef-870f-40dc-8e68-0fff8adce8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:17.986228 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304600ef-870f-40dc-8e68-0fff8adce8f8 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:17.991394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0a946-4345-49eb-87d0-9ea9953e82b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:17.992320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0a946-4345-49eb-87d0-9ea9953e82b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:17.992679 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0a946-4345-49eb-87d0-9ea9953e82b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:17.993377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0a946-4345-49eb-87d0-9ea9953e82b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:17.993827 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0a946-4345-49eb-87d0-9ea9953e82b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:17.995546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0a946-4345-49eb-87d0-9ea9953e82b3 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:18.010968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 909/1827] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:18.012074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0a946-4345-49eb-87d0-9ea9953e82b3 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:18.024191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0a946-4345-49eb-87d0-9ea9953e82b3 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:18.030514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753868f-8668-419f-a0c6-f451c7a57161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:18.031657 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753868f-8668-419f-a0c6-f451c7a57161 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:18.032010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753868f-8668-419f-a0c6-f451c7a57161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:18.032464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753868f-8668-419f-a0c6-f451c7a57161 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:18.033275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753868f-8668-419f-a0c6-f451c7a57161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:18.035043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753868f-8668-419f-a0c6-f451c7a57161 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:18.059894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 910/1828] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:18.060942 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753868f-8668-419f-a0c6-f451c7a57161 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:18.074688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753868f-8668-419f-a0c6-f451c7a57161 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:18.082269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65009823-d051-465b-82c3-89d98b699c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:18.085086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65009823-d051-465b-82c3-89d98b699c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:18.085086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65009823-d051-465b-82c3-89d98b699c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:18.085086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65009823-d051-465b-82c3-89d98b699c12 admin admin] PATH_INFO: `/v3/projects/a103ee8a0e4b4eb6ba1a5a54ae0cf123/users/43dcf0f4643d49ca9b881045ba02450f/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:18.117946 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65009823-d051-465b-82c3-89d98b699c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a103ee8a0e4b4eb6ba1a5a54ae0cf123, user_id=43dcf0f4643d49ca9b881045ba02450f, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:18.120935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65009823-d051-465b-82c3-89d98b699c12 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:18.256189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 911/1829] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:18 2022] PUT /identity/v3/projects/a103ee8a0e4b4eb6ba1a5a54ae0cf123/users/43dcf0f4643d49ca9b881045ba02450f/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:18.262717 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbd5b8-9a13-463a-a3e7-9e1dda4b1c3b None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:18.263255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbd5b8-9a13-463a-a3e7-9e1dda4b1c3b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:18.263557 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbd5b8-9a13-463a-a3e7-9e1dda4b1c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:18.277945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b189cac441f4e30a6df113dcf3baaba'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:18.278658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b189cac441f4e30a6df113dcf3baaba'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:18.300010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-22fbd5b8-9a13-463a-a3e7-9e1dda4b1c3b None None] MFA Rules not processed for user `43dcf0f4643d49ca9b881045ba02450f`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:18.305767 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-22fbd5b8-9a13-463a-a3e7-9e1dda4b1c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:18.377709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 912/1830] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:18.382913 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b189cac441f4e30a6df113dcf3baaba'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:18.383656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b189cac441f4e30a6df113dcf3baaba'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:18.385679 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbd5b8-9a13-463a-a3e7-9e1dda4b1c3b None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:18.387797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-22fbd5b8-9a13-463a-a3e7-9e1dda4b1c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:18.406961 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b189cac441f4e30a6df113dcf3baaba'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:18.458240 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 919/1831] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:17 2022] DELETE /identity/v3/users/6b189cac441f4e30a6df113dcf3baaba => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:18.508860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbd5b8-9a13-463a-a3e7-9e1dda4b1c3b None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:18.599478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c0ddf-819e-41f4-ad6b-3ad57748715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:18.600193 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c0ddf-819e-41f4-ad6b-3ad57748715a admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:18.600654 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c0ddf-819e-41f4-ad6b-3ad57748715a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:18.601081 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c0ddf-819e-41f4-ad6b-3ad57748715a admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:18.601939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c0ddf-819e-41f4-ad6b-3ad57748715a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:18.604650 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c0ddf-819e-41f4-ad6b-3ad57748715a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:18.718166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 913/1832] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:18 2022] POST /identity/v3/projects => generated 393 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:18.723060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:18.733477 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214274c-29d4-46c5-99eb-81dd9d39daef admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:18.790673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2b438-4d25-4b46-8dba-60152f67ec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:18.795707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2b438-4d25-4b46-8dba-60152f67ec80 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:18.795707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2b438-4d25-4b46-8dba-60152f67ec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:18.795707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2b438-4d25-4b46-8dba-60152f67ec80 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:18.795707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2b438-4d25-4b46-8dba-60152f67ec80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:18.795707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2b438-4d25-4b46-8dba-60152f67ec80 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:18.943354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 920/1833] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:18 2022] POST /identity/v3/users => generated 303 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:18.947404 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c0ddf-819e-41f4-ad6b-3ad57748715a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:18.960093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c0ddf-819e-41f4-ad6b-3ad57748715a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:18.965303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730786e-2e35-4f2b-93ef-8ab2995fe7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:18.968084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730786e-2e35-4f2b-93ef-8ab2995fe7ea admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:18.968084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730786e-2e35-4f2b-93ef-8ab2995fe7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:18.968084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730786e-2e35-4f2b-93ef-8ab2995fe7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:18.968084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730786e-2e35-4f2b-93ef-8ab2995fe7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:18.969007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730786e-2e35-4f2b-93ef-8ab2995fe7ea admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:18.980180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 914/1834] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:18.984521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2b438-4d25-4b46-8dba-60152f67ec80 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:18.994196 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2b438-4d25-4b46-8dba-60152f67ec80 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:18.999098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007b6e6-a5e5-4bac-b81c-c02573d7292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:18.999622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007b6e6-a5e5-4bac-b81c-c02573d7292c admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:18.999905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007b6e6-a5e5-4bac-b81c-c02573d7292c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:19.000207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007b6e6-a5e5-4bac-b81c-c02573d7292c admin admin] PATH_INFO: `/v3/projects/ad3a9817e3254f4a9e3dc0d7002341a1/users/ac5f9745cbae475db4191cd224d134c0/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:19.015000 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007b6e6-a5e5-4bac-b81c-c02573d7292c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3a9817e3254f4a9e3dc0d7002341a1, user_id=ac5f9745cbae475db4191cd224d134c0, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:19.018282 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007b6e6-a5e5-4bac-b81c-c02573d7292c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:19.080542 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730786e-2e35-4f2b-93ef-8ab2995fe7ea admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:19.082403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8730786e-2e35-4f2b-93ef-8ab2995fe7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:19.096508 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730786e-2e35-4f2b-93ef-8ab2995fe7ea admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:19.105109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 921/1835] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:18 2022] PUT /identity/v3/projects/ad3a9817e3254f4a9e3dc0d7002341a1/users/ac5f9745cbae475db4191cd224d134c0/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:19.109808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422645c-dd56-48cb-aa19-d629b1aa3a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:19.110676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007b6e6-a5e5-4bac-b81c-c02573d7292c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:19.111074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422645c-dd56-48cb-aa19-d629b1aa3a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:19.111518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422645c-dd56-48cb-aa19-d629b1aa3a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:19.111888 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422645c-dd56-48cb-aa19-d629b1aa3a6e admin admin] PATH_INFO: `/v3/projects/ef5d6051715c458cb84ac188825728e9` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:19.114324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422645c-dd56-48cb-aa19-d629b1aa3a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5d6051715c458cb84ac188825728e9)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:19.116992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422645c-dd56-48cb-aa19-d629b1aa3a6e admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:19.201691 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007b6e6-a5e5-4bac-b81c-c02573d7292c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:19.207988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0383426-e43f-4cec-b5ff-f1fbbc2d6211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:19.210424 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0383426-e43f-4cec-b5ff-f1fbbc2d6211 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:19.210797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0383426-e43f-4cec-b5ff-f1fbbc2d6211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:19.210994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0383426-e43f-4cec-b5ff-f1fbbc2d6211 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:19.212192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0383426-e43f-4cec-b5ff-f1fbbc2d6211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:19.214066 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0383426-e43f-4cec-b5ff-f1fbbc2d6211 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:19.228906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 922/1836] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:19.230537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0383426-e43f-4cec-b5ff-f1fbbc2d6211 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:19.246198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0383426-e43f-4cec-b5ff-f1fbbc2d6211 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:19.249175 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc957e-b732-4a18-9a38-b9332800ac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:19.250074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc957e-b732-4a18-9a38-b9332800ac21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:19.250357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc957e-b732-4a18-9a38-b9332800ac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:19.250632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc957e-b732-4a18-9a38-b9332800ac21 admin admin] PATH_INFO: `/v3/projects/ad3a9817e3254f4a9e3dc0d7002341a1/users/ac5f9745cbae475db4191cd224d134c0/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:19.259822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc957e-b732-4a18-9a38-b9332800ac21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3a9817e3254f4a9e3dc0d7002341a1, user_id=ac5f9745cbae475db4191cd224d134c0, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:19.262833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc957e-b732-4a18-9a38-b9332800ac21 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:19.276021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 923/1837] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:19 2022] PUT /identity/v3/projects/ad3a9817e3254f4a9e3dc0d7002341a1/users/ac5f9745cbae475db4191cd224d134c0/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:19.295582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf00bff-6cbf-45ef-993c-92afbae96fcc None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:19.295876 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf00bff-6cbf-45ef-993c-92afbae96fcc None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:19.296232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf00bff-6cbf-45ef-993c-92afbae96fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:19.300948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6422645c-dd56-48cb-aa19-d629b1aa3a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5d6051715c458cb84ac188825728e9', 'request_id': 'req-6422645c-dd56-48cb-aa19-d629b1aa3a6e'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:19.307543 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6422645c-dd56-48cb-aa19-d629b1aa3a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5d6051715c458cb84ac188825728e9', 'request_id': 'req-6422645c-dd56-48cb-aa19-d629b1aa3a6e'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:19.315009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6422645c-dd56-48cb-aa19-d629b1aa3a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5d6051715c458cb84ac188825728e9', 'request_id': 'req-6422645c-dd56-48cb-aa19-d629b1aa3a6e'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:19.335724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-baf00bff-6cbf-45ef-993c-92afbae96fcc None None] MFA Rules not processed for user `ac5f9745cbae475db4191cd224d134c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:19.337060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-baf00bff-6cbf-45ef-993c-92afbae96fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:19.416727 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6422645c-dd56-48cb-aa19-d629b1aa3a6e admin admin] The token cache is being invalidate because project ef5d6051715c458cb84ac188825728e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:19.417166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6422645c-dd56-48cb-aa19-d629b1aa3a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:19.417998 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6422645c-dd56-48cb-aa19-d629b1aa3a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:19.423361 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 915/1838] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:19 2022] DELETE /identity/v3/projects/ef5d6051715c458cb84ac188825728e9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:19.425568 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc8d89-94ca-4be4-9c5d-92d5c7cd3c96 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:19.429372 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc8d89-94ca-4be4-9c5d-92d5c7cd3c96 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:19.429372 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc8d89-94ca-4be4-9c5d-92d5c7cd3c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:19.459387 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 924/1839] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:19.464787 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-f0cc8d89-94ca-4be4-9c5d-92d5c7cd3c96 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:19.465931 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f0cc8d89-94ca-4be4-9c5d-92d5c7cd3c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:19.471051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf00bff-6cbf-45ef-993c-92afbae96fcc None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:19.472674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-baf00bff-6cbf-45ef-993c-92afbae96fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:19.533947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 916/1840] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:19.541707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82f905-9698-4934-91aa-fa034a3830bd None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:19.541993 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82f905-9698-4934-91aa-fa034a3830bd None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:19.542420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82f905-9698-4934-91aa-fa034a3830bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:19.564256 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf00bff-6cbf-45ef-993c-92afbae96fcc None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:19.568800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b08f68-1bd1-4c53-a423-6fd69a7de41d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:19.569738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08f68-1bd1-4c53-a423-6fd69a7de41d service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:19.569738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08f68-1bd1-4c53-a423-6fd69a7de41d service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:19.570027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b08f68-1bd1-4c53-a423-6fd69a7de41d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:19.571996 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-6a82f905-9698-4934-91aa-fa034a3830bd None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:19.573752 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6a82f905-9698-4934-91aa-fa034a3830bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:19.580886 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b08f68-1bd1-4c53-a423-6fd69a7de41d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:19.582343 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b08f68-1bd1-4c53-a423-6fd69a7de41d service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:19.583526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 917/1841] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:19.584476 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82f905-9698-4934-91aa-fa034a3830bd None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:19.585927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6a82f905-9698-4934-91aa-fa034a3830bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:19.605744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82f905-9698-4934-91aa-fa034a3830bd None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:19.606693 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 925/1842] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:39:19.607695 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b08f68-1bd1-4c53-a423-6fd69a7de41d service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:19.619258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b08f68-1bd1-4c53-a423-6fd69a7de41d service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:19.624877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4400ca-ba01-41e3-9a75-284898b9fb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:19.626735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4400ca-ba01-41e3-9a75-284898b9fb24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:19.626735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4400ca-ba01-41e3-9a75-284898b9fb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:19.626926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4400ca-ba01-41e3-9a75-284898b9fb24 admin admin] PATH_INFO: `/v3/users/210c4e319c2848f493a77d1b35fef1aa` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:19.628193 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4400ca-ba01-41e3-9a75-284898b9fb24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=210c4e319c2848f493a77d1b35fef1aa)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:19.630153 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4400ca-ba01-41e3-9a75-284898b9fb24 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:19.634620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b069a-5ef8-4639-a506-6e6bc94653a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:19.636424 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b069a-5ef8-4639-a506-6e6bc94653a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:19.637088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b069a-5ef8-4639-a506-6e6bc94653a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:19.637627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b069a-5ef8-4639-a506-6e6bc94653a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:19.638549 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b069a-5ef8-4639-a506-6e6bc94653a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:19.639161 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b069a-5ef8-4639-a506-6e6bc94653a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:19.640985 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b069a-5ef8-4639-a506-6e6bc94653a6 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:19.655853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 926/1843] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:19.660236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b069a-5ef8-4639-a506-6e6bc94653a6 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:19.675129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b069a-5ef8-4639-a506-6e6bc94653a6 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:19.680846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e912-0b45-4158-9042-eac5eb2d2655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:19.681591 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e912-0b45-4158-9042-eac5eb2d2655 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:19.681950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e912-0b45-4158-9042-eac5eb2d2655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:19.682304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367e912-0b45-4158-9042-eac5eb2d2655 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:19.683281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367e912-0b45-4158-9042-eac5eb2d2655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:19.685780 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367e912-0b45-4158-9042-eac5eb2d2655 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:19.800503 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 927/1844] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:19 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:19.801541 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e912-0b45-4158-9042-eac5eb2d2655 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:19.866546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4c4400ca-ba01-41e3-9a75-284898b9fb24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '210c4e319c2848f493a77d1b35fef1aa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:19.866847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367e912-0b45-4158-9042-eac5eb2d2655 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:19.872568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33eb10-6184-4945-93c1-d24d7ebd0308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:19.873155 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33eb10-6184-4945-93c1-d24d7ebd0308 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:19.873440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33eb10-6184-4945-93c1-d24d7ebd0308 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:19.873718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33eb10-6184-4945-93c1-d24d7ebd0308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:19.875912 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5b33eb10-6184-4945-93c1-d24d7ebd0308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:19.936766 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33eb10-6184-4945-93c1-d24d7ebd0308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:19.938275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33eb10-6184-4945-93c1-d24d7ebd0308 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:19.947364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 928/1845] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:19.948134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33eb10-6184-4945-93c1-d24d7ebd0308 service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:19.959980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4c4400ca-ba01-41e3-9a75-284898b9fb24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '210c4e319c2848f493a77d1b35fef1aa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:19.977856 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4c4400ca-ba01-41e3-9a75-284898b9fb24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '210c4e319c2848f493a77d1b35fef1aa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:19.979422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4c4400ca-ba01-41e3-9a75-284898b9fb24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '210c4e319c2848f493a77d1b35fef1aa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:19.989802 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4c4400ca-ba01-41e3-9a75-284898b9fb24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '210c4e319c2848f493a77d1b35fef1aa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:19.997515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 918/1846] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:19 2022] DELETE /identity/v3/users/210c4e319c2848f493a77d1b35fef1aa => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:20.002207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27c471-c27d-42e1-b8b1-bbd215162203 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:20.002346 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27c471-c27d-42e1-b8b1-bbd215162203 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:20.002851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27c471-c27d-42e1-b8b1-bbd215162203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:20.022819 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ae27c471-c27d-42e1-b8b1-bbd215162203 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:20.024102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ae27c471-c27d-42e1-b8b1-bbd215162203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:20.036982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33eb10-6184-4945-93c1-d24d7ebd0308 service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:20.099730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 919/1847] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:20.107059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a435c2-439f-42ff-a0eb-b42ac4af0d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:20.107937 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a435c2-439f-42ff-a0eb-b42ac4af0d0b admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:20.108382 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a435c2-439f-42ff-a0eb-b42ac4af0d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:20.108667 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a435c2-439f-42ff-a0eb-b42ac4af0d0b admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:20.109031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27c471-c27d-42e1-b8b1-bbd215162203 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:20.109366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a435c2-439f-42ff-a0eb-b42ac4af0d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:20.110586 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ae27c471-c27d-42e1-b8b1-bbd215162203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:20.111348 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a435c2-439f-42ff-a0eb-b42ac4af0d0b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:20.165467 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27c471-c27d-42e1-b8b1-bbd215162203 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:20.169252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4aea88-e92f-4086-abc2-b5b964ad5888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:20.169885 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aea88-e92f-4086-abc2-b5b964ad5888 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:20.170174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aea88-e92f-4086-abc2-b5b964ad5888 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:20.170447 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4aea88-e92f-4086-abc2-b5b964ad5888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:20.180345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4aea88-e92f-4086-abc2-b5b964ad5888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:20.181766 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4aea88-e92f-4086-abc2-b5b964ad5888 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:20.191506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 920/1848] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:20.216867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 929/1849] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:19 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:20.217732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4aea88-e92f-4086-abc2-b5b964ad5888 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:20.219252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ee4aea88-e92f-4086-abc2-b5b964ad5888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:20.232434 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4aea88-e92f-4086-abc2-b5b964ad5888 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:20.237828 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01792e53-d151-47e9-ae2d-ccc9fca3576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:20.238926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01792e53-d151-47e9-ae2d-ccc9fca3576d admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:20.240920 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01792e53-d151-47e9-ae2d-ccc9fca3576d admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:20.240920 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01792e53-d151-47e9-ae2d-ccc9fca3576d admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:20.240920 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01792e53-d151-47e9-ae2d-ccc9fca3576d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:20.241857 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01792e53-d151-47e9-ae2d-ccc9fca3576d admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:20.252982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 921/1850] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:20.257194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a435c2-439f-42ff-a0eb-b42ac4af0d0b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:20.267914 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a435c2-439f-42ff-a0eb-b42ac4af0d0b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:20.275494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae7c5a-b13b-4078-a80f-014ab06730f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:20.275494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae7c5a-b13b-4078-a80f-014ab06730f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:20.275494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae7c5a-b13b-4078-a80f-014ab06730f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:20.275494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae7c5a-b13b-4078-a80f-014ab06730f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:20.275849 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae7c5a-b13b-4078-a80f-014ab06730f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:20.276236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae7c5a-b13b-4078-a80f-014ab06730f1 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:20.286604 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 930/1851] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:20.290831 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01792e53-d151-47e9-ae2d-ccc9fca3576d admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:20.300750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01792e53-d151-47e9-ae2d-ccc9fca3576d admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:20.305281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715a572-e1f8-45d0-8a31-62954f6f3dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:20.306228 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715a572-e1f8-45d0-8a31-62954f6f3dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:20.306508 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715a572-e1f8-45d0-8a31-62954f6f3dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:20.306776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715a572-e1f8-45d0-8a31-62954f6f3dc2 admin admin] PATH_INFO: `/v3/projects/4b68cc82d93344ecb0c24111e248a794/users/f37ae35ffff64c61addc8fc64eb441f1/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:20.321510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715a572-e1f8-45d0-8a31-62954f6f3dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b68cc82d93344ecb0c24111e248a794, user_id=f37ae35ffff64c61addc8fc64eb441f1, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:20.324336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715a572-e1f8-45d0-8a31-62954f6f3dc2 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:20.500739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 922/1852] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:20 2022] PUT /identity/v3/projects/4b68cc82d93344ecb0c24111e248a794/users/f37ae35ffff64c61addc8fc64eb441f1/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:20.510100 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a47ddd-4b79-4a1f-a4e4-a9553f7e2624 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:20.510392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a47ddd-4b79-4a1f-a4e4-a9553f7e2624 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:20.510668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a47ddd-4b79-4a1f-a4e4-a9553f7e2624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:20.546592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-44a47ddd-4b79-4a1f-a4e4-a9553f7e2624 None None] MFA Rules not processed for user `f37ae35ffff64c61addc8fc64eb441f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:20.546592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-44a47ddd-4b79-4a1f-a4e4-a9553f7e2624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:20.621518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 931/1853] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:20.633118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715a572-e1f8-45d0-8a31-62954f6f3dc2 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:20.635019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1715a572-e1f8-45d0-8a31-62954f6f3dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:20.697385 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715a572-e1f8-45d0-8a31-62954f6f3dc2 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:20.701417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57820ef9-b145-4b44-b47a-bb60c692d32b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f9935443bcc4d34aeb56e5b77a96720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:20.702135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57820ef9-b145-4b44-b47a-bb60c692d32b service glance] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:20.702430 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57820ef9-b145-4b44-b47a-bb60c692d32b service glance] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:20.702772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57820ef9-b145-4b44-b47a-bb60c692d32b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:20.713300 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57820ef9-b145-4b44-b47a-bb60c692d32b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:20.714695 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57820ef9-b145-4b44-b47a-bb60c692d32b service glance] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:20.724382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 923/1854] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:39:20.745016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a47ddd-4b79-4a1f-a4e4-a9553f7e2624 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:20.747007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-44a47ddd-4b79-4a1f-a4e4-a9553f7e2624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:20.843398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a47ddd-4b79-4a1f-a4e4-a9553f7e2624 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:20.850314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:20.851222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:20.851502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:20.851778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] PATH_INFO: `/v3/projects/b0398b90899d4f50b17f8ec82c3add06` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:20.853221 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0398b90899d4f50b17f8ec82c3add06)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:20.855266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:20.985035 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0398b90899d4f50b17f8ec82c3add06', 'request_id': 'req-33eec479-9178-481a-9b35-c9cec3a55b1b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:20.990995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0398b90899d4f50b17f8ec82c3add06', 'request_id': 'req-33eec479-9178-481a-9b35-c9cec3a55b1b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:21.096242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0398b90899d4f50b17f8ec82c3add06', 'request_id': 'req-33eec479-9178-481a-9b35-c9cec3a55b1b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:21.107505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] The token cache is being invalidate because project b0398b90899d4f50b17f8ec82c3add06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:21.107790 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:21.108443 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:21.109994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 932/1855] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:20 2022] DELETE /identity/v3/projects/b0398b90899d4f50b17f8ec82c3add06 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:21.114639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57820ef9-b145-4b44-b47a-bb60c692d32b service glance] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:21.125466 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57820ef9-b145-4b44-b47a-bb60c692d32b service glance] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:21.181541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32adff5-e3ba-4b79-9f16-6c9a36e59a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:21.186052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32adff5-e3ba-4b79-9f16-6c9a36e59a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:21.186052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32adff5-e3ba-4b79-9f16-6c9a36e59a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:21.186052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32adff5-e3ba-4b79-9f16-6c9a36e59a87 admin admin] PATH_INFO: `/v3/users/b6ec0c14acd24b2eaf6e4d00dbf4ccc3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:21.186052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32adff5-e3ba-4b79-9f16-6c9a36e59a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ec0c14acd24b2eaf6e4d00dbf4ccc3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:21.186052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32adff5-e3ba-4b79-9f16-6c9a36e59a87 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:21.355061 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a32adff5-e3ba-4b79-9f16-6c9a36e59a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ec0c14acd24b2eaf6e4d00dbf4ccc3'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:21.426742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a32adff5-e3ba-4b79-9f16-6c9a36e59a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ec0c14acd24b2eaf6e4d00dbf4ccc3'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:21.438513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a32adff5-e3ba-4b79-9f16-6c9a36e59a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ec0c14acd24b2eaf6e4d00dbf4ccc3'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:21.439409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a32adff5-e3ba-4b79-9f16-6c9a36e59a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ec0c14acd24b2eaf6e4d00dbf4ccc3'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:21.446039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a32adff5-e3ba-4b79-9f16-6c9a36e59a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ec0c14acd24b2eaf6e4d00dbf4ccc3'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:21.452706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 924/1856] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:21 2022] DELETE /identity/v3/users/b6ec0c14acd24b2eaf6e4d00dbf4ccc3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:22.343579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:22.346319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:22.370627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec479-9178-481a-9b35-c9cec3a55b1b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:22.445453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7b583-de40-403d-9099-52936fe18d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:22.446443 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7b583-de40-403d-9099-52936fe18d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:22.446805 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7b583-de40-403d-9099-52936fe18d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:22.447332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7b583-de40-403d-9099-52936fe18d3d admin admin] PATH_INFO: `/v3/projects/29b5d8a964f144249f346bd00b890118` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:22.448800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7b583-de40-403d-9099-52936fe18d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b5d8a964f144249f346bd00b890118)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:22.453866 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7b583-de40-403d-9099-52936fe18d3d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:22.488215 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c107-a83d-49a8-bcde-74568e3b0b71 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:22.488742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c107-a83d-49a8-bcde-74568e3b0b71 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:22.488821 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c107-a83d-49a8-bcde-74568e3b0b71 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:22.490611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 925/1857] 10.222.0.25 () {54 vars in 921 bytes} [Tue Mar 8 15:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:39:22.499175 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7eda1-e389-498e-a424-9052fe9920d9 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:22.499175 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7eda1-e389-498e-a424-9052fe9920d9 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:22.499175 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7eda1-e389-498e-a424-9052fe9920d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:22.519786 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ece7eda1-e389-498e-a424-9052fe9920d9 None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:22.521269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ece7eda1-e389-498e-a424-9052fe9920d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:22.599785 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b7f7b583-de40-403d-9099-52936fe18d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b5d8a964f144249f346bd00b890118', 'request_id': 'req-b7f7b583-de40-403d-9099-52936fe18d3d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:22.604816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 926/1858] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Mar 8 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:22.605451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b7f7b583-de40-403d-9099-52936fe18d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b5d8a964f144249f346bd00b890118', 'request_id': 'req-b7f7b583-de40-403d-9099-52936fe18d3d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:22.612168 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7eda1-e389-498e-a424-9052fe9920d9 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:22.614019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ece7eda1-e389-498e-a424-9052fe9920d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:22.628955 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7eda1-e389-498e-a424-9052fe9920d9 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:22.692904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b7f7b583-de40-403d-9099-52936fe18d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b5d8a964f144249f346bd00b890118', 'request_id': 'req-b7f7b583-de40-403d-9099-52936fe18d3d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:22.693539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ca1a4-eb3b-43d7-90be-ceaaaea14053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:22.694357 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ca1a4-eb3b-43d7-90be-ceaaaea14053 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:22.694642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ca1a4-eb3b-43d7-90be-ceaaaea14053 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:22.694920 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ca1a4-eb3b-43d7-90be-ceaaaea14053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:22.704643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ca1a4-eb3b-43d7-90be-ceaaaea14053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:22.704776 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b7f7b583-de40-403d-9099-52936fe18d3d admin admin] The token cache is being invalidate because project 29b5d8a964f144249f346bd00b890118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:22.704961 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b7f7b583-de40-403d-9099-52936fe18d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:22.705590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b7f7b583-de40-403d-9099-52936fe18d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:22.706407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ca1a4-eb3b-43d7-90be-ceaaaea14053 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:22.707354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 933/1859] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:22 2022] DELETE /identity/v3/projects/29b5d8a964f144249f346bd00b890118 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:22.711744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d659-5fa5-4e9f-99c3-c17d945869c6 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:22.712042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d659-5fa5-4e9f-99c3-c17d945869c6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:22.712882 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d659-5fa5-4e9f-99c3-c17d945869c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:22.718741 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 927/1860] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:22.736976 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-e2f1d659-5fa5-4e9f-99c3-c17d945869c6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:22.738700 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e2f1d659-5fa5-4e9f-99c3-c17d945869c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:22.809983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 934/1861] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:22.818142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e310b6-0b08-463b-9abf-2ec9efa8c2bb None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:22.818441 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e310b6-0b08-463b-9abf-2ec9efa8c2bb None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:22.818732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e310b6-0b08-463b-9abf-2ec9efa8c2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:22.837018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-09e310b6-0b08-463b-9abf-2ec9efa8c2bb None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:22.838210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-09e310b6-0b08-463b-9abf-2ec9efa8c2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:22.846905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 928/1862] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:22.851179 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d659-5fa5-4e9f-99c3-c17d945869c6 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:22.860698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d659-5fa5-4e9f-99c3-c17d945869c6 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:22.865393 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdb522-0e79-4489-b4b2-42078f065775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:22.866102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb522-0e79-4489-b4b2-42078f065775 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:22.866388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb522-0e79-4489-b4b2-42078f065775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:22.866674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdb522-0e79-4489-b4b2-42078f065775 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:22.867399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdb522-0e79-4489-b4b2-42078f065775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:22.867708 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdb522-0e79-4489-b4b2-42078f065775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:22.869353 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdb522-0e79-4489-b4b2-42078f065775 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:22.880569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 935/1863] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:22.885881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e310b6-0b08-463b-9abf-2ec9efa8c2bb None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:22.894500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e310b6-0b08-463b-9abf-2ec9efa8c2bb None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:22.899102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ddec6-2512-4335-b631-b8aea48dc990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:22.899737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ddec6-2512-4335-b631-b8aea48dc990 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:22.900018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ddec6-2512-4335-b631-b8aea48dc990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:22.900330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ddec6-2512-4335-b631-b8aea48dc990 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:22.901019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ddec6-2512-4335-b631-b8aea48dc990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:22.902907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ddec6-2512-4335-b631-b8aea48dc990 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:22.974593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 929/1864] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:22 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:22.978689 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdb522-0e79-4489-b4b2-42078f065775 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:22.988364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdb522-0e79-4489-b4b2-42078f065775 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:23.041191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bed147-65e4-4d99-9f31-2079ff8c3940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:23.041856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bed147-65e4-4d99-9f31-2079ff8c3940 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:23.042121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bed147-65e4-4d99-9f31-2079ff8c3940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:23.042401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bed147-65e4-4d99-9f31-2079ff8c3940 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:23.043087 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bed147-65e4-4d99-9f31-2079ff8c3940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:23.045041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bed147-65e4-4d99-9f31-2079ff8c3940 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:23.151996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 936/1865] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:22 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:23.153219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ddec6-2512-4335-b631-b8aea48dc990 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:23.164012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ddec6-2512-4335-b631-b8aea48dc990 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:23.169152 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643250c-6e97-49f6-8494-0f6cb58b9cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:23.169812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643250c-6e97-49f6-8494-0f6cb58b9cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:23.170095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643250c-6e97-49f6-8494-0f6cb58b9cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:23.170371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643250c-6e97-49f6-8494-0f6cb58b9cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:23.171098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643250c-6e97-49f6-8494-0f6cb58b9cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:23.173104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643250c-6e97-49f6-8494-0f6cb58b9cc0 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:23.183495 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 930/1866] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:23.187332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bed147-65e4-4d99-9f31-2079ff8c3940 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:23.198029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bed147-65e4-4d99-9f31-2079ff8c3940 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:23.202892 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c99184-88ea-48e0-af18-f39c7a9bd490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:23.203555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c99184-88ea-48e0-af18-f39c7a9bd490 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:23.203840 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c99184-88ea-48e0-af18-f39c7a9bd490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:23.204721 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c99184-88ea-48e0-af18-f39c7a9bd490 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:23.205449 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c99184-88ea-48e0-af18-f39c7a9bd490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:23.207051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c99184-88ea-48e0-af18-f39c7a9bd490 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:23.220582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 937/1867] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:23.221382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643250c-6e97-49f6-8494-0f6cb58b9cc0 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:23.231579 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643250c-6e97-49f6-8494-0f6cb58b9cc0 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:23.236373 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26854e24-685c-429a-9eb3-94984b8b4ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:23.237257 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26854e24-685c-429a-9eb3-94984b8b4ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:23.237549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26854e24-685c-429a-9eb3-94984b8b4ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:23.237832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26854e24-685c-429a-9eb3-94984b8b4ccf admin admin] PATH_INFO: `/v3/projects/3eee4813bdf943849cbbef872ecf358b/users/6b7c35da5c4743c283fdb44573a392fa/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:23.252859 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26854e24-685c-429a-9eb3-94984b8b4ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eee4813bdf943849cbbef872ecf358b, user_id=6b7c35da5c4743c283fdb44573a392fa, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:23.255546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26854e24-685c-429a-9eb3-94984b8b4ccf admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:23.347065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 931/1868] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:23 2022] PUT /identity/v3/projects/3eee4813bdf943849cbbef872ecf358b/users/6b7c35da5c4743c283fdb44573a392fa/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:23.358115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d9d0f-aa5e-4513-ac4d-506862e3db14 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:23.358588 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d9d0f-aa5e-4513-ac4d-506862e3db14 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:23.358661 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d9d0f-aa5e-4513-ac4d-506862e3db14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:23.388001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-722d9d0f-aa5e-4513-ac4d-506862e3db14 None None] MFA Rules not processed for user `6b7c35da5c4743c283fdb44573a392fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:23.389240 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-722d9d0f-aa5e-4513-ac4d-506862e3db14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:23.458484 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 938/1869] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:23.470199 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26854e24-685c-429a-9eb3-94984b8b4ccf admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:23.471887 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-26854e24-685c-429a-9eb3-94984b8b4ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:23.529745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26854e24-685c-429a-9eb3-94984b8b4ccf admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:23.533413 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b3a26-3fc9-46b9-ac0d-98e596d89018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:23.534058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b3a26-3fc9-46b9-ac0d-98e596d89018 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:23.534333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b3a26-3fc9-46b9-ac0d-98e596d89018 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:23.534611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b3a26-3fc9-46b9-ac0d-98e596d89018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:23.546265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b3a26-3fc9-46b9-ac0d-98e596d89018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:23.548462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b3a26-3fc9-46b9-ac0d-98e596d89018 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:23.557301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 932/1870] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:23.575697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d9d0f-aa5e-4513-ac4d-506862e3db14 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:23.635997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d9d0f-aa5e-4513-ac4d-506862e3db14 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:23.640627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:23.641608 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:23.641889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:23.642160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] PATH_INFO: `/v3/users/6b7c35da5c4743c283fdb44573a392fa` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:23.643355 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7c35da5c4743c283fdb44573a392fa)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:23.645308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:23.839692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7c35da5c4743c283fdb44573a392fa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:23.840406 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7c35da5c4743c283fdb44573a392fa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:23.920905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7c35da5c4743c283fdb44573a392fa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:23.921481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7c35da5c4743c283fdb44573a392fa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:23.933806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7c35da5c4743c283fdb44573a392fa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:23.945964 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 939/1871] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:23 2022] DELETE /identity/v3/users/6b7c35da5c4743c283fdb44573a392fa => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:23.950540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab2272-b0c9-4d8e-93ac-25809e638833 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:23.950914 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab2272-b0c9-4d8e-93ac-25809e638833 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:23.951191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab2272-b0c9-4d8e-93ac-25809e638833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:23.967622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-31ab2272-b0c9-4d8e-93ac-25809e638833 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:23.968848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-31ab2272-b0c9-4d8e-93ac-25809e638833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:24.024048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 933/1872] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:24.033916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:24.035314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:24.088936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f13e-a3f0-4b82-8ccc-ff06455cb909 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:24.092594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b594d9-8283-4757-8964-9372e2ada422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:24.093227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b594d9-8283-4757-8964-9372e2ada422 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:24.093507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b594d9-8283-4757-8964-9372e2ada422 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:24.093778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b594d9-8283-4757-8964-9372e2ada422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:24.103296 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b594d9-8283-4757-8964-9372e2ada422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:24.104750 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b594d9-8283-4757-8964-9372e2ada422 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:24.113977 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 940/1873] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:24.523147 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab2272-b0c9-4d8e-93ac-25809e638833 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:24.525083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-31ab2272-b0c9-4d8e-93ac-25809e638833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:24.540488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab2272-b0c9-4d8e-93ac-25809e638833 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:24.547553 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:24.549709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:24.550321 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:24.550762 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28 admin admin] PATH_INFO: `/v3/projects/3eee4813bdf943849cbbef872ecf358b` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:24.552745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eee4813bdf943849cbbef872ecf358b)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:24.555372 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:24.686131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eee4813bdf943849cbbef872ecf358b', 'request_id': 'req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:24.695051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eee4813bdf943849cbbef872ecf358b', 'request_id': 'req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:24.725162 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eee4813bdf943849cbbef872ecf358b', 'request_id': 'req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:24.844071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28 admin admin] The token cache is being invalidate because project 3eee4813bdf943849cbbef872ecf358b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:24.844560 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:24.846243 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-dd8810e3-c5fb-41fc-b7d5-ddb6b59d9f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:24.848873 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 934/1874] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:24 2022] DELETE /identity/v3/projects/3eee4813bdf943849cbbef872ecf358b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:24.853253 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311836e4-ce68-4773-99a3-82257ace3a8d None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:24.854191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311836e4-ce68-4773-99a3-82257ace3a8d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:24.854685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311836e4-ce68-4773-99a3-82257ace3a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:24.883538 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-311836e4-ce68-4773-99a3-82257ace3a8d None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:24.883538 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-311836e4-ce68-4773-99a3-82257ace3a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:24.981301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 941/1875] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:24.989854 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e62e0-38f6-4a49-b750-4b6c32a38eaa None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:24.990237 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e62e0-38f6-4a49-b750-4b6c32a38eaa None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:24.992413 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e62e0-38f6-4a49-b750-4b6c32a38eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:25.021048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-038e62e0-38f6-4a49-b750-4b6c32a38eaa None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:25.022197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-038e62e0-38f6-4a49-b750-4b6c32a38eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:25.039348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 935/1876] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:25.052385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311836e4-ce68-4773-99a3-82257ace3a8d None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:25.063129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311836e4-ce68-4773-99a3-82257ace3a8d None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:25.070551 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ca9e2-ea62-43d1-8692-3a66b9c02ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:25.071257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ca9e2-ea62-43d1-8692-3a66b9c02ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:25.071538 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ca9e2-ea62-43d1-8692-3a66b9c02ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:25.071866 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ca9e2-ea62-43d1-8692-3a66b9c02ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:25.072784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ca9e2-ea62-43d1-8692-3a66b9c02ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:25.073144 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ca9e2-ea62-43d1-8692-3a66b9c02ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:25.074800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ca9e2-ea62-43d1-8692-3a66b9c02ff7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:25.092278 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 942/1877] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:25.100724 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e62e0-38f6-4a49-b750-4b6c32a38eaa None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:25.112851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e62e0-38f6-4a49-b750-4b6c32a38eaa None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:25.118514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba60d1-8e27-4876-aaf6-581b22161215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:25.119940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba60d1-8e27-4876-aaf6-581b22161215 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:25.120767 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba60d1-8e27-4876-aaf6-581b22161215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:25.121095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba60d1-8e27-4876-aaf6-581b22161215 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:25.121846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba60d1-8e27-4876-aaf6-581b22161215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:25.123893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba60d1-8e27-4876-aaf6-581b22161215 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:25.299045 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 936/1878] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:25 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:25.302973 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ca9e2-ea62-43d1-8692-3a66b9c02ff7 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:25.315342 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ca9e2-ea62-43d1-8692-3a66b9c02ff7 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:25.379190 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43235b24-0908-4809-af43-f69096ab78b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:25.379856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43235b24-0908-4809-af43-f69096ab78b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:25.380138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43235b24-0908-4809-af43-f69096ab78b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:25.380447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43235b24-0908-4809-af43-f69096ab78b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:25.381146 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43235b24-0908-4809-af43-f69096ab78b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:25.383053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43235b24-0908-4809-af43-f69096ab78b8 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:25.505163 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 943/1879] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:25 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:25.509404 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba60d1-8e27-4876-aaf6-581b22161215 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:25.520816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba60d1-8e27-4876-aaf6-581b22161215 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:25.526305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30b3dd-f619-4a06-af92-30ae39072058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:25.527527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30b3dd-f619-4a06-af92-30ae39072058 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:25.528048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30b3dd-f619-4a06-af92-30ae39072058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:25.528586 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30b3dd-f619-4a06-af92-30ae39072058 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:25.529668 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30b3dd-f619-4a06-af92-30ae39072058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:25.532584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30b3dd-f619-4a06-af92-30ae39072058 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:25.546350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 937/1880] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:25.551180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43235b24-0908-4809-af43-f69096ab78b8 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:25.565705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43235b24-0908-4809-af43-f69096ab78b8 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:25.571344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fe369-4d52-4079-bad4-ca116f233b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:25.572181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fe369-4d52-4079-bad4-ca116f233b38 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:25.572507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fe369-4d52-4079-bad4-ca116f233b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:25.572792 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fe369-4d52-4079-bad4-ca116f233b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:25.573525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fe369-4d52-4079-bad4-ca116f233b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:25.575140 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fe369-4d52-4079-bad4-ca116f233b38 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:25.587716 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 944/1881] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:25.591413 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30b3dd-f619-4a06-af92-30ae39072058 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:25.604530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30b3dd-f619-4a06-af92-30ae39072058 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:25.609200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c47658-f8a3-4288-bdc1-40ec60363a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:25.610142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47658-f8a3-4288-bdc1-40ec60363a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:25.610425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47658-f8a3-4288-bdc1-40ec60363a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:25.610702 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c47658-f8a3-4288-bdc1-40ec60363a0d admin admin] PATH_INFO: `/v3/projects/1d44f343763d4f1fbb71f67a721606b6/users/6a1fea26bafd4908b363067971b19087/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:25.650414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c47658-f8a3-4288-bdc1-40ec60363a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d44f343763d4f1fbb71f67a721606b6, user_id=6a1fea26bafd4908b363067971b19087, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:25.653384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c47658-f8a3-4288-bdc1-40ec60363a0d admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:25.730991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 938/1882] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:25 2022] PUT /identity/v3/projects/1d44f343763d4f1fbb71f67a721606b6/users/6a1fea26bafd4908b363067971b19087/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:25.746276 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d96f3f-2bc7-4707-8d37-692bcc509435 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:25.746894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d96f3f-2bc7-4707-8d37-692bcc509435 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:25.746894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d96f3f-2bc7-4707-8d37-692bcc509435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:25.785829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-18d96f3f-2bc7-4707-8d37-692bcc509435 None None] MFA Rules not processed for user `6a1fea26bafd4908b363067971b19087`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:25.787073 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-18d96f3f-2bc7-4707-8d37-692bcc509435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:25.869284 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 945/1883] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:25.891513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c47658-f8a3-4288-bdc1-40ec60363a0d admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:25.893505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d7c47658-f8a3-4288-bdc1-40ec60363a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:25.959169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c47658-f8a3-4288-bdc1-40ec60363a0d admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:25.971114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c99557-bde0-48dd-b6c4-9e993d23c048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:25.971818 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c99557-bde0-48dd-b6c4-9e993d23c048 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:25.972098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c99557-bde0-48dd-b6c4-9e993d23c048 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:25.972421 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c99557-bde0-48dd-b6c4-9e993d23c048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:25.983079 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c99557-bde0-48dd-b6c4-9e993d23c048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:25.984687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c99557-bde0-48dd-b6c4-9e993d23c048 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:25.996031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 939/1884] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:26.015835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d96f3f-2bc7-4707-8d37-692bcc509435 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:26.096433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d96f3f-2bc7-4707-8d37-692bcc509435 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:26.101849 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:26.103232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:26.103232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:26.103422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] PATH_INFO: `/v3/users/6a1fea26bafd4908b363067971b19087` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:26.104716 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1fea26bafd4908b363067971b19087)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:26.106927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:26.314046 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1fea26bafd4908b363067971b19087'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:26.314688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1fea26bafd4908b363067971b19087'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:26.392341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1fea26bafd4908b363067971b19087'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:26.392994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1fea26bafd4908b363067971b19087'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:26.411076 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1fea26bafd4908b363067971b19087'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:26.424464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 946/1885] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:26 2022] DELETE /identity/v3/users/6a1fea26bafd4908b363067971b19087 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:26.429206 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d58a9-5ef5-4a52-904d-809af5702be2 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:26.431945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d58a9-5ef5-4a52-904d-809af5702be2 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:26.431945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d58a9-5ef5-4a52-904d-809af5702be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:26.447753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b85d58a9-5ef5-4a52-904d-809af5702be2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:26.449159 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b85d58a9-5ef5-4a52-904d-809af5702be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:26.515886 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 940/1886] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:26.526599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:26.528027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:26.596225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293d28b-d69c-4ec1-b33a-40dea6eca82e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:26.599894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f3e11-0bfd-4b2d-8559-dc3be733278d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:26.600572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f3e11-0bfd-4b2d-8559-dc3be733278d service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:26.600859 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f3e11-0bfd-4b2d-8559-dc3be733278d service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:26.601142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f3e11-0bfd-4b2d-8559-dc3be733278d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:26.611874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f3e11-0bfd-4b2d-8559-dc3be733278d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:26.616670 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f3e11-0bfd-4b2d-8559-dc3be733278d service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:26.624354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 947/1887] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:26.908605 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac18111-e9ed-42b5-9f04-0b0aad4a4513 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:26.909537 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac18111-e9ed-42b5-9f04-0b0aad4a4513 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:26.910665 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac18111-e9ed-42b5-9f04-0b0aad4a4513 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:26.913207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 941/1888] 10.222.0.25 () {54 vars in 921 bytes} [Tue Mar 8 15:39:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:39:26.925025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbab123-b8eb-439e-a667-62850a693ecc None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:26.935409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbab123-b8eb-439e-a667-62850a693ecc None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:26.937951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbab123-b8eb-439e-a667-62850a693ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:26.968763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5cbab123-b8eb-439e-a667-62850a693ecc None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:26.970231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5cbab123-b8eb-439e-a667-62850a693ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:27.077224 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 948/1889] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Mar 8 15:39:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:27.090139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac18111-e9ed-42b5-9f04-0b0aad4a4513 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:27.096980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2ac18111-e9ed-42b5-9f04-0b0aad4a4513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:27.111915 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac18111-e9ed-42b5-9f04-0b0aad4a4513 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:27.118708 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8bb2-d97f-4265-badd-16ed33bbac38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:27.120659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8bb2-d97f-4265-badd-16ed33bbac38 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:27.120904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8bb2-d97f-4265-badd-16ed33bbac38 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:27.121197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8bb2-d97f-4265-badd-16ed33bbac38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:27.131302 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb8bb2-d97f-4265-badd-16ed33bbac38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:27.133016 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb8bb2-d97f-4265-badd-16ed33bbac38 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:27.150925 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 942/1890] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:27.152259 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbab123-b8eb-439e-a667-62850a693ecc None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:27.153908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5cbab123-b8eb-439e-a667-62850a693ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:27.187206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbab123-b8eb-439e-a667-62850a693ecc None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:27.201191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509f8f0-84b4-4e15-a1d3-a380d14627e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:27.201191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509f8f0-84b4-4e15-a1d3-a380d14627e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:27.201191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509f8f0-84b4-4e15-a1d3-a380d14627e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:27.201191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509f8f0-84b4-4e15-a1d3-a380d14627e7 admin admin] PATH_INFO: `/v3/projects/1d44f343763d4f1fbb71f67a721606b6` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:27.206075 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509f8f0-84b4-4e15-a1d3-a380d14627e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d44f343763d4f1fbb71f67a721606b6)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:27.208038 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509f8f0-84b4-4e15-a1d3-a380d14627e7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:27.322004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-c509f8f0-84b4-4e15-a1d3-a380d14627e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d44f343763d4f1fbb71f67a721606b6', 'request_id': 'req-c509f8f0-84b4-4e15-a1d3-a380d14627e7'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:27.330917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-c509f8f0-84b4-4e15-a1d3-a380d14627e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d44f343763d4f1fbb71f67a721606b6', 'request_id': 'req-c509f8f0-84b4-4e15-a1d3-a380d14627e7'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:27.456136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-c509f8f0-84b4-4e15-a1d3-a380d14627e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d44f343763d4f1fbb71f67a721606b6', 'request_id': 'req-c509f8f0-84b4-4e15-a1d3-a380d14627e7'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:27.467753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-c509f8f0-84b4-4e15-a1d3-a380d14627e7 admin admin] The token cache is being invalidate because project 1d44f343763d4f1fbb71f67a721606b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:27.469090 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-c509f8f0-84b4-4e15-a1d3-a380d14627e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:27.469090 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-c509f8f0-84b4-4e15-a1d3-a380d14627e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:27.470803 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 949/1891] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:27 2022] DELETE /identity/v3/projects/1d44f343763d4f1fbb71f67a721606b6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:27.475824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bb6c9-d100-4579-8695-d94fb98a5be1 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:27.476121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bb6c9-d100-4579-8695-d94fb98a5be1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:27.476475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bb6c9-d100-4579-8695-d94fb98a5be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:27.494142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7f7bb6c9-d100-4579-8695-d94fb98a5be1 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:27.497828 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7f7bb6c9-d100-4579-8695-d94fb98a5be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:27.553671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 943/1892] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:27.562627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bd14d-4e4c-4a65-af68-fe01f27fb13a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:27.562931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bd14d-4e4c-4a65-af68-fe01f27fb13a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:27.563732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bd14d-4e4c-4a65-af68-fe01f27fb13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:27.584074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-3c5bd14d-4e4c-4a65-af68-fe01f27fb13a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:27.586188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3c5bd14d-4e4c-4a65-af68-fe01f27fb13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:27.595744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 950/1893] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:27.600050 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bb6c9-d100-4579-8695-d94fb98a5be1 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:27.609790 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bb6c9-d100-4579-8695-d94fb98a5be1 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:27.614485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b701f-ae74-43ad-afd3-1a78e06ad050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:27.616353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b701f-ae74-43ad-afd3-1a78e06ad050 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:27.616353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b701f-ae74-43ad-afd3-1a78e06ad050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:27.616353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b701f-ae74-43ad-afd3-1a78e06ad050 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:27.616817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b701f-ae74-43ad-afd3-1a78e06ad050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:27.616817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b701f-ae74-43ad-afd3-1a78e06ad050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:27.618311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b701f-ae74-43ad-afd3-1a78e06ad050 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:27.630148 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 944/1894] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:27.634449 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bd14d-4e4c-4a65-af68-fe01f27fb13a None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:27.647109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bd14d-4e4c-4a65-af68-fe01f27fb13a None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:27.652821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a1d53-91e8-4721-b568-026dfd24146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:27.653127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1d53-91e8-4721-b568-026dfd24146f admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:27.653414 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1d53-91e8-4721-b568-026dfd24146f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:27.653694 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1d53-91e8-4721-b568-026dfd24146f admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:27.654395 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a1d53-91e8-4721-b568-026dfd24146f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:27.656346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a1d53-91e8-4721-b568-026dfd24146f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:27.794059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 951/1895] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:27 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:27.798000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b701f-ae74-43ad-afd3-1a78e06ad050 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:27.807938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b701f-ae74-43ad-afd3-1a78e06ad050 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:27.866936 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f28a3-5ddc-4365-a008-dcb215521f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:27.867671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f28a3-5ddc-4365-a008-dcb215521f62 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:27.867940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f28a3-5ddc-4365-a008-dcb215521f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:27.868249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f28a3-5ddc-4365-a008-dcb215521f62 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:27.869573 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f28a3-5ddc-4365-a008-dcb215521f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:27.873507 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f28a3-5ddc-4365-a008-dcb215521f62 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:27.956312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 945/1896] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:27 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:27.960334 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a1d53-91e8-4721-b568-026dfd24146f admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:27.970769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a1d53-91e8-4721-b568-026dfd24146f admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:27.975938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf2f7c-4621-4c36-b86f-ec6741da2d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:27.976752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf2f7c-4621-4c36-b86f-ec6741da2d80 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:27.977182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf2f7c-4621-4c36-b86f-ec6741da2d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:27.977410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf2f7c-4621-4c36-b86f-ec6741da2d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:27.978178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf2f7c-4621-4c36-b86f-ec6741da2d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:27.979794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf2f7c-4621-4c36-b86f-ec6741da2d80 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:27.994147 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 952/1897] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:27.996742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f28a3-5ddc-4365-a008-dcb215521f62 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:28.008183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f28a3-5ddc-4365-a008-dcb215521f62 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:28.013586 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be707cbc-f81a-4bf4-8741-8ccc4d00d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:28.014341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be707cbc-f81a-4bf4-8741-8ccc4d00d521 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:28.014697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be707cbc-f81a-4bf4-8741-8ccc4d00d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:28.015054 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be707cbc-f81a-4bf4-8741-8ccc4d00d521 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:28.015850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be707cbc-f81a-4bf4-8741-8ccc4d00d521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:28.018047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be707cbc-f81a-4bf4-8741-8ccc4d00d521 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:28.029725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 946/1898] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:28.034149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf2f7c-4621-4c36-b86f-ec6741da2d80 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:28.045599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf2f7c-4621-4c36-b86f-ec6741da2d80 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:28.053983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f811f-3ed3-4ab2-a661-053000b59fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:28.054871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f811f-3ed3-4ab2-a661-053000b59fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:28.055153 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f811f-3ed3-4ab2-a661-053000b59fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:28.055428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f811f-3ed3-4ab2-a661-053000b59fe0 admin admin] PATH_INFO: `/v3/projects/58d36da8d95c4ab39fcfaf7dd148e3aa/users/c901302360434c6ca5ba698adc4e2ff7/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:28.070648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f811f-3ed3-4ab2-a661-053000b59fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d36da8d95c4ab39fcfaf7dd148e3aa, user_id=c901302360434c6ca5ba698adc4e2ff7, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:28.073344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f811f-3ed3-4ab2-a661-053000b59fe0 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:28.230442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 953/1899] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:28 2022] PUT /identity/v3/projects/58d36da8d95c4ab39fcfaf7dd148e3aa/users/c901302360434c6ca5ba698adc4e2ff7/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:28.242215 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44d739-33bd-4069-bd12-b1620f67ac3b None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:28.242215 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44d739-33bd-4069-bd12-b1620f67ac3b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:28.242215 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44d739-33bd-4069-bd12-b1620f67ac3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:28.269337 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ae44d739-33bd-4069-bd12-b1620f67ac3b None None] MFA Rules not processed for user `c901302360434c6ca5ba698adc4e2ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:28.270554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ae44d739-33bd-4069-bd12-b1620f67ac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:28.334202 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 947/1900] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:28.346148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f811f-3ed3-4ab2-a661-053000b59fe0 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:28.347889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-332f811f-3ed3-4ab2-a661-053000b59fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:28.404163 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f811f-3ed3-4ab2-a661-053000b59fe0 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:28.408705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99264915-3bcc-4978-a3bf-e01c494d76e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f9935443bcc4d34aeb56e5b77a96720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:28.409346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99264915-3bcc-4978-a3bf-e01c494d76e1 service glance] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:28.409632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99264915-3bcc-4978-a3bf-e01c494d76e1 service glance] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:28.409908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99264915-3bcc-4978-a3bf-e01c494d76e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:28.418310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99264915-3bcc-4978-a3bf-e01c494d76e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:28.419738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99264915-3bcc-4978-a3bf-e01c494d76e1 service glance] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:28.429854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 954/1901] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:31.836252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44d739-33bd-4069-bd12-b1620f67ac3b None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:31.836252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ae44d739-33bd-4069-bd12-b1620f67ac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:31.905910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44d739-33bd-4069-bd12-b1620f67ac3b None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:31.911733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:31.913046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:31.913171 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:31.913653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] PATH_INFO: `/v3/users/43dcf0f4643d49ca9b881045ba02450f` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:31.915217 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43dcf0f4643d49ca9b881045ba02450f)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:31.917382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:32.108651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43dcf0f4643d49ca9b881045ba02450f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:32.195480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43dcf0f4643d49ca9b881045ba02450f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:32.208723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43dcf0f4643d49ca9b881045ba02450f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:32.209494 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43dcf0f4643d49ca9b881045ba02450f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:32.216774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43dcf0f4643d49ca9b881045ba02450f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:32.223295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 948/1902] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:31 2022] DELETE /identity/v3/users/43dcf0f4643d49ca9b881045ba02450f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:32.227771 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2aee0-d907-498f-9dfa-8714312ba989 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:32.233904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2aee0-d907-498f-9dfa-8714312ba989 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:32.233904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2aee0-d907-498f-9dfa-8714312ba989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:32.245210 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-84b2aee0-d907-498f-9dfa-8714312ba989 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:32.246751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-84b2aee0-d907-498f-9dfa-8714312ba989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:32.317538 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 955/1903] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:32.327693 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:32.330384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:32.393062 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe1b34-f9a0-4524-b335-7537cad0bd25 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:32.396839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba0421-b6fe-4895-8994-ed4cf2c056f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:32.397489 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba0421-b6fe-4895-8994-ed4cf2c056f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:32.397770 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba0421-b6fe-4895-8994-ed4cf2c056f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:32.398048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba0421-b6fe-4895-8994-ed4cf2c056f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:32.407511 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba0421-b6fe-4895-8994-ed4cf2c056f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:32.409003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba0421-b6fe-4895-8994-ed4cf2c056f7 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:32.419090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 949/1904] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:32.884975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2aee0-d907-498f-9dfa-8714312ba989 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:32.886653 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-84b2aee0-d907-498f-9dfa-8714312ba989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:32.921537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2aee0-d907-498f-9dfa-8714312ba989 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:32.930513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:32.931385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:32.931670 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:32.931948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] PATH_INFO: `/v3/projects/a103ee8a0e4b4eb6ba1a5a54ae0cf123` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:32.933197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a103ee8a0e4b4eb6ba1a5a54ae0cf123)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:32.935123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:33.139062 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a103ee8a0e4b4eb6ba1a5a54ae0cf123', 'request_id': 'req-46a79c93-bb70-428b-ad42-f73ff2aedc20'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:33.146891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a103ee8a0e4b4eb6ba1a5a54ae0cf123', 'request_id': 'req-46a79c93-bb70-428b-ad42-f73ff2aedc20'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:33.227316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a103ee8a0e4b4eb6ba1a5a54ae0cf123', 'request_id': 'req-46a79c93-bb70-428b-ad42-f73ff2aedc20'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:33.240943 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] The token cache is being invalidate because project a103ee8a0e4b4eb6ba1a5a54ae0cf123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:33.241564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:33.242124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:33.243846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 956/1905] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:32 2022] DELETE /identity/v3/projects/a103ee8a0e4b4eb6ba1a5a54ae0cf123 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:33.247964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba0421-b6fe-4895-8994-ed4cf2c056f7 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:33.262670 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba0421-b6fe-4895-8994-ed4cf2c056f7 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:33.321159 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14d8d6-d174-4320-b13f-3d6d8636a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:33.322071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14d8d6-d174-4320-b13f-3d6d8636a901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:33.322351 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14d8d6-d174-4320-b13f-3d6d8636a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:33.322628 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14d8d6-d174-4320-b13f-3d6d8636a901 admin admin] PATH_INFO: `/v3/users/ac5f9745cbae475db4191cd224d134c0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:33.323838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14d8d6-d174-4320-b13f-3d6d8636a901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5f9745cbae475db4191cd224d134c0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:33.325832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14d8d6-d174-4320-b13f-3d6d8636a901 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:33.494920 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-db14d8d6-d174-4320-b13f-3d6d8636a901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5f9745cbae475db4191cd224d134c0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:33.569155 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-db14d8d6-d174-4320-b13f-3d6d8636a901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5f9745cbae475db4191cd224d134c0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:33.581891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-db14d8d6-d174-4320-b13f-3d6d8636a901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5f9745cbae475db4191cd224d134c0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:33.582593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-db14d8d6-d174-4320-b13f-3d6d8636a901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5f9745cbae475db4191cd224d134c0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:33.592062 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-db14d8d6-d174-4320-b13f-3d6d8636a901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5f9745cbae475db4191cd224d134c0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:33.595624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 950/1906] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:33 2022] DELETE /identity/v3/users/ac5f9745cbae475db4191cd224d134c0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:34.061580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:34.063872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:34.076582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79c93-bb70-428b-ad42-f73ff2aedc20 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:34.136042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797da39c-8134-4c48-a118-c9ad3c4fbd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:34.137897 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797da39c-8134-4c48-a118-c9ad3c4fbd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:34.138181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797da39c-8134-4c48-a118-c9ad3c4fbd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:34.138459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797da39c-8134-4c48-a118-c9ad3c4fbd0f admin admin] PATH_INFO: `/v3/projects/ad3a9817e3254f4a9e3dc0d7002341a1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:34.142407 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797da39c-8134-4c48-a118-c9ad3c4fbd0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3a9817e3254f4a9e3dc0d7002341a1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:34.144711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797da39c-8134-4c48-a118-c9ad3c4fbd0f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:34.254727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-797da39c-8134-4c48-a118-c9ad3c4fbd0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3a9817e3254f4a9e3dc0d7002341a1', 'request_id': 'req-797da39c-8134-4c48-a118-c9ad3c4fbd0f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:34.260249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-797da39c-8134-4c48-a118-c9ad3c4fbd0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3a9817e3254f4a9e3dc0d7002341a1', 'request_id': 'req-797da39c-8134-4c48-a118-c9ad3c4fbd0f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:34.335324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-797da39c-8134-4c48-a118-c9ad3c4fbd0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3a9817e3254f4a9e3dc0d7002341a1', 'request_id': 'req-797da39c-8134-4c48-a118-c9ad3c4fbd0f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:34.353080 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-797da39c-8134-4c48-a118-c9ad3c4fbd0f admin admin] The token cache is being invalidate because project ad3a9817e3254f4a9e3dc0d7002341a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:34.353237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-797da39c-8134-4c48-a118-c9ad3c4fbd0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:34.353960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-797da39c-8134-4c48-a118-c9ad3c4fbd0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:34.355845 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 957/1907] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:34 2022] DELETE /identity/v3/projects/ad3a9817e3254f4a9e3dc0d7002341a1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:34.362023 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03606b3-6fa3-4d90-a691-1400d0228b07 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:34.362524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03606b3-6fa3-4d90-a691-1400d0228b07 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:34.362710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03606b3-6fa3-4d90-a691-1400d0228b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:34.389366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-a03606b3-6fa3-4d90-a691-1400d0228b07 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:34.399105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a03606b3-6fa3-4d90-a691-1400d0228b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:34.456122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 951/1908] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:34.464406 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c06072-0a9f-4528-a684-d646f1b3226c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:34.465022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c06072-0a9f-4528-a684-d646f1b3226c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:34.465316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c06072-0a9f-4528-a684-d646f1b3226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:34.501456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-18c06072-0a9f-4528-a684-d646f1b3226c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:34.506933 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-18c06072-0a9f-4528-a684-d646f1b3226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:34.521556 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 958/1909] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:34.525876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03606b3-6fa3-4d90-a691-1400d0228b07 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:34.535833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03606b3-6fa3-4d90-a691-1400d0228b07 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:34.540907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c1986-8437-4ec9-aff0-454ca9bb585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:34.541562 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c1986-8437-4ec9-aff0-454ca9bb585a admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:34.542338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c1986-8437-4ec9-aff0-454ca9bb585a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:34.542338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c1986-8437-4ec9-aff0-454ca9bb585a admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:34.542865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c1986-8437-4ec9-aff0-454ca9bb585a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:34.543169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c1986-8437-4ec9-aff0-454ca9bb585a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:34.545073 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c1986-8437-4ec9-aff0-454ca9bb585a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:34.557228 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 952/1910] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:34.561613 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c06072-0a9f-4528-a684-d646f1b3226c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:34.571605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c06072-0a9f-4528-a684-d646f1b3226c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:34.576259 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7aec7-e2fe-4536-be0f-bda4acb5a76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:34.576917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7aec7-e2fe-4536-be0f-bda4acb5a76e admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:34.577202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7aec7-e2fe-4536-be0f-bda4acb5a76e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:34.577618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7aec7-e2fe-4536-be0f-bda4acb5a76e admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:34.578353 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7aec7-e2fe-4536-be0f-bda4acb5a76e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:34.580302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7aec7-e2fe-4536-be0f-bda4acb5a76e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:34.744050 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 959/1911] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:34 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:34.748750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c1986-8437-4ec9-aff0-454ca9bb585a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:34.759132 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c1986-8437-4ec9-aff0-454ca9bb585a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:34.818173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea95619-8642-42ed-8088-eab8cf784cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:34.818792 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea95619-8642-42ed-8088-eab8cf784cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:34.819072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea95619-8642-42ed-8088-eab8cf784cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:34.819369 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea95619-8642-42ed-8088-eab8cf784cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:34.820042 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea95619-8642-42ed-8088-eab8cf784cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:34.822120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea95619-8642-42ed-8088-eab8cf784cc9 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:34.944379 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 953/1912] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:34 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:34.948355 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7aec7-e2fe-4536-be0f-bda4acb5a76e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:34.959217 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7aec7-e2fe-4536-be0f-bda4acb5a76e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:34.965330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43a5eb-6608-4668-a8da-bbd91557151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:34.965330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a5eb-6608-4668-a8da-bbd91557151c admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:34.965728 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a5eb-6608-4668-a8da-bbd91557151c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:34.965728 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43a5eb-6608-4668-a8da-bbd91557151c admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:34.966416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43a5eb-6608-4668-a8da-bbd91557151c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:34.968169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43a5eb-6608-4668-a8da-bbd91557151c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:34.979420 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 960/1913] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:34.983350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea95619-8642-42ed-8088-eab8cf784cc9 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:34.993872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea95619-8642-42ed-8088-eab8cf784cc9 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:34.998437 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a716eeb-da86-493a-8611-1efa1e1ada36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:35.000420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a716eeb-da86-493a-8611-1efa1e1ada36 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:35.000420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a716eeb-da86-493a-8611-1efa1e1ada36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:35.000420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a716eeb-da86-493a-8611-1efa1e1ada36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:35.000679 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a716eeb-da86-493a-8611-1efa1e1ada36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:35.002120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a716eeb-da86-493a-8611-1efa1e1ada36 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:35.013485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 954/1914] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:35.020073 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43a5eb-6608-4668-a8da-bbd91557151c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:35.030917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43a5eb-6608-4668-a8da-bbd91557151c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:35.039994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132f659-4ae4-4d4d-ba8a-215a254b57a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:35.039994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132f659-4ae4-4d4d-ba8a-215a254b57a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:35.039994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132f659-4ae4-4d4d-ba8a-215a254b57a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:35.039994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132f659-4ae4-4d4d-ba8a-215a254b57a1 admin admin] PATH_INFO: `/v3/projects/13919570aec34921be4fc40337a10b63/users/3ac348e3592148c3a18c694931306af9/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:35.055607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132f659-4ae4-4d4d-ba8a-215a254b57a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13919570aec34921be4fc40337a10b63, user_id=3ac348e3592148c3a18c694931306af9, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:35.058422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132f659-4ae4-4d4d-ba8a-215a254b57a1 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:35.142424 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 961/1915] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:35 2022] PUT /identity/v3/projects/13919570aec34921be4fc40337a10b63/users/3ac348e3592148c3a18c694931306af9/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:35.150462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95e7f-1ab6-4a17-bac1-ce27702f5d38 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:35.150795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95e7f-1ab6-4a17-bac1-ce27702f5d38 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:35.151072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e95e7f-1ab6-4a17-bac1-ce27702f5d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:35.178819 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-64e95e7f-1ab6-4a17-bac1-ce27702f5d38 None None] MFA Rules not processed for user `3ac348e3592148c3a18c694931306af9`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:35.183965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-64e95e7f-1ab6-4a17-bac1-ce27702f5d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:35.251440 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 955/1916] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:35.255978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132f659-4ae4-4d4d-ba8a-215a254b57a1 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:35.315567 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132f659-4ae4-4d4d-ba8a-215a254b57a1 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:35.320288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254046fc-483f-4aec-b4ac-8f4895932da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:35.320936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254046fc-483f-4aec-b4ac-8f4895932da5 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:35.321225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254046fc-483f-4aec-b4ac-8f4895932da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:35.321498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254046fc-483f-4aec-b4ac-8f4895932da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:35.322180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254046fc-483f-4aec-b4ac-8f4895932da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:35.324066 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254046fc-483f-4aec-b4ac-8f4895932da5 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:35.402034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 962/1917] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:35 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:35.406078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e95e7f-1ab6-4a17-bac1-ce27702f5d38 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:35.416588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e95e7f-1ab6-4a17-bac1-ce27702f5d38 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:35.472326 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2da8f5-866a-4e90-90ad-49787c4e0f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:35.473003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2da8f5-866a-4e90-90ad-49787c4e0f63 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:35.473284 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2da8f5-866a-4e90-90ad-49787c4e0f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:35.473560 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2da8f5-866a-4e90-90ad-49787c4e0f63 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:35.474251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2da8f5-866a-4e90-90ad-49787c4e0f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:35.476223 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2da8f5-866a-4e90-90ad-49787c4e0f63 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:35.563790 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 956/1918] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:35 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:35.571218 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254046fc-483f-4aec-b4ac-8f4895932da5 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:35.582061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254046fc-483f-4aec-b4ac-8f4895932da5 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:35.586790 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e8df1-5e3f-4e04-bdfe-df840f59e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:35.587450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e8df1-5e3f-4e04-bdfe-df840f59e4ad admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:35.587734 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e8df1-5e3f-4e04-bdfe-df840f59e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:35.588043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e8df1-5e3f-4e04-bdfe-df840f59e4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:35.588830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e8df1-5e3f-4e04-bdfe-df840f59e4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:35.590515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e8df1-5e3f-4e04-bdfe-df840f59e4ad admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:35.601675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 963/1919] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:35.606395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2da8f5-866a-4e90-90ad-49787c4e0f63 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:35.617031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2da8f5-866a-4e90-90ad-49787c4e0f63 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:35.621976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e7f67-2dda-4815-b2e7-676c6c9f0d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:35.623230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e7f67-2dda-4815-b2e7-676c6c9f0d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:35.623835 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e7f67-2dda-4815-b2e7-676c6c9f0d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:35.624119 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e7f67-2dda-4815-b2e7-676c6c9f0d73 admin admin] PATH_INFO: `/v3/projects/572a6ea31a8749dfb28e0bb28fb0ac52/users/511af33c2a7d42a88dfba9eea2803b6c/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:35.642783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e7f67-2dda-4815-b2e7-676c6c9f0d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572a6ea31a8749dfb28e0bb28fb0ac52, user_id=511af33c2a7d42a88dfba9eea2803b6c, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:35.645207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e7f67-2dda-4815-b2e7-676c6c9f0d73 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:35.746192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 957/1920] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:35 2022] PUT /identity/v3/projects/572a6ea31a8749dfb28e0bb28fb0ac52/users/511af33c2a7d42a88dfba9eea2803b6c/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:35.750077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e8df1-5e3f-4e04-bdfe-df840f59e4ad admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:35.760484 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e8df1-5e3f-4e04-bdfe-df840f59e4ad admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:35.814681 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbce89d-0c1d-44ac-bc5d-08789016b708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:35.815344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbce89d-0c1d-44ac-bc5d-08789016b708 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:35.815624 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbce89d-0c1d-44ac-bc5d-08789016b708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:35.815898 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbce89d-0c1d-44ac-bc5d-08789016b708 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:35.816652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbce89d-0c1d-44ac-bc5d-08789016b708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:35.818238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbce89d-0c1d-44ac-bc5d-08789016b708 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:35.833632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 964/1921] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:35.837742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e7f67-2dda-4815-b2e7-676c6c9f0d73 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:35.848409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e7f67-2dda-4815-b2e7-676c6c9f0d73 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:35.853069 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663a5fd-93d7-4774-8b5c-753baf770222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:35.853941 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663a5fd-93d7-4774-8b5c-753baf770222 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:35.854223 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663a5fd-93d7-4774-8b5c-753baf770222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:35.854498 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663a5fd-93d7-4774-8b5c-753baf770222 admin admin] PATH_INFO: `/v3/projects/572a6ea31a8749dfb28e0bb28fb0ac52/users/511af33c2a7d42a88dfba9eea2803b6c/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:35.856476 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663a5fd-93d7-4774-8b5c-753baf770222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572a6ea31a8749dfb28e0bb28fb0ac52, user_id=511af33c2a7d42a88dfba9eea2803b6c, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:35.859104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663a5fd-93d7-4774-8b5c-753baf770222 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:35.869095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 958/1922] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:35 2022] PUT /identity/v3/projects/572a6ea31a8749dfb28e0bb28fb0ac52/users/511af33c2a7d42a88dfba9eea2803b6c/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:35.880839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908595e5-da85-4777-ac23-77326033c012 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:35.882075 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908595e5-da85-4777-ac23-77326033c012 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:35.882075 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908595e5-da85-4777-ac23-77326033c012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:35.908225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-908595e5-da85-4777-ac23-77326033c012 None None] MFA Rules not processed for user `511af33c2a7d42a88dfba9eea2803b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:35.909507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-908595e5-da85-4777-ac23-77326033c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:35.974286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 965/1923] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:35.985315 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663a5fd-93d7-4774-8b5c-753baf770222 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:35.987026 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2663a5fd-93d7-4774-8b5c-753baf770222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:36.041686 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663a5fd-93d7-4774-8b5c-753baf770222 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:36.045309 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deea45-8900-482b-a382-93bb9c44113c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:36.045933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deea45-8900-482b-a382-93bb9c44113c service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:36.046213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deea45-8900-482b-a382-93bb9c44113c service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:36.046487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deea45-8900-482b-a382-93bb9c44113c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:36.099784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49deea45-8900-482b-a382-93bb9c44113c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:36.101261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49deea45-8900-482b-a382-93bb9c44113c service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:36.110841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 959/1924] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:44.992746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908595e5-da85-4777-ac23-77326033c012 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:44.994135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-908595e5-da85-4777-ac23-77326033c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:45.006385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908595e5-da85-4777-ac23-77326033c012 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:45.010013 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f719f-913b-4c39-8a0d-c0bf7c4d3201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:45.010650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f719f-913b-4c39-8a0d-c0bf7c4d3201 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:45.010934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f719f-913b-4c39-8a0d-c0bf7c4d3201 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:45.011213 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f719f-913b-4c39-8a0d-c0bf7c4d3201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:45.021438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f719f-913b-4c39-8a0d-c0bf7c4d3201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:45.022989 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f719f-913b-4c39-8a0d-c0bf7c4d3201 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:45.034001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 966/1925] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:48.289032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deea45-8900-482b-a382-93bb9c44113c service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:48.290597 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-49deea45-8900-482b-a382-93bb9c44113c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:48.353862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deea45-8900-482b-a382-93bb9c44113c service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:48.358514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:48.359387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:48.359690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:48.359993 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] PATH_INFO: `/v3/users/b19643274a0c4d81b3c5e4632a19490a` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:48.361305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19643274a0c4d81b3c5e4632a19490a)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:48.363257 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:48.552945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19643274a0c4d81b3c5e4632a19490a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:48.686123 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19643274a0c4d81b3c5e4632a19490a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:48.699042 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19643274a0c4d81b3c5e4632a19490a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:48.699675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19643274a0c4d81b3c5e4632a19490a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:48.706772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19643274a0c4d81b3c5e4632a19490a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:48.712461 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 960/1926] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:48 2022] DELETE /identity/v3/users/b19643274a0c4d81b3c5e4632a19490a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:48.717011 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c24de-3155-4365-aeae-cbe991998d3c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:48.717485 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c24de-3155-4365-aeae-cbe991998d3c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:48.717577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c24de-3155-4365-aeae-cbe991998d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:48.734864 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-eb8c24de-3155-4365-aeae-cbe991998d3c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:48.736068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-eb8c24de-3155-4365-aeae-cbe991998d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:48.794191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 967/1927] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:48.804707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:48.806072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:48.862586 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1d523-b0ec-4a57-ba0c-5580b228741e admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:48.866158 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c51ff-5e7e-49ba-ad5b-6339c04195e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:48.866804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c51ff-5e7e-49ba-ad5b-6339c04195e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:48.867081 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c51ff-5e7e-49ba-ad5b-6339c04195e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:48.867352 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c51ff-5e7e-49ba-ad5b-6339c04195e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:48.876912 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c51ff-5e7e-49ba-ad5b-6339c04195e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:48.878353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c51ff-5e7e-49ba-ad5b-6339c04195e2 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:48.888448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 961/1928] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:49.299843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c24de-3155-4365-aeae-cbe991998d3c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:49.301296 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-eb8c24de-3155-4365-aeae-cbe991998d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:49.315164 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c24de-3155-4365-aeae-cbe991998d3c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:49.320099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:49.321112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:49.321396 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:49.321671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] PATH_INFO: `/v3/projects/f5acc4db97534b5596ce5b75dde79609` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:49.322864 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5acc4db97534b5596ce5b75dde79609)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:49.324824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:49.446775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5acc4db97534b5596ce5b75dde79609', 'request_id': 'req-3e87ffdb-2906-4c99-8af5-cd43317d03e0'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:49.452365 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5acc4db97534b5596ce5b75dde79609', 'request_id': 'req-3e87ffdb-2906-4c99-8af5-cd43317d03e0'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:49.545000 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5acc4db97534b5596ce5b75dde79609', 'request_id': 'req-3e87ffdb-2906-4c99-8af5-cd43317d03e0'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:49.556856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] The token cache is being invalidate because project f5acc4db97534b5596ce5b75dde79609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:49.557143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:49.557769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:49.559329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 968/1929] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:49 2022] DELETE /identity/v3/projects/f5acc4db97534b5596ce5b75dde79609 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:49.563740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c51ff-5e7e-49ba-ad5b-6339c04195e2 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:49.574356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c51ff-5e7e-49ba-ad5b-6339c04195e2 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:49.629319 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315b3d6-1492-4681-b13e-610047df1426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:49.630223 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315b3d6-1492-4681-b13e-610047df1426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:49.630505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315b3d6-1492-4681-b13e-610047df1426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:49.630782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315b3d6-1492-4681-b13e-610047df1426 admin admin] PATH_INFO: `/v3/users/d8f2b568582848b09b65497f14355b6e` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:49.632065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315b3d6-1492-4681-b13e-610047df1426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f2b568582848b09b65497f14355b6e)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:49.634368 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315b3d6-1492-4681-b13e-610047df1426 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:49.838664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b315b3d6-1492-4681-b13e-610047df1426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f2b568582848b09b65497f14355b6e'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:49.897384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b315b3d6-1492-4681-b13e-610047df1426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f2b568582848b09b65497f14355b6e'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:49.914010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b315b3d6-1492-4681-b13e-610047df1426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f2b568582848b09b65497f14355b6e'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:49.914753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b315b3d6-1492-4681-b13e-610047df1426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f2b568582848b09b65497f14355b6e'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:49.922039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b315b3d6-1492-4681-b13e-610047df1426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f2b568582848b09b65497f14355b6e'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:49.932895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 962/1930] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:49 2022] DELETE /identity/v3/users/d8f2b568582848b09b65497f14355b6e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:50.403735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:50.405215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:50.419848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87ffdb-2906-4c99-8af5-cd43317d03e0 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:50.476999 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7b34e-f597-440d-abb3-4fb94be5f809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:50.477965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7b34e-f597-440d-abb3-4fb94be5f809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:50.478251 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7b34e-f597-440d-abb3-4fb94be5f809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:50.478531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7b34e-f597-440d-abb3-4fb94be5f809 admin admin] PATH_INFO: `/v3/projects/3c91dc5a59934f20847d2a43dbb919c5` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:50.479844 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7b34e-f597-440d-abb3-4fb94be5f809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c91dc5a59934f20847d2a43dbb919c5)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:50.481767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7b34e-f597-440d-abb3-4fb94be5f809 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:50.603677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32b7b34e-f597-440d-abb3-4fb94be5f809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c91dc5a59934f20847d2a43dbb919c5', 'request_id': 'req-32b7b34e-f597-440d-abb3-4fb94be5f809'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:50.609291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32b7b34e-f597-440d-abb3-4fb94be5f809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c91dc5a59934f20847d2a43dbb919c5', 'request_id': 'req-32b7b34e-f597-440d-abb3-4fb94be5f809'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:50.705094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32b7b34e-f597-440d-abb3-4fb94be5f809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c91dc5a59934f20847d2a43dbb919c5', 'request_id': 'req-32b7b34e-f597-440d-abb3-4fb94be5f809'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:50.719469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32b7b34e-f597-440d-abb3-4fb94be5f809 admin admin] The token cache is being invalidate because project 3c91dc5a59934f20847d2a43dbb919c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:50.719769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32b7b34e-f597-440d-abb3-4fb94be5f809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:50.720448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32b7b34e-f597-440d-abb3-4fb94be5f809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:50.725587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 969/1931] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:50 2022] DELETE /identity/v3/projects/3c91dc5a59934f20847d2a43dbb919c5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:50.727406 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e33f4-1db1-4d58-829b-b38e6db02483 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:50.728362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e33f4-1db1-4d58-829b-b38e6db02483 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:50.728718 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e33f4-1db1-4d58-829b-b38e6db02483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:50.747087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-013e33f4-1db1-4d58-829b-b38e6db02483 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:50.748540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-013e33f4-1db1-4d58-829b-b38e6db02483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:50.809009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 963/1932] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:50.817666 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0686a-5985-4f6d-a9ed-d560003ce3c7 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:50.817960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0686a-5985-4f6d-a9ed-d560003ce3c7 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:50.818246 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0686a-5985-4f6d-a9ed-d560003ce3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:50.837161 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-30e0686a-5985-4f6d-a9ed-d560003ce3c7 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:50.838400 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-30e0686a-5985-4f6d-a9ed-d560003ce3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:50.846607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 970/1933] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:50.852260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e33f4-1db1-4d58-829b-b38e6db02483 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:50.860637 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e33f4-1db1-4d58-829b-b38e6db02483 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:50.866449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b17c9-7e02-4ab7-93be-056202af9b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:50.867101 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b17c9-7e02-4ab7-93be-056202af9b66 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:50.867386 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b17c9-7e02-4ab7-93be-056202af9b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:50.867660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b17c9-7e02-4ab7-93be-056202af9b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:50.868418 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b17c9-7e02-4ab7-93be-056202af9b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:50.868725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b17c9-7e02-4ab7-93be-056202af9b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:50.870324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b17c9-7e02-4ab7-93be-056202af9b66 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:50.883496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 964/1934] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:50.887809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0686a-5985-4f6d-a9ed-d560003ce3c7 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:50.897758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0686a-5985-4f6d-a9ed-d560003ce3c7 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:50.902524 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd12c6c-0f12-45ee-a983-60720957f62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:50.903167 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd12c6c-0f12-45ee-a983-60720957f62f admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:50.903798 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd12c6c-0f12-45ee-a983-60720957f62f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:50.904091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd12c6c-0f12-45ee-a983-60720957f62f admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:50.904819 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd12c6c-0f12-45ee-a983-60720957f62f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:50.907325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd12c6c-0f12-45ee-a983-60720957f62f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:50.992549 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 971/1935] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:50 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:50.995340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b17c9-7e02-4ab7-93be-056202af9b66 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:51.005786 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b17c9-7e02-4ab7-93be-056202af9b66 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:51.064878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d9703-afe9-4987-828c-ee06add20a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:51.065706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d9703-afe9-4987-828c-ee06add20a50 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:51.065873 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d9703-afe9-4987-828c-ee06add20a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:51.066226 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d9703-afe9-4987-828c-ee06add20a50 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:51.067533 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d9703-afe9-4987-828c-ee06add20a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:51.069534 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d9703-afe9-4987-828c-ee06add20a50 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:51.211569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 965/1936] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:50 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:51.215393 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd12c6c-0f12-45ee-a983-60720957f62f admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:51.226715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd12c6c-0f12-45ee-a983-60720957f62f admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:51.231610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf4fef-8b79-493c-a655-05df04ad68ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:51.232388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf4fef-8b79-493c-a655-05df04ad68ff admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:51.237564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf4fef-8b79-493c-a655-05df04ad68ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:51.237564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf4fef-8b79-493c-a655-05df04ad68ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:51.237564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf4fef-8b79-493c-a655-05df04ad68ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:51.237564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf4fef-8b79-493c-a655-05df04ad68ff admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:51.250346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 972/1937] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:51.251609 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d9703-afe9-4987-828c-ee06add20a50 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:51.261602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d9703-afe9-4987-828c-ee06add20a50 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:51.265393 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf4fef-8b79-493c-a655-05df04ad68ff admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:51.266996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-92cf4fef-8b79-493c-a655-05df04ad68ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:51.267117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d78a5-7ddf-4a33-9538-9fb6b1e14667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:51.267784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d78a5-7ddf-4a33-9538-9fb6b1e14667 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:51.268064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d78a5-7ddf-4a33-9538-9fb6b1e14667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:51.268371 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d78a5-7ddf-4a33-9538-9fb6b1e14667 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:51.269091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d78a5-7ddf-4a33-9538-9fb6b1e14667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:51.270674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d78a5-7ddf-4a33-9538-9fb6b1e14667 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:51.279297 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf4fef-8b79-493c-a655-05df04ad68ff admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:51.281172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 966/1938] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:51.284751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b45d8f-9d0f-472a-81a3-e7c45adec44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:51.285677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b45d8f-9d0f-472a-81a3-e7c45adec44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:51.285957 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b45d8f-9d0f-472a-81a3-e7c45adec44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:51.286228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b45d8f-9d0f-472a-81a3-e7c45adec44a admin admin] PATH_INFO: `/v3/users/3ac348e3592148c3a18c694931306af9` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:51.287465 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b45d8f-9d0f-472a-81a3-e7c45adec44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac348e3592148c3a18c694931306af9)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:51.287986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d78a5-7ddf-4a33-9538-9fb6b1e14667 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:51.289409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b45d8f-9d0f-472a-81a3-e7c45adec44a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:51.297528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d78a5-7ddf-4a33-9538-9fb6b1e14667 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:51.304834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ebaa7-83a6-4af4-a15a-a622bc3c2651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:51.306329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ebaa7-83a6-4af4-a15a-a622bc3c2651 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:51.306706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ebaa7-83a6-4af4-a15a-a622bc3c2651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:51.306991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ebaa7-83a6-4af4-a15a-a622bc3c2651 admin admin] PATH_INFO: `/v3/projects/13c9be684a244b939e679a70d63ef473/users/3a3510f12c4242c695d55c3e2bc4e03b/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:51.323477 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ebaa7-83a6-4af4-a15a-a622bc3c2651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c9be684a244b939e679a70d63ef473, user_id=3a3510f12c4242c695d55c3e2bc4e03b, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:51.326203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ebaa7-83a6-4af4-a15a-a622bc3c2651 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:51.419068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 967/1939] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:51 2022] PUT /identity/v3/projects/13c9be684a244b939e679a70d63ef473/users/3a3510f12c4242c695d55c3e2bc4e03b/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:51.425252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393f501-4a18-47d1-802e-41c12a7f2338 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:51.425581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393f501-4a18-47d1-802e-41c12a7f2338 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:51.425865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393f501-4a18-47d1-802e-41c12a7f2338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:51.456675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-1393f501-4a18-47d1-802e-41c12a7f2338 None None] MFA Rules not processed for user `3a3510f12c4242c695d55c3e2bc4e03b`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:51.457877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1393f501-4a18-47d1-802e-41c12a7f2338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:51.481881 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d8b45d8f-9d0f-472a-81a3-e7c45adec44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac348e3592148c3a18c694931306af9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:51.482894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d8b45d8f-9d0f-472a-81a3-e7c45adec44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac348e3592148c3a18c694931306af9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:51.523645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 968/1940] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:51.526648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393f501-4a18-47d1-802e-41c12a7f2338 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:51.528019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1393f501-4a18-47d1-802e-41c12a7f2338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:51.554650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d8b45d8f-9d0f-472a-81a3-e7c45adec44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac348e3592148c3a18c694931306af9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:51.555698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d8b45d8f-9d0f-472a-81a3-e7c45adec44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac348e3592148c3a18c694931306af9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:51.591649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d8b45d8f-9d0f-472a-81a3-e7c45adec44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac348e3592148c3a18c694931306af9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:51.615615 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393f501-4a18-47d1-802e-41c12a7f2338 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:51.620672 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 973/1941] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:51 2022] DELETE /identity/v3/users/3ac348e3592148c3a18c694931306af9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:51.623289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bc2b9-4e69-4874-810d-4f224a727c1e None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:51.623628 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bc2b9-4e69-4874-810d-4f224a727c1e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:51.624635 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bc2b9-4e69-4874-810d-4f224a727c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:51.652274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-608bc2b9-4e69-4874-810d-4f224a727c1e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:51.653493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-608bc2b9-4e69-4874-810d-4f224a727c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:51.685479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb27058-1ab0-4cad-b555-ab327d630ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:51.687484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb27058-1ab0-4cad-b555-ab327d630ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:51.687932 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb27058-1ab0-4cad-b555-ab327d630ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:51.688563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb27058-1ab0-4cad-b555-ab327d630ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:51.689480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb27058-1ab0-4cad-b555-ab327d630ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:51.691203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb27058-1ab0-4cad-b555-ab327d630ed8 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:51.721956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 974/1942] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:51.733022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bc2b9-4e69-4874-810d-4f224a727c1e None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:51.734939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-608bc2b9-4e69-4874-810d-4f224a727c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:51.797138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bc2b9-4e69-4874-810d-4f224a727c1e None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:51.801199 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e11be-d60f-4b54-a08e-af9c71b5ab17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:51.801866 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e11be-d60f-4b54-a08e-af9c71b5ab17 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:51.802153 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e11be-d60f-4b54-a08e-af9c71b5ab17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:51.802501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e11be-d60f-4b54-a08e-af9c71b5ab17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:51.804763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 969/1943] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:51 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:51.808672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb27058-1ab0-4cad-b555-ab327d630ed8 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:51.813428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e11be-d60f-4b54-a08e-af9c71b5ab17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:51.814860 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e11be-d60f-4b54-a08e-af9c71b5ab17 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:51.825326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 975/1944] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:39:51.879050 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb27058-1ab0-4cad-b555-ab327d630ed8 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:51.886339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86a0b6-f40f-443b-b743-0984429fcc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:51.887283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86a0b6-f40f-443b-b743-0984429fcc56 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:51.890626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86a0b6-f40f-443b-b743-0984429fcc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:51.890626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86a0b6-f40f-443b-b743-0984429fcc56 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:51.890626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86a0b6-f40f-443b-b743-0984429fcc56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:51.891572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86a0b6-f40f-443b-b743-0984429fcc56 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:51.986160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 970/1945] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:51 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:51.990227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e11be-d60f-4b54-a08e-af9c71b5ab17 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:52.001527 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e11be-d60f-4b54-a08e-af9c71b5ab17 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:52.006235 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c0a3e-b86a-445a-8fa0-9b0d9d0d412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:52.006933 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c0a3e-b86a-445a-8fa0-9b0d9d0d412a admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:52.007217 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c0a3e-b86a-445a-8fa0-9b0d9d0d412a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:52.007496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c0a3e-b86a-445a-8fa0-9b0d9d0d412a admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:52.008352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c0a3e-b86a-445a-8fa0-9b0d9d0d412a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:52.009966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c0a3e-b86a-445a-8fa0-9b0d9d0d412a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:52.020318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 976/1946] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:52.024578 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86a0b6-f40f-443b-b743-0984429fcc56 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:52.035032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86a0b6-f40f-443b-b743-0984429fcc56 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:52.040992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3d944-2eba-4088-9d17-72e904ed71a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:52.042414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d944-2eba-4088-9d17-72e904ed71a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:52.042702 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d944-2eba-4088-9d17-72e904ed71a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:52.042979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d944-2eba-4088-9d17-72e904ed71a6 admin admin] PATH_INFO: `/v3/projects/d318c198ac144b918af57061cb00bb40/users/2c968bdee9d94681be02cb8e2489b78f/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:52.065512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3d944-2eba-4088-9d17-72e904ed71a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d318c198ac144b918af57061cb00bb40, user_id=2c968bdee9d94681be02cb8e2489b78f, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:52.068512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3d944-2eba-4088-9d17-72e904ed71a6 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:52.154979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 971/1947] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:52 2022] PUT /identity/v3/projects/d318c198ac144b918af57061cb00bb40/users/2c968bdee9d94681be02cb8e2489b78f/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:52.159504 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c0a3e-b86a-445a-8fa0-9b0d9d0d412a admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:52.175434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c0a3e-b86a-445a-8fa0-9b0d9d0d412a admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:52.231645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103454f-103b-4ead-b187-9f066117d7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:52.232508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103454f-103b-4ead-b187-9f066117d7bd admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:52.238302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103454f-103b-4ead-b187-9f066117d7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:52.238302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103454f-103b-4ead-b187-9f066117d7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:52.238302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103454f-103b-4ead-b187-9f066117d7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:52.238302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103454f-103b-4ead-b187-9f066117d7bd admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:52.238621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3d944-2eba-4088-9d17-72e904ed71a6 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:52.238621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-90d3d944-2eba-4088-9d17-72e904ed71a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:52.248193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 977/1948] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:52.250000 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103454f-103b-4ead-b187-9f066117d7bd admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:52.251868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3d944-2eba-4088-9d17-72e904ed71a6 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:52.260388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:52.261265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:52.261467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103454f-103b-4ead-b187-9f066117d7bd admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:52.261554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:52.261815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] PATH_INFO: `/v3/projects/13919570aec34921be4fc40337a10b63` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:52.263505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=13919570aec34921be4fc40337a10b63)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:52.267249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ca2a7-3303-4585-a1c0-1e416dcddbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:52.268207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca2a7-3303-4585-a1c0-1e416dcddbca admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:52.268508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca2a7-3303-4585-a1c0-1e416dcddbca admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:52.268785 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ca2a7-3303-4585-a1c0-1e416dcddbca admin admin] PATH_INFO: `/v3/projects/d318c198ac144b918af57061cb00bb40/users/2c968bdee9d94681be02cb8e2489b78f/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:52.270821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ca2a7-3303-4585-a1c0-1e416dcddbca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d318c198ac144b918af57061cb00bb40, user_id=2c968bdee9d94681be02cb8e2489b78f, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:52.273514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:52.273708 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ca2a7-3303-4585-a1c0-1e416dcddbca admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:52.284992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 978/1949] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:52 2022] PUT /identity/v3/projects/d318c198ac144b918af57061cb00bb40/users/2c968bdee9d94681be02cb8e2489b78f/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:52.295735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c97d6d-3371-46a4-96fd-23dfa9629637 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:52.296058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c97d6d-3371-46a4-96fd-23dfa9629637 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:52.296371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c97d6d-3371-46a4-96fd-23dfa9629637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:52.324666 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-01c97d6d-3371-46a4-96fd-23dfa9629637 None None] MFA Rules not processed for user `2c968bdee9d94681be02cb8e2489b78f`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:52.325869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-01c97d6d-3371-46a4-96fd-23dfa9629637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:52.391956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 979/1950] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:52.403612 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c97d6d-3371-46a4-96fd-23dfa9629637 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:52.405605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-01c97d6d-3371-46a4-96fd-23dfa9629637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:52.407639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13919570aec34921be4fc40337a10b63', 'request_id': 'req-392fdea0-c756-4fcf-b36c-4d69005908cd'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.413045 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13919570aec34921be4fc40337a10b63', 'request_id': 'req-392fdea0-c756-4fcf-b36c-4d69005908cd'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.419281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13919570aec34921be4fc40337a10b63', 'request_id': 'req-392fdea0-c756-4fcf-b36c-4d69005908cd'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.460743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c97d6d-3371-46a4-96fd-23dfa9629637 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:52.496587 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] The token cache is being invalidate because project 13919570aec34921be4fc40337a10b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:52.497028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.497761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.499354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 972/1951] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:52 2022] DELETE /identity/v3/projects/13919570aec34921be4fc40337a10b63 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:52.503286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:52.504612 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:52.507728 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923862b9-66c2-4889-ae53-feb68bf8b646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:52.508411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923862b9-66c2-4889-ae53-feb68bf8b646 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:52.508698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923862b9-66c2-4889-ae53-feb68bf8b646 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:52.508971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923862b9-66c2-4889-ae53-feb68bf8b646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:52.511506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-923862b9-66c2-4889-ae53-feb68bf8b646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:52.570218 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fdea0-c756-4fcf-b36c-4d69005908cd admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:52.573357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923862b9-66c2-4889-ae53-feb68bf8b646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:52.574898 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923862b9-66c2-4889-ae53-feb68bf8b646 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:52.575025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11166584-fbb5-4795-b314-7256051dda40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:52.575960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11166584-fbb5-4795-b314-7256051dda40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:52.576340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11166584-fbb5-4795-b314-7256051dda40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:52.576618 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11166584-fbb5-4795-b314-7256051dda40 admin admin] PATH_INFO: `/v3/users/511af33c2a7d42a88dfba9eea2803b6c` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:52.577865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11166584-fbb5-4795-b314-7256051dda40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=511af33c2a7d42a88dfba9eea2803b6c)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:52.581052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11166584-fbb5-4795-b314-7256051dda40 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:52.585903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 980/1952] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:39:52.614339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923862b9-66c2-4889-ae53-feb68bf8b646 service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:52.615985 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-923862b9-66c2-4889-ae53-feb68bf8b646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:52.628948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923862b9-66c2-4889-ae53-feb68bf8b646 service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:52.633680 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:52.634537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:52.634826 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:52.635110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] PATH_INFO: `/v3/users/3a3510f12c4242c695d55c3e2bc4e03b` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:52.636343 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3510f12c4242c695d55c3e2bc4e03b)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:52.638265 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:52.802931 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-11166584-fbb5-4795-b314-7256051dda40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '511af33c2a7d42a88dfba9eea2803b6c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.882076 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3510f12c4242c695d55c3e2bc4e03b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.884934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3510f12c4242c695d55c3e2bc4e03b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.892669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-11166584-fbb5-4795-b314-7256051dda40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '511af33c2a7d42a88dfba9eea2803b6c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.904926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-11166584-fbb5-4795-b314-7256051dda40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '511af33c2a7d42a88dfba9eea2803b6c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.906255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-11166584-fbb5-4795-b314-7256051dda40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '511af33c2a7d42a88dfba9eea2803b6c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.912855 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-11166584-fbb5-4795-b314-7256051dda40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '511af33c2a7d42a88dfba9eea2803b6c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.918698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 973/1953] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:52 2022] DELETE /identity/v3/users/511af33c2a7d42a88dfba9eea2803b6c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:52.971460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3510f12c4242c695d55c3e2bc4e03b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.972160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3510f12c4242c695d55c3e2bc4e03b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.985701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3510f12c4242c695d55c3e2bc4e03b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:52.997934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 981/1954] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:52 2022] DELETE /identity/v3/users/3a3510f12c4242c695d55c3e2bc4e03b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:53.002407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0f00e-465e-4ce2-a4b8-86a14d93b0f2 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:53.002706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0f00e-465e-4ce2-a4b8-86a14d93b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:53.002985 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0f00e-465e-4ce2-a4b8-86a14d93b0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:53.020407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b9f0f00e-465e-4ce2-a4b8-86a14d93b0f2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:53.021611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b9f0f00e-465e-4ce2-a4b8-86a14d93b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:53.081898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 974/1955] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:53.091594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:53.093292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:53.160271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06b99a-f227-4287-8c82-99eb114b5b50 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:53.166392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc778770-08ef-4db3-873d-f1f213de2f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:53.171288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc778770-08ef-4db3-873d-f1f213de2f0f service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:53.171288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc778770-08ef-4db3-873d-f1f213de2f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:53.171288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc778770-08ef-4db3-873d-f1f213de2f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:53.178562 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc778770-08ef-4db3-873d-f1f213de2f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:53.180024 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc778770-08ef-4db3-873d-f1f213de2f0f service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:53.190790 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 982/1956] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:39:53.428584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0f00e-465e-4ce2-a4b8-86a14d93b0f2 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:53.430055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b9f0f00e-465e-4ce2-a4b8-86a14d93b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:53.444366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0f00e-465e-4ce2-a4b8-86a14d93b0f2 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:53.452935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fce28b-ba38-42bd-be5d-976aec6d6d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:53.453911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fce28b-ba38-42bd-be5d-976aec6d6d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:53.454213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fce28b-ba38-42bd-be5d-976aec6d6d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:53.454510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fce28b-ba38-42bd-be5d-976aec6d6d28 admin admin] PATH_INFO: `/v3/projects/572a6ea31a8749dfb28e0bb28fb0ac52` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:53.455796 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fce28b-ba38-42bd-be5d-976aec6d6d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572a6ea31a8749dfb28e0bb28fb0ac52)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:53.457899 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fce28b-ba38-42bd-be5d-976aec6d6d28 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:53.594893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-54fce28b-ba38-42bd-be5d-976aec6d6d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572a6ea31a8749dfb28e0bb28fb0ac52', 'request_id': 'req-54fce28b-ba38-42bd-be5d-976aec6d6d28'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:53.600548 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-54fce28b-ba38-42bd-be5d-976aec6d6d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572a6ea31a8749dfb28e0bb28fb0ac52', 'request_id': 'req-54fce28b-ba38-42bd-be5d-976aec6d6d28'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:53.606747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-54fce28b-ba38-42bd-be5d-976aec6d6d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572a6ea31a8749dfb28e0bb28fb0ac52', 'request_id': 'req-54fce28b-ba38-42bd-be5d-976aec6d6d28'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:53.626902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc778770-08ef-4db3-873d-f1f213de2f0f service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:53.630303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-fc778770-08ef-4db3-873d-f1f213de2f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:53.662623 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc778770-08ef-4db3-873d-f1f213de2f0f service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:53.692685 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-54fce28b-ba38-42bd-be5d-976aec6d6d28 admin admin] The token cache is being invalidate because project 572a6ea31a8749dfb28e0bb28fb0ac52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:53.693008 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-54fce28b-ba38-42bd-be5d-976aec6d6d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:53.694802 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-54fce28b-ba38-42bd-be5d-976aec6d6d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:53.696397 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 975/1957] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:53 2022] DELETE /identity/v3/projects/572a6ea31a8749dfb28e0bb28fb0ac52 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:53.702400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff92f9e-3ede-491e-8561-6a19a793dbb4 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:53.702687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff92f9e-3ede-491e-8561-6a19a793dbb4 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:53.702972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff92f9e-3ede-491e-8561-6a19a793dbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:53.723758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:53.725191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-eff92f9e-3ede-491e-8561-6a19a793dbb4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:53.727597 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-eff92f9e-3ede-491e-8561-6a19a793dbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:53.728874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:53.729170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:53.730491 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] PATH_INFO: `/v3/projects/13c9be684a244b939e679a70d63ef473` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:53.732031 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c9be684a244b939e679a70d63ef473)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:53.734678 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:53.746217 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 976/1958] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:53.748804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73703f-2251-4124-98ae-5c452ebfe187 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:53.750234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73703f-2251-4124-98ae-5c452ebfe187 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:53.753962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73703f-2251-4124-98ae-5c452ebfe187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:53.773765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ce73703f-2251-4124-98ae-5c452ebfe187 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:53.775000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ce73703f-2251-4124-98ae-5c452ebfe187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:53.787470 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 977/1959] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:53.792630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73703f-2251-4124-98ae-5c452ebfe187 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:53.802692 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73703f-2251-4124-98ae-5c452ebfe187 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:53.809217 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6b1d-26bd-44e9-9e0e-14658b3763b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:53.812277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6b1d-26bd-44e9-9e0e-14658b3763b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:53.812277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6b1d-26bd-44e9-9e0e-14658b3763b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:53.812277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6b1d-26bd-44e9-9e0e-14658b3763b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:53.812277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6b1d-26bd-44e9-9e0e-14658b3763b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:53.812570 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6b1d-26bd-44e9-9e0e-14658b3763b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:53.814112 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6b1d-26bd-44e9-9e0e-14658b3763b1 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:53.832257 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 978/1960] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:39:53.834568 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6b1d-26bd-44e9-9e0e-14658b3763b1 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:53.844538 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6b1d-26bd-44e9-9e0e-14658b3763b1 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:53.850290 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4204d-1d0b-43e4-82cc-e6bcb78ac79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:53.851886 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4204d-1d0b-43e4-82cc-e6bcb78ac79d admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:53.852191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4204d-1d0b-43e4-82cc-e6bcb78ac79d admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:53.852470 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4204d-1d0b-43e4-82cc-e6bcb78ac79d admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:53.853168 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4204d-1d0b-43e4-82cc-e6bcb78ac79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:53.855233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4204d-1d0b-43e4-82cc-e6bcb78ac79d admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:53.877110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c9be684a244b939e679a70d63ef473', 'request_id': 'req-e1b54a95-6e15-4755-87eb-ea2854e57024'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:53.887178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c9be684a244b939e679a70d63ef473', 'request_id': 'req-e1b54a95-6e15-4755-87eb-ea2854e57024'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:54.059162 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 979/1961] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:53 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:54.076459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c9be684a244b939e679a70d63ef473', 'request_id': 'req-e1b54a95-6e15-4755-87eb-ea2854e57024'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:54.077486 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4204d-1d0b-43e4-82cc-e6bcb78ac79d admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:54.090157 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] The token cache is being invalidate because project 13c9be684a244b939e679a70d63ef473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:54.090821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:54.098051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:54.100172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 983/1962] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:53 2022] DELETE /identity/v3/projects/13c9be684a244b939e679a70d63ef473 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:54.104350 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:54.106621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:54.166907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4204d-1d0b-43e4-82cc-e6bcb78ac79d admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:54.174873 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3a179-eba1-450c-b032-3f332755b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:54.176126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a179-eba1-450c-b032-3f332755b8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:54.176634 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a179-eba1-450c-b032-3f332755b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:54.176914 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a179-eba1-450c-b032-3f332755b8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:54.177618 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3a179-eba1-450c-b032-3f332755b8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:54.179544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3a179-eba1-450c-b032-3f332755b8b0 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:54.198024 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b54a95-6e15-4755-87eb-ea2854e57024 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:54.200941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede9372-d81e-4129-b354-fa0527504ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:54.202432 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede9372-d81e-4129-b354-fa0527504ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:54.202782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede9372-d81e-4129-b354-fa0527504ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:54.203130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede9372-d81e-4129-b354-fa0527504ce4 admin admin] PATH_INFO: `/v3/users/2c968bdee9d94681be02cb8e2489b78f` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:54.204562 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede9372-d81e-4129-b354-fa0527504ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c968bdee9d94681be02cb8e2489b78f)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:54.206636 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede9372-d81e-4129-b354-fa0527504ce4 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:54.306184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 980/1963] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:54 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:54.307949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3a179-eba1-450c-b032-3f332755b8b0 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:54.309747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-bcf3a179-eba1-450c-b032-3f332755b8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:54.322207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3a179-eba1-450c-b032-3f332755b8b0 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:54.329496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28ce04-4446-4e0f-8342-95910e4d333b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:54.330168 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28ce04-4446-4e0f-8342-95910e4d333b admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:54.330586 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28ce04-4446-4e0f-8342-95910e4d333b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:54.330915 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28ce04-4446-4e0f-8342-95910e4d333b admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:54.331704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28ce04-4446-4e0f-8342-95910e4d333b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:54.333348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28ce04-4446-4e0f-8342-95910e4d333b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:54.348910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 981/1964] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:54.353951 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28ce04-4446-4e0f-8342-95910e4d333b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:54.363839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28ce04-4446-4e0f-8342-95910e4d333b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:54.366805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6829b-3623-4223-a5e8-c87389b999af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:54.367480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6829b-3623-4223-a5e8-c87389b999af admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:54.367826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6829b-3623-4223-a5e8-c87389b999af admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:54.368192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6829b-3623-4223-a5e8-c87389b999af admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:54.369151 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6829b-3623-4223-a5e8-c87389b999af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:54.378107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6829b-3623-4223-a5e8-c87389b999af admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:54.395879 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 982/1965] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:54.397125 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6829b-3623-4223-a5e8-c87389b999af admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:54.411822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6829b-3623-4223-a5e8-c87389b999af admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:54.417723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdf38d-e71d-40da-b83c-9ce9cfa8bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:54.422023 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf38d-e71d-40da-b83c-9ce9cfa8bc89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:54.422709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf38d-e71d-40da-b83c-9ce9cfa8bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:54.423002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf38d-e71d-40da-b83c-9ce9cfa8bc89 admin admin] PATH_INFO: `/v3/projects/2bb39c194e3546d0b9c9afbd3e27b345/users/133049c03baa4fe2a3cda02ed35b2d44/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:54.426717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-eede9372-d81e-4129-b354-fa0527504ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c968bdee9d94681be02cb8e2489b78f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:54.428928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-eede9372-d81e-4129-b354-fa0527504ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c968bdee9d94681be02cb8e2489b78f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:54.441996 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdf38d-e71d-40da-b83c-9ce9cfa8bc89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb39c194e3546d0b9c9afbd3e27b345, user_id=133049c03baa4fe2a3cda02ed35b2d44, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:54.444742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdf38d-e71d-40da-b83c-9ce9cfa8bc89 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:54.505030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-eede9372-d81e-4129-b354-fa0527504ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c968bdee9d94681be02cb8e2489b78f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:54.510940 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-eede9372-d81e-4129-b354-fa0527504ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c968bdee9d94681be02cb8e2489b78f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:54.519406 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-eede9372-d81e-4129-b354-fa0527504ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c968bdee9d94681be02cb8e2489b78f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:54.532988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 984/1966] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:54 2022] DELETE /identity/v3/users/2c968bdee9d94681be02cb8e2489b78f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:54.558634 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 983/1967] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:54 2022] PUT /identity/v3/projects/2bb39c194e3546d0b9c9afbd3e27b345/users/133049c03baa4fe2a3cda02ed35b2d44/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:54.571557 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a94d6-e3d6-442c-893d-693770f1ec63 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:54.572914 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a94d6-e3d6-442c-893d-693770f1ec63 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:54.573197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a94d6-e3d6-442c-893d-693770f1ec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:54.603402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-3c3a94d6-e3d6-442c-893d-693770f1ec63 None None] MFA Rules not processed for user `133049c03baa4fe2a3cda02ed35b2d44`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:54.609397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3c3a94d6-e3d6-442c-893d-693770f1ec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:54.698357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 985/1968] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:54.749382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdf38d-e71d-40da-b83c-9ce9cfa8bc89 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:54.750463 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-33cdf38d-e71d-40da-b83c-9ce9cfa8bc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:54.812354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdf38d-e71d-40da-b83c-9ce9cfa8bc89 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:54.816704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f087d72-d21e-4d39-ad5e-e1456efc4606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:54.817458 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f087d72-d21e-4d39-ad5e-e1456efc4606 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:54.817730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f087d72-d21e-4d39-ad5e-e1456efc4606 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:54.818008 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f087d72-d21e-4d39-ad5e-e1456efc4606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:54.827643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f087d72-d21e-4d39-ad5e-e1456efc4606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:54.833027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f087d72-d21e-4d39-ad5e-e1456efc4606 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:54.839362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 984/1969] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:55.060663 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a94d6-e3d6-442c-893d-693770f1ec63 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:55.062947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3c3a94d6-e3d6-442c-893d-693770f1ec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:55.133283 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a94d6-e3d6-442c-893d-693770f1ec63 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:55.138416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e670894-8e0d-4eee-a031-b4a15e2337c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:55.138976 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e670894-8e0d-4eee-a031-b4a15e2337c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:55.139259 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e670894-8e0d-4eee-a031-b4a15e2337c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:55.139534 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e670894-8e0d-4eee-a031-b4a15e2337c1 admin admin] PATH_INFO: `/v3/projects/d318c198ac144b918af57061cb00bb40` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:55.140758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e670894-8e0d-4eee-a031-b4a15e2337c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d318c198ac144b918af57061cb00bb40)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:55.142982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e670894-8e0d-4eee-a031-b4a15e2337c1 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:55.249221 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e670894-8e0d-4eee-a031-b4a15e2337c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd318c198ac144b918af57061cb00bb40', 'request_id': 'req-7e670894-8e0d-4eee-a031-b4a15e2337c1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:55.254656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e670894-8e0d-4eee-a031-b4a15e2337c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd318c198ac144b918af57061cb00bb40', 'request_id': 'req-7e670894-8e0d-4eee-a031-b4a15e2337c1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:55.310399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e670894-8e0d-4eee-a031-b4a15e2337c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd318c198ac144b918af57061cb00bb40', 'request_id': 'req-7e670894-8e0d-4eee-a031-b4a15e2337c1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:55.322464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e670894-8e0d-4eee-a031-b4a15e2337c1 admin admin] The token cache is being invalidate because project d318c198ac144b918af57061cb00bb40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:55.322756 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e670894-8e0d-4eee-a031-b4a15e2337c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:55.323403 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e670894-8e0d-4eee-a031-b4a15e2337c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:55.324962 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 986/1970] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:55 2022] DELETE /identity/v3/projects/d318c198ac144b918af57061cb00bb40 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:55.329830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084437-915d-4e52-a692-e414d3ebfcb6 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:55.330289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084437-915d-4e52-a692-e414d3ebfcb6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:55.330394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084437-915d-4e52-a692-e414d3ebfcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:55.348468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-bc084437-915d-4e52-a692-e414d3ebfcb6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:55.349659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-bc084437-915d-4e52-a692-e414d3ebfcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:55.408106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 985/1971] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:55.415816 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c67835-1bfa-4980-abd5-2781a2b4b10c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:55.418999 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c67835-1bfa-4980-abd5-2781a2b4b10c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:55.418999 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c67835-1bfa-4980-abd5-2781a2b4b10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:55.434760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c9c67835-1bfa-4980-abd5-2781a2b4b10c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:55.435949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c9c67835-1bfa-4980-abd5-2781a2b4b10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:55.444811 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 987/1972] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:55.452739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc084437-915d-4e52-a692-e414d3ebfcb6 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:55.461700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc084437-915d-4e52-a692-e414d3ebfcb6 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:55.466848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f168af-d37e-4f1c-a2f1-1d8e1b7f78d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:55.467510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f168af-d37e-4f1c-a2f1-1d8e1b7f78d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:55.468402 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f168af-d37e-4f1c-a2f1-1d8e1b7f78d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:55.468402 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f168af-d37e-4f1c-a2f1-1d8e1b7f78d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:55.468918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f168af-d37e-4f1c-a2f1-1d8e1b7f78d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:55.469227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f168af-d37e-4f1c-a2f1-1d8e1b7f78d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:55.470830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f168af-d37e-4f1c-a2f1-1d8e1b7f78d4 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:55.483041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 986/1973] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:55.487303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c67835-1bfa-4980-abd5-2781a2b4b10c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:55.496444 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c67835-1bfa-4980-abd5-2781a2b4b10c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:55.501809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf5b43-d90c-48a0-afb5-a5e5cb8e0802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:55.502392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf5b43-d90c-48a0-afb5-a5e5cb8e0802 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:55.502690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf5b43-d90c-48a0-afb5-a5e5cb8e0802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:55.502990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf5b43-d90c-48a0-afb5-a5e5cb8e0802 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:55.503695 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf5b43-d90c-48a0-afb5-a5e5cb8e0802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:55.505624 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf5b43-d90c-48a0-afb5-a5e5cb8e0802 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:55.533606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f168af-d37e-4f1c-a2f1-1d8e1b7f78d4 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:55.535527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b3f168af-d37e-4f1c-a2f1-1d8e1b7f78d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:55.548749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f168af-d37e-4f1c-a2f1-1d8e1b7f78d4 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:55.553656 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024c093-b6d3-4d04-a24c-be6f8679b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:55.554599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024c093-b6d3-4d04-a24c-be6f8679b30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:55.554950 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024c093-b6d3-4d04-a24c-be6f8679b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:55.555302 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024c093-b6d3-4d04-a24c-be6f8679b30d admin admin] PATH_INFO: `/v3/users/f37ae35ffff64c61addc8fc64eb441f1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:55.556740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024c093-b6d3-4d04-a24c-be6f8679b30d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37ae35ffff64c61addc8fc64eb441f1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:55.558812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024c093-b6d3-4d04-a24c-be6f8679b30d admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:55.603525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 988/1974] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:55 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:55.607519 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf5b43-d90c-48a0-afb5-a5e5cb8e0802 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:55.666891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf5b43-d90c-48a0-afb5-a5e5cb8e0802 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:55.671579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b791db-0287-4a03-8ebf-d25452211549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:55.672274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b791db-0287-4a03-8ebf-d25452211549 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:55.672561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b791db-0287-4a03-8ebf-d25452211549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:55.672839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b791db-0287-4a03-8ebf-d25452211549 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:55.673530 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b791db-0287-4a03-8ebf-d25452211549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:55.675435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b791db-0287-4a03-8ebf-d25452211549 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:55.746877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9024c093-b6d3-4d04-a24c-be6f8679b30d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37ae35ffff64c61addc8fc64eb441f1'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:55.830224 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 989/1975] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:55 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:55.834234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b791db-0287-4a03-8ebf-d25452211549 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:55.843378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b791db-0287-4a03-8ebf-d25452211549 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:55.847941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7afdaf-f95b-4b2b-8659-7eb542215cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:55.848603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7afdaf-f95b-4b2b-8659-7eb542215cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:55.848881 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7afdaf-f95b-4b2b-8659-7eb542215cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:55.849154 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7afdaf-f95b-4b2b-8659-7eb542215cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:55.849894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7afdaf-f95b-4b2b-8659-7eb542215cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:55.851453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7afdaf-f95b-4b2b-8659-7eb542215cb2 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:55.853729 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9024c093-b6d3-4d04-a24c-be6f8679b30d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37ae35ffff64c61addc8fc64eb441f1'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:55.861826 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 990/1976] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:55.865590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7afdaf-f95b-4b2b-8659-7eb542215cb2 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:55.866453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9024c093-b6d3-4d04-a24c-be6f8679b30d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37ae35ffff64c61addc8fc64eb441f1'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:55.867108 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9024c093-b6d3-4d04-a24c-be6f8679b30d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37ae35ffff64c61addc8fc64eb441f1'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:55.874890 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9024c093-b6d3-4d04-a24c-be6f8679b30d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37ae35ffff64c61addc8fc64eb441f1'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:55.875874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7afdaf-f95b-4b2b-8659-7eb542215cb2 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:55.886090 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca08f3-2648-4718-b801-82d9fa67f990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:55.886231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 987/1977] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:55 2022] DELETE /identity/v3/users/f37ae35ffff64c61addc8fc64eb441f1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:55.886325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca08f3-2648-4718-b801-82d9fa67f990 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:55.886325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca08f3-2648-4718-b801-82d9fa67f990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:55.886325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca08f3-2648-4718-b801-82d9fa67f990 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:55.886325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca08f3-2648-4718-b801-82d9fa67f990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:55.886325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca08f3-2648-4718-b801-82d9fa67f990 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:55.889334 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a8f47-ac4f-4d59-936f-a61660beb673 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:55.889712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a8f47-ac4f-4d59-936f-a61660beb673 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:55.889996 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a8f47-ac4f-4d59-936f-a61660beb673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:55.896780 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 991/1978] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:55.900546 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca08f3-2648-4718-b801-82d9fa67f990 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:55.902304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-1fca08f3-2648-4718-b801-82d9fa67f990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:55.907325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b62a8f47-ac4f-4d59-936f-a61660beb673 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:55.908506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b62a8f47-ac4f-4d59-936f-a61660beb673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:55.914856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca08f3-2648-4718-b801-82d9fa67f990 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:55.968495 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 988/1979] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:55.975433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de46d8-cea6-44d2-b739-bbe5674a3bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:55.976365 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de46d8-cea6-44d2-b739-bbe5674a3bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:55.976724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de46d8-cea6-44d2-b739-bbe5674a3bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:55.977077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de46d8-cea6-44d2-b739-bbe5674a3bfa admin admin] PATH_INFO: `/v3/projects/fa4dc4f8a5d8460e980abc55bfd85431/users/5d84b64852024d0f9197f1907060d853/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:55.977987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a8f47-ac4f-4d59-936f-a61660beb673 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:55.979301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b62a8f47-ac4f-4d59-936f-a61660beb673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:55.992943 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de46d8-cea6-44d2-b739-bbe5674a3bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4dc4f8a5d8460e980abc55bfd85431, user_id=5d84b64852024d0f9197f1907060d853, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:55.995593 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de46d8-cea6-44d2-b739-bbe5674a3bfa admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:56.036090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a8f47-ac4f-4d59-936f-a61660beb673 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:56.040692 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5afcf-1452-4bb2-8c35-01897f7a7a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:56.041332 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5afcf-1452-4bb2-8c35-01897f7a7a12 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.041615 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5afcf-1452-4bb2-8c35-01897f7a7a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.041896 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5afcf-1452-4bb2-8c35-01897f7a7a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.052744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5afcf-1452-4bb2-8c35-01897f7a7a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:56.054192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5afcf-1452-4bb2-8c35-01897f7a7a12 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:56.059134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 992/1980] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:55 2022] PUT /identity/v3/projects/fa4dc4f8a5d8460e980abc55bfd85431/users/5d84b64852024d0f9197f1907060d853/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:56.065203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 989/1981] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:39:56.069610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea31e9e-21bd-464f-bb26-d21feb5fd519 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.069935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea31e9e-21bd-464f-bb26-d21feb5fd519 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.070210 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea31e9e-21bd-464f-bb26-d21feb5fd519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.096586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5ea31e9e-21bd-464f-bb26-d21feb5fd519 None None] MFA Rules not processed for user `5d84b64852024d0f9197f1907060d853`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:56.097816 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5ea31e9e-21bd-464f-bb26-d21feb5fd519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:56.162489 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 993/1982] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:56.167029 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5afcf-1452-4bb2-8c35-01897f7a7a12 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:56.176610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5afcf-1452-4bb2-8c35-01897f7a7a12 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:56.233685 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de843b-18d1-48bd-8810-10061aa24a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:56.234373 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de843b-18d1-48bd-8810-10061aa24a78 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.234653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de843b-18d1-48bd-8810-10061aa24a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.234923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de843b-18d1-48bd-8810-10061aa24a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.235611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de843b-18d1-48bd-8810-10061aa24a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:56.237606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de843b-18d1-48bd-8810-10061aa24a78 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:56.340603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 990/1983] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:56 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:56.344764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea31e9e-21bd-464f-bb26-d21feb5fd519 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:56.356322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea31e9e-21bd-464f-bb26-d21feb5fd519 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:56.421961 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef6a16-0e94-4f31-a6ba-88bd98dc649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:56.422635 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef6a16-0e94-4f31-a6ba-88bd98dc649c admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.422922 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef6a16-0e94-4f31-a6ba-88bd98dc649c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.423202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef6a16-0e94-4f31-a6ba-88bd98dc649c admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.424048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef6a16-0e94-4f31-a6ba-88bd98dc649c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:56.426080 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef6a16-0e94-4f31-a6ba-88bd98dc649c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:56.466059 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de843b-18d1-48bd-8810-10061aa24a78 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:56.467812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c1de843b-18d1-48bd-8810-10061aa24a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:56.481746 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de843b-18d1-48bd-8810-10061aa24a78 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:56.487083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a7586-8e42-4aa0-9364-111abc229860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:56.488011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a7586-8e42-4aa0-9364-111abc229860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.488335 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a7586-8e42-4aa0-9364-111abc229860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.491623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a7586-8e42-4aa0-9364-111abc229860 admin admin] PATH_INFO: `/v3/projects/4b68cc82d93344ecb0c24111e248a794` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.491623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a7586-8e42-4aa0-9364-111abc229860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b68cc82d93344ecb0c24111e248a794)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:56.492132 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a7586-8e42-4aa0-9364-111abc229860 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:56.519703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 994/1984] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:56 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:56.523457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef6a16-0e94-4f31-a6ba-88bd98dc649c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:56.533930 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef6a16-0e94-4f31-a6ba-88bd98dc649c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:56.538673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820f242-3bb2-4522-aaef-cc80e7eed628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:56.539328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820f242-3bb2-4522-aaef-cc80e7eed628 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.539611 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820f242-3bb2-4522-aaef-cc80e7eed628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.539888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820f242-3bb2-4522-aaef-cc80e7eed628 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.540649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820f242-3bb2-4522-aaef-cc80e7eed628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:56.542235 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820f242-3bb2-4522-aaef-cc80e7eed628 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:56.553104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 995/1985] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:56.557128 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820f242-3bb2-4522-aaef-cc80e7eed628 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:56.567462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820f242-3bb2-4522-aaef-cc80e7eed628 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:56.572315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e297c0-0464-4bfd-9c14-43f3b637245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:56.573176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e297c0-0464-4bfd-9c14-43f3b637245b admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.573459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e297c0-0464-4bfd-9c14-43f3b637245b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.573735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e297c0-0464-4bfd-9c14-43f3b637245b admin admin] PATH_INFO: `/v3/projects/dd8517e645474dda92b73715d21188b4/users/07102d66efeb4286a49818cdef6910c1/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.588301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e297c0-0464-4bfd-9c14-43f3b637245b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8517e645474dda92b73715d21188b4, user_id=07102d66efeb4286a49818cdef6910c1, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:56.591006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e297c0-0464-4bfd-9c14-43f3b637245b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:56.687266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 996/1986] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:56 2022] PUT /identity/v3/projects/dd8517e645474dda92b73715d21188b4/users/07102d66efeb4286a49818cdef6910c1/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:56.691170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e297c0-0464-4bfd-9c14-43f3b637245b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:56.697469 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d63a7586-8e42-4aa0-9364-111abc229860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b68cc82d93344ecb0c24111e248a794', 'request_id': 'req-d63a7586-8e42-4aa0-9364-111abc229860'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:56.703561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d63a7586-8e42-4aa0-9364-111abc229860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b68cc82d93344ecb0c24111e248a794', 'request_id': 'req-d63a7586-8e42-4aa0-9364-111abc229860'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:56.710183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d63a7586-8e42-4aa0-9364-111abc229860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b68cc82d93344ecb0c24111e248a794', 'request_id': 'req-d63a7586-8e42-4aa0-9364-111abc229860'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:56.749998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e297c0-0464-4bfd-9c14-43f3b637245b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:56.795061 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d63a7586-8e42-4aa0-9364-111abc229860 admin admin] The token cache is being invalidate because project 4b68cc82d93344ecb0c24111e248a794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:56.795839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d63a7586-8e42-4aa0-9364-111abc229860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:56.796560 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d63a7586-8e42-4aa0-9364-111abc229860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:56.798325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 991/1987] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:56 2022] DELETE /identity/v3/projects/4b68cc82d93344ecb0c24111e248a794 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:56.802928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b0467-427d-4cdf-b429-0acd46c37150 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.803228 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b0467-427d-4cdf-b429-0acd46c37150 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.803581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b0467-427d-4cdf-b429-0acd46c37150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.805114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83347a41-af1f-46fc-a3f1-73fbe08f80ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:56.806606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83347a41-af1f-46fc-a3f1-73fbe08f80ce admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.806606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83347a41-af1f-46fc-a3f1-73fbe08f80ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.806606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83347a41-af1f-46fc-a3f1-73fbe08f80ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.807083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83347a41-af1f-46fc-a3f1-73fbe08f80ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:56.808675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83347a41-af1f-46fc-a3f1-73fbe08f80ce admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:56.819436 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 997/1988] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:56.822659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-612b0467-427d-4cdf-b429-0acd46c37150 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:56.823579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83347a41-af1f-46fc-a3f1-73fbe08f80ce admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:56.824272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-612b0467-427d-4cdf-b429-0acd46c37150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:56.825204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-83347a41-af1f-46fc-a3f1-73fbe08f80ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:56.832707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 992/1989] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:56.837476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83347a41-af1f-46fc-a3f1-73fbe08f80ce admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:56.840110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb719d-9473-401a-91de-e04773070048 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.840500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb719d-9473-401a-91de-e04773070048 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.840878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb719d-9473-401a-91de-e04773070048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.843093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7dbad4-970a-4cb4-bde3-8b7ef25df121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:56.845146 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dbad4-970a-4cb4-bde3-8b7ef25df121 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.845442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dbad4-970a-4cb4-bde3-8b7ef25df121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.845725 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dbad4-970a-4cb4-bde3-8b7ef25df121 admin admin] PATH_INFO: `/v3/projects/dd8517e645474dda92b73715d21188b4/users/07102d66efeb4286a49818cdef6910c1/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.848341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dbad4-970a-4cb4-bde3-8b7ef25df121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8517e645474dda92b73715d21188b4, user_id=07102d66efeb4286a49818cdef6910c1, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:56.851985 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dbad4-970a-4cb4-bde3-8b7ef25df121 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:56.859898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-3abb719d-9473-401a-91de-e04773070048 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:56.861110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3abb719d-9473-401a-91de-e04773070048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:56.862940 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 998/1990] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:56 2022] PUT /identity/v3/projects/dd8517e645474dda92b73715d21188b4/users/07102d66efeb4286a49818cdef6910c1/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:56.873856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92782be0-8643-4c64-812a-0b4bb4c13585 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.874139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92782be0-8643-4c64-812a-0b4bb4c13585 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.874412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92782be0-8643-4c64-812a-0b4bb4c13585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.899441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-92782be0-8643-4c64-812a-0b4bb4c13585 None None] MFA Rules not processed for user `07102d66efeb4286a49818cdef6910c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:56.900797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-92782be0-8643-4c64-812a-0b4bb4c13585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:56.916624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 993/1991] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:56.922722 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb719d-9473-401a-91de-e04773070048 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:56.931205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb719d-9473-401a-91de-e04773070048 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:56.935802 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa446ea-47b8-49cf-8f18-cc7918b8163d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:56.936776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa446ea-47b8-49cf-8f18-cc7918b8163d admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.937060 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa446ea-47b8-49cf-8f18-cc7918b8163d admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.937363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa446ea-47b8-49cf-8f18-cc7918b8163d admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.938065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa446ea-47b8-49cf-8f18-cc7918b8163d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:56.938368 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa446ea-47b8-49cf-8f18-cc7918b8163d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:56.939969 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa446ea-47b8-49cf-8f18-cc7918b8163d admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:56.951232 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 994/1992] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:39:56.955408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa446ea-47b8-49cf-8f18-cc7918b8163d admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:56.964760 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa446ea-47b8-49cf-8f18-cc7918b8163d admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:56.968608 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 999/1993] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:56.970503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4698fb-cb58-43dd-9695-4a0edb20ba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:56.971122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4698fb-cb58-43dd-9695-4a0edb20ba92 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:56.971403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4698fb-cb58-43dd-9695-4a0edb20ba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:56.971676 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4698fb-cb58-43dd-9695-4a0edb20ba92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:56.972398 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4698fb-cb58-43dd-9695-4a0edb20ba92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:56.974345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4698fb-cb58-43dd-9695-4a0edb20ba92 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:56.979692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92782be0-8643-4c64-812a-0b4bb4c13585 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:56.981069 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-92782be0-8643-4c64-812a-0b4bb4c13585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:57.035005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92782be0-8643-4c64-812a-0b4bb4c13585 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:57.038747 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354fccc-a9e0-42d7-b286-45895b1e5893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:57.039408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354fccc-a9e0-42d7-b286-45895b1e5893 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:57.039711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354fccc-a9e0-42d7-b286-45895b1e5893 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:57.039988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354fccc-a9e0-42d7-b286-45895b1e5893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:57.049129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354fccc-a9e0-42d7-b286-45895b1e5893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:57.050566 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354fccc-a9e0-42d7-b286-45895b1e5893 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:57.059843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1000/1994] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:39:57.101698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 995/1995] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:56 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:39:57.102799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354fccc-a9e0-42d7-b286-45895b1e5893 service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:57.113409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354fccc-a9e0-42d7-b286-45895b1e5893 service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:57.126081 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4698fb-cb58-43dd-9695-4a0edb20ba92 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:57.174758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a4a06-77af-445d-9512-d78a355e4d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:57.175435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a4a06-77af-445d-9512-d78a355e4d5c admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:57.175723 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a4a06-77af-445d-9512-d78a355e4d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:57.176120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a4a06-77af-445d-9512-d78a355e4d5c admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:57.176861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a4a06-77af-445d-9512-d78a355e4d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:57.178829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a4a06-77af-445d-9512-d78a355e4d5c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:57.188193 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4698fb-cb58-43dd-9695-4a0edb20ba92 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:57.193420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462498c-90a1-4e06-a93e-c97935131dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:57.194291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462498c-90a1-4e06-a93e-c97935131dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:57.194572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462498c-90a1-4e06-a93e-c97935131dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:57.194847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462498c-90a1-4e06-a93e-c97935131dc9 admin admin] PATH_INFO: `/v3/users/5d84b64852024d0f9197f1907060d853` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:57.196051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462498c-90a1-4e06-a93e-c97935131dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d84b64852024d0f9197f1907060d853)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:57.198067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462498c-90a1-4e06-a93e-c97935131dc9 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:57.287570 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1001/1996] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:57 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:57.291519 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a4a06-77af-445d-9512-d78a355e4d5c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:57.301335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a4a06-77af-445d-9512-d78a355e4d5c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:57.305940 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f323061-74e4-4b4b-99c6-7b3ac56c073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:57.306590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f323061-74e4-4b4b-99c6-7b3ac56c073e admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:57.306899 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f323061-74e4-4b4b-99c6-7b3ac56c073e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:57.307144 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f323061-74e4-4b4b-99c6-7b3ac56c073e admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:57.307863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f323061-74e4-4b4b-99c6-7b3ac56c073e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:57.309525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f323061-74e4-4b4b-99c6-7b3ac56c073e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:57.320017 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1002/1997] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:57.323589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f323061-74e4-4b4b-99c6-7b3ac56c073e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:57.332979 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f323061-74e4-4b4b-99c6-7b3ac56c073e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:57.337553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b1738-4a88-40fa-a202-2a3c469346d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:57.338156 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b1738-4a88-40fa-a202-2a3c469346d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:57.338438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b1738-4a88-40fa-a202-2a3c469346d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:57.338715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b1738-4a88-40fa-a202-2a3c469346d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:57.339438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b1738-4a88-40fa-a202-2a3c469346d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:57.341004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b1738-4a88-40fa-a202-2a3c469346d4 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:57.350843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1003/1998] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:39:57.354641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b1738-4a88-40fa-a202-2a3c469346d4 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:57.364243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b1738-4a88-40fa-a202-2a3c469346d4 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:57.370143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75895fc-b29f-464d-bf55-62fc080412dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:57.370986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75895fc-b29f-464d-bf55-62fc080412dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:57.371263 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75895fc-b29f-464d-bf55-62fc080412dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:57.371535 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75895fc-b29f-464d-bf55-62fc080412dd admin admin] PATH_INFO: `/v3/projects/4ec78c37600a4949bc177baa1e274139/users/538fc5e836b14f649eb47dedc26a4b79/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:57.374071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4462498c-90a1-4e06-a93e-c97935131dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d84b64852024d0f9197f1907060d853'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:57.388348 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75895fc-b29f-464d-bf55-62fc080412dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec78c37600a4949bc177baa1e274139, user_id=538fc5e836b14f649eb47dedc26a4b79, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:57.391054 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75895fc-b29f-464d-bf55-62fc080412dd admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:57.456699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4462498c-90a1-4e06-a93e-c97935131dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d84b64852024d0f9197f1907060d853'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:57.469978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4462498c-90a1-4e06-a93e-c97935131dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d84b64852024d0f9197f1907060d853'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:57.473921 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4462498c-90a1-4e06-a93e-c97935131dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d84b64852024d0f9197f1907060d853'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:57.477155 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4462498c-90a1-4e06-a93e-c97935131dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d84b64852024d0f9197f1907060d853'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:57.482904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 996/1999] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:57 2022] DELETE /identity/v3/users/5d84b64852024d0f9197f1907060d853 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:57.487074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726524ea-ffc0-4cfb-9901-2cfd2eba5a39 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:57.487399 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726524ea-ffc0-4cfb-9901-2cfd2eba5a39 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:57.487679 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726524ea-ffc0-4cfb-9901-2cfd2eba5a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:57.498768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1004/2000] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:57 2022] PUT /identity/v3/projects/4ec78c37600a4949bc177baa1e274139/users/538fc5e836b14f649eb47dedc26a4b79/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:57.504053 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-726524ea-ffc0-4cfb-9901-2cfd2eba5a39 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:57.505299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-726524ea-ffc0-4cfb-9901-2cfd2eba5a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:57.511437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834da72-517d-4814-aea1-13d686d7596a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:57.511630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834da72-517d-4814-aea1-13d686d7596a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:57.511867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834da72-517d-4814-aea1-13d686d7596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:57.540129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c834da72-517d-4814-aea1-13d686d7596a None None] MFA Rules not processed for user `538fc5e836b14f649eb47dedc26a4b79`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:57.541344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c834da72-517d-4814-aea1-13d686d7596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:57.565239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 997/2001] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:57.575598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726524ea-ffc0-4cfb-9901-2cfd2eba5a39 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:57.577172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-726524ea-ffc0-4cfb-9901-2cfd2eba5a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:57.605715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1005/2002] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:39:57.617332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834da72-517d-4814-aea1-13d686d7596a None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:57.618683 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c834da72-517d-4814-aea1-13d686d7596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:57.633893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726524ea-ffc0-4cfb-9901-2cfd2eba5a39 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:57.637986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9f22c-7ce3-4037-974c-11f0a15764e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:57.638678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9f22c-7ce3-4037-974c-11f0a15764e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:57.638892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9f22c-7ce3-4037-974c-11f0a15764e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:57.639219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9f22c-7ce3-4037-974c-11f0a15764e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:57.648923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9f22c-7ce3-4037-974c-11f0a15764e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:57.650364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9f22c-7ce3-4037-974c-11f0a15764e1 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:57.660763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 998/2003] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:39:57.673984 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834da72-517d-4814-aea1-13d686d7596a None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:57.677809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e293007-a565-44d5-aabc-70a16ad338ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:57.678454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e293007-a565-44d5-aabc-70a16ad338ae service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:57.678739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e293007-a565-44d5-aabc-70a16ad338ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:57.679019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e293007-a565-44d5-aabc-70a16ad338ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:57.687588 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e293007-a565-44d5-aabc-70a16ad338ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:57.691640 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e293007-a565-44d5-aabc-70a16ad338ae service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:57.698586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1006/2004] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:39:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:39:58.047161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9f22c-7ce3-4037-974c-11f0a15764e1 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:58.048714 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7ff9f22c-7ce3-4037-974c-11f0a15764e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:58.062721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9f22c-7ce3-4037-974c-11f0a15764e1 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:58.068676 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:58.069610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:58.069965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:58.070314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] PATH_INFO: `/v3/projects/fa4dc4f8a5d8460e980abc55bfd85431` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:58.071705 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa4dc4f8a5d8460e980abc55bfd85431)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:58.073946 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:58.190676 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4dc4f8a5d8460e980abc55bfd85431', 'request_id': 'req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:58.196230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4dc4f8a5d8460e980abc55bfd85431', 'request_id': 'req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:58.202480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4dc4f8a5d8460e980abc55bfd85431', 'request_id': 'req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:58.286703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] The token cache is being invalidate because project fa4dc4f8a5d8460e980abc55bfd85431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:58.290600 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:58.290600 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:58.290600 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 999/2005] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:58 2022] DELETE /identity/v3/projects/fa4dc4f8a5d8460e980abc55bfd85431 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:58.293327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e293007-a565-44d5-aabc-70a16ad338ae service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:58.304546 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e293007-a565-44d5-aabc-70a16ad338ae service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:58.363387 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f11d5-b026-4b52-a07f-eb5b36644315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:58.364288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f11d5-b026-4b52-a07f-eb5b36644315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:58.364566 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f11d5-b026-4b52-a07f-eb5b36644315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:58.364836 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f11d5-b026-4b52-a07f-eb5b36644315 admin admin] PATH_INFO: `/v3/users/07102d66efeb4286a49818cdef6910c1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:58.366062 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f11d5-b026-4b52-a07f-eb5b36644315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07102d66efeb4286a49818cdef6910c1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:58.367970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f11d5-b026-4b52-a07f-eb5b36644315 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:58.529441 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9e5f11d5-b026-4b52-a07f-eb5b36644315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07102d66efeb4286a49818cdef6910c1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:58.530583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9e5f11d5-b026-4b52-a07f-eb5b36644315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07102d66efeb4286a49818cdef6910c1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:58.594340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9e5f11d5-b026-4b52-a07f-eb5b36644315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07102d66efeb4286a49818cdef6910c1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:58.595003 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9e5f11d5-b026-4b52-a07f-eb5b36644315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07102d66efeb4286a49818cdef6910c1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:58.607510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9e5f11d5-b026-4b52-a07f-eb5b36644315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07102d66efeb4286a49818cdef6910c1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:58.620207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1007/2006] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:39:58 2022] DELETE /identity/v3/users/07102d66efeb4286a49818cdef6910c1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:59.018206 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:59.019698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:59.033247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871d3f9-0cd7-4974-a6a7-8e144d1dbc84 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:59.089304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:59.090188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:59.090471 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:59.090747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f admin admin] PATH_INFO: `/v3/projects/dd8517e645474dda92b73715d21188b4` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:59.091987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8517e645474dda92b73715d21188b4)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:59.094170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:59.206062 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8517e645474dda92b73715d21188b4', 'request_id': 'req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:59.211306 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8517e645474dda92b73715d21188b4', 'request_id': 'req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:59.217331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8517e645474dda92b73715d21188b4', 'request_id': 'req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:59.289944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f admin admin] The token cache is being invalidate because project dd8517e645474dda92b73715d21188b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:39:59.290234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:59.290880 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d7ca7d6c-7416-4006-adb6-bf2f3a7dbe0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:39:59.292440 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1000/2007] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:39:59 2022] DELETE /identity/v3/projects/dd8517e645474dda92b73715d21188b4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:39:59.297299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2a119-0d9e-4abe-b481-43a2b428bd3f None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:59.297769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2a119-0d9e-4abe-b481-43a2b428bd3f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:59.297893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2a119-0d9e-4abe-b481-43a2b428bd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:59.316056 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-57d2a119-0d9e-4abe-b481-43a2b428bd3f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:59.317319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-57d2a119-0d9e-4abe-b481-43a2b428bd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:59.376884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1008/2008] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:59.385630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f57491-23e9-473c-9011-59185a984894 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:59.385980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f57491-23e9-473c-9011-59185a984894 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:59.386265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f57491-23e9-473c-9011-59185a984894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:59.405241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-c6f57491-23e9-473c-9011-59185a984894 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:39:59.406378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c6f57491-23e9-473c-9011-59185a984894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:39:59.414258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1001/2009] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:39:59.418474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2a119-0d9e-4abe-b481-43a2b428bd3f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:59.428063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2a119-0d9e-4abe-b481-43a2b428bd3f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:59.432724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf75933-e4ff-4e7d-98f2-c401fe9076c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:59.434630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf75933-e4ff-4e7d-98f2-c401fe9076c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:59.434943 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf75933-e4ff-4e7d-98f2-c401fe9076c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:59.435220 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf75933-e4ff-4e7d-98f2-c401fe9076c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:59.436742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf75933-e4ff-4e7d-98f2-c401fe9076c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:39:59.437150 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf75933-e4ff-4e7d-98f2-c401fe9076c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:59.438749 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf75933-e4ff-4e7d-98f2-c401fe9076c5 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:59.449889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1009/2010] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:39:59.454727 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f57491-23e9-473c-9011-59185a984894 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:59.463927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f57491-23e9-473c-9011-59185a984894 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:59.468658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88925360-752a-424a-9172-28acde5b7690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:59.469300 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88925360-752a-424a-9172-28acde5b7690 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:59.469587 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88925360-752a-424a-9172-28acde5b7690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:59.469868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88925360-752a-424a-9172-28acde5b7690 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:59.470553 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88925360-752a-424a-9172-28acde5b7690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:59.472513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88925360-752a-424a-9172-28acde5b7690 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:59.613355 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1002/2011] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:39:59 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:59.617261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf75933-e4ff-4e7d-98f2-c401fe9076c5 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:59.627674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf75933-e4ff-4e7d-98f2-c401fe9076c5 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:59.683629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ad9a9-0ec6-43ba-9182-ee9c86d48fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:59.684330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ad9a9-0ec6-43ba-9182-ee9c86d48fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:59.684614 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ad9a9-0ec6-43ba-9182-ee9c86d48fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:59.684890 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ad9a9-0ec6-43ba-9182-ee9c86d48fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:59.685745 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ad9a9-0ec6-43ba-9182-ee9c86d48fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:59.688724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ad9a9-0ec6-43ba-9182-ee9c86d48fc8 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:59.790227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1010/2012] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:39:59 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:39:59.794263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88925360-752a-424a-9172-28acde5b7690 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:59.804796 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88925360-752a-424a-9172-28acde5b7690 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:59.809546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556307c6-934b-4f2f-96bf-809cbc91a1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:59.810240 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556307c6-934b-4f2f-96bf-809cbc91a1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:59.810521 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556307c6-934b-4f2f-96bf-809cbc91a1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:59.810794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556307c6-934b-4f2f-96bf-809cbc91a1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:59.812496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556307c6-934b-4f2f-96bf-809cbc91a1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:59.814087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556307c6-934b-4f2f-96bf-809cbc91a1c2 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:59.824354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1003/2013] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:59.828194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ad9a9-0ec6-43ba-9182-ee9c86d48fc8 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:59.837902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ad9a9-0ec6-43ba-9182-ee9c86d48fc8 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:59.843031 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c811e33-5a04-4cce-aa07-f5183080a055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:59.843700 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c811e33-5a04-4cce-aa07-f5183080a055 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:59.843985 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c811e33-5a04-4cce-aa07-f5183080a055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:59.844306 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c811e33-5a04-4cce-aa07-f5183080a055 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:59.845029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c811e33-5a04-4cce-aa07-f5183080a055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:59.846615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c811e33-5a04-4cce-aa07-f5183080a055 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:59.856154 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1011/2014] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:39:59.860637 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556307c6-934b-4f2f-96bf-809cbc91a1c2 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:39:59.870265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556307c6-934b-4f2f-96bf-809cbc91a1c2 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:39:59.874903 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e21812-35e0-4f09-bbf0-3990f40c6a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:39:59.875768 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e21812-35e0-4f09-bbf0-3990f40c6a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:59.876052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e21812-35e0-4f09-bbf0-3990f40c6a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:59.876364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e21812-35e0-4f09-bbf0-3990f40c6a4f admin admin] PATH_INFO: `/v3/projects/a265d4a9f3b64336ad63510e42cf93b1/users/22c16730df5744f6b209fcb6abbe3393/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:39:59.890074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e21812-35e0-4f09-bbf0-3990f40c6a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a265d4a9f3b64336ad63510e42cf93b1, user_id=22c16730df5744f6b209fcb6abbe3393, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:39:59.892777 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e21812-35e0-4f09-bbf0-3990f40c6a4f admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:39:59.982353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1004/2015] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:39:59 2022] PUT /identity/v3/projects/a265d4a9f3b64336ad63510e42cf93b1/users/22c16730df5744f6b209fcb6abbe3393/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:39:59.993010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51f02e-dc56-4d4a-81de-fc896b717e4f None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:39:59.994908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51f02e-dc56-4d4a-81de-fc896b717e4f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:39:59.994908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51f02e-dc56-4d4a-81de-fc896b717e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:00.019105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-2e51f02e-dc56-4d4a-81de-fc896b717e4f None None] MFA Rules not processed for user `22c16730df5744f6b209fcb6abbe3393`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:00.020320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2e51f02e-dc56-4d4a-81de-fc896b717e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:00.080807 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1012/2016] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:00.085348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e21812-35e0-4f09-bbf0-3990f40c6a4f admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:00.144755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e21812-35e0-4f09-bbf0-3990f40c6a4f admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:00.149408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232b5a9-32de-41e4-b5d9-1162d6665a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:00.150052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232b5a9-32de-41e4-b5d9-1162d6665a25 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:00.150332 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232b5a9-32de-41e4-b5d9-1162d6665a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:00.150606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232b5a9-32de-41e4-b5d9-1162d6665a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:00.151295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232b5a9-32de-41e4-b5d9-1162d6665a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:00.153240 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232b5a9-32de-41e4-b5d9-1162d6665a25 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:00.292109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1005/2017] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:00 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:00.296115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51f02e-dc56-4d4a-81de-fc896b717e4f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:00.306503 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51f02e-dc56-4d4a-81de-fc896b717e4f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:00.360083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf7724-e5ab-48df-9e99-f44065d24a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:00.360853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf7724-e5ab-48df-9e99-f44065d24a31 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:00.361137 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf7724-e5ab-48df-9e99-f44065d24a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:00.361411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf7724-e5ab-48df-9e99-f44065d24a31 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:00.362104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf7724-e5ab-48df-9e99-f44065d24a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:00.364014 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf7724-e5ab-48df-9e99-f44065d24a31 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:00.440423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1013/2018] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:00 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:00.444390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232b5a9-32de-41e4-b5d9-1162d6665a25 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:00.455080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232b5a9-32de-41e4-b5d9-1162d6665a25 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:00.459857 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46c94-96a0-4590-8204-b1306038ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:00.460543 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46c94-96a0-4590-8204-b1306038ed8c admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:00.460822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46c94-96a0-4590-8204-b1306038ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:00.461099 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46c94-96a0-4590-8204-b1306038ed8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:00.461810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc46c94-96a0-4590-8204-b1306038ed8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:00.463450 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc46c94-96a0-4590-8204-b1306038ed8c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:00.475563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1006/2019] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:00.479593 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf7724-e5ab-48df-9e99-f44065d24a31 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:00.489376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf7724-e5ab-48df-9e99-f44065d24a31 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:00.494016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6e128-ba55-4666-978c-ab082fc9877e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:00.494669 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6e128-ba55-4666-978c-ab082fc9877e admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:00.494955 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6e128-ba55-4666-978c-ab082fc9877e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:00.495234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6e128-ba55-4666-978c-ab082fc9877e admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:00.495960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6e128-ba55-4666-978c-ab082fc9877e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:00.497591 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6e128-ba55-4666-978c-ab082fc9877e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:00.507359 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1014/2020] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:00.511007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46c94-96a0-4590-8204-b1306038ed8c admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:00.521009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46c94-96a0-4590-8204-b1306038ed8c admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:00.525522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523af6ec-8f7e-46cc-a8ab-34470e337b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:00.526372 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523af6ec-8f7e-46cc-a8ab-34470e337b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:00.526648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523af6ec-8f7e-46cc-a8ab-34470e337b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:00.526925 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523af6ec-8f7e-46cc-a8ab-34470e337b3b admin admin] PATH_INFO: `/v3/projects/3693de902107479a92170d4cc04533a2/users/d740dfdf55b74bd38d44f7834f1f5022/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:00.541139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523af6ec-8f7e-46cc-a8ab-34470e337b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3693de902107479a92170d4cc04533a2, user_id=d740dfdf55b74bd38d44f7834f1f5022, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:00.543815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523af6ec-8f7e-46cc-a8ab-34470e337b3b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:00.624237 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1007/2021] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:00 2022] PUT /identity/v3/projects/3693de902107479a92170d4cc04533a2/users/d740dfdf55b74bd38d44f7834f1f5022/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:00.634981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accffeac-0221-4f71-95a1-a2c39e6c67cb None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:00.635272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accffeac-0221-4f71-95a1-a2c39e6c67cb None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:00.635565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accffeac-0221-4f71-95a1-a2c39e6c67cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:00.661693 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-accffeac-0221-4f71-95a1-a2c39e6c67cb None None] MFA Rules not processed for user `d740dfdf55b74bd38d44f7834f1f5022`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:00.662963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-accffeac-0221-4f71-95a1-a2c39e6c67cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:00.731579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1015/2022] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:00.736456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523af6ec-8f7e-46cc-a8ab-34470e337b3b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:00.801619 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523af6ec-8f7e-46cc-a8ab-34470e337b3b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:00.806106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dede8-1596-491b-b27f-f387dfb0b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:00.806747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dede8-1596-491b-b27f-f387dfb0b6dc admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:00.807029 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dede8-1596-491b-b27f-f387dfb0b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:00.807298 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970dede8-1596-491b-b27f-f387dfb0b6dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:00.807964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dede8-1596-491b-b27f-f387dfb0b6dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:00.809876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970dede8-1596-491b-b27f-f387dfb0b6dc admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:00.899190 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1008/2023] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:00 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:40:00.903263 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accffeac-0221-4f71-95a1-a2c39e6c67cb None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:00.913779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accffeac-0221-4f71-95a1-a2c39e6c67cb None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:00.967533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69687e3-cc80-4e6b-b0e8-c239c5ebaeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:00.968218 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69687e3-cc80-4e6b-b0e8-c239c5ebaeaa admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:00.968506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69687e3-cc80-4e6b-b0e8-c239c5ebaeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:00.968786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69687e3-cc80-4e6b-b0e8-c239c5ebaeaa admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:00.969476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69687e3-cc80-4e6b-b0e8-c239c5ebaeaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:00.971403 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69687e3-cc80-4e6b-b0e8-c239c5ebaeaa admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:01.069498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1016/2024] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:00 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:01.073503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dede8-1596-491b-b27f-f387dfb0b6dc admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:01.084919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970dede8-1596-491b-b27f-f387dfb0b6dc admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:01.089758 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813e623-8991-417b-b9ab-f4e60675381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:01.090416 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813e623-8991-417b-b9ab-f4e60675381c admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:01.090699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813e623-8991-417b-b9ab-f4e60675381c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:01.091041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813e623-8991-417b-b9ab-f4e60675381c admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:01.091767 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813e623-8991-417b-b9ab-f4e60675381c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:01.093449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813e623-8991-417b-b9ab-f4e60675381c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:01.104135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1009/2025] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:01.109049 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69687e3-cc80-4e6b-b0e8-c239c5ebaeaa admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:01.119113 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69687e3-cc80-4e6b-b0e8-c239c5ebaeaa admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:01.124323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70140d13-951d-41cc-b5e4-5d556cc6ed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:01.125193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70140d13-951d-41cc-b5e4-5d556cc6ed6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:01.125475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70140d13-951d-41cc-b5e4-5d556cc6ed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:01.125748 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70140d13-951d-41cc-b5e4-5d556cc6ed6e admin admin] PATH_INFO: `/v3/projects/3c1055e7f60946f2ba437393b15761b9/users/602b805808744cf299b4fc53bfef0285/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:01.139844 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70140d13-951d-41cc-b5e4-5d556cc6ed6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1055e7f60946f2ba437393b15761b9, user_id=602b805808744cf299b4fc53bfef0285, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:01.142532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70140d13-951d-41cc-b5e4-5d556cc6ed6e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:01.281130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1017/2026] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:01 2022] PUT /identity/v3/projects/3c1055e7f60946f2ba437393b15761b9/users/602b805808744cf299b4fc53bfef0285/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:01.285420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813e623-8991-417b-b9ab-f4e60675381c admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:01.295855 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813e623-8991-417b-b9ab-f4e60675381c admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:01.349675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bb243-9c87-4f37-9f42-f93b2890f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:01.350256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bb243-9c87-4f37-9f42-f93b2890f437 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:01.350535 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bb243-9c87-4f37-9f42-f93b2890f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:01.350807 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bb243-9c87-4f37-9f42-f93b2890f437 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:01.351512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bb243-9c87-4f37-9f42-f93b2890f437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:01.353167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bb243-9c87-4f37-9f42-f93b2890f437 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:01.363263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1010/2027] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:01.367402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70140d13-951d-41cc-b5e4-5d556cc6ed6e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:01.377621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70140d13-951d-41cc-b5e4-5d556cc6ed6e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:01.382352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ace4c-87a5-4a4e-b197-cc23358b4eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:01.383250 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ace4c-87a5-4a4e-b197-cc23358b4eff admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:01.383537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ace4c-87a5-4a4e-b197-cc23358b4eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:01.383812 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ace4c-87a5-4a4e-b197-cc23358b4eff admin admin] PATH_INFO: `/v3/projects/3c1055e7f60946f2ba437393b15761b9/users/602b805808744cf299b4fc53bfef0285/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:01.385875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ace4c-87a5-4a4e-b197-cc23358b4eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1055e7f60946f2ba437393b15761b9, user_id=602b805808744cf299b4fc53bfef0285, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:01.388544 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ace4c-87a5-4a4e-b197-cc23358b4eff admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:01.399434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1018/2028] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:01 2022] PUT /identity/v3/projects/3c1055e7f60946f2ba437393b15761b9/users/602b805808744cf299b4fc53bfef0285/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:01.412336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafde16-05d2-45e9-9260-291495fe1107 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:01.412744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafde16-05d2-45e9-9260-291495fe1107 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:01.412948 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafde16-05d2-45e9-9260-291495fe1107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:01.440972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-adafde16-05d2-45e9-9260-291495fe1107 None None] MFA Rules not processed for user `602b805808744cf299b4fc53bfef0285`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:01.442192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-adafde16-05d2-45e9-9260-291495fe1107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:01.515910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1011/2029] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:01.526934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ace4c-87a5-4a4e-b197-cc23358b4eff admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:01.528664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ce7ace4c-87a5-4a4e-b197-cc23358b4eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:01.585381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ace4c-87a5-4a4e-b197-cc23358b4eff admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:01.589177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde98fc-cdaf-4aff-baa3-bd125d85ebfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:01.589822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde98fc-cdaf-4aff-baa3-bd125d85ebfa service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:01.590105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde98fc-cdaf-4aff-baa3-bd125d85ebfa service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:01.590379 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde98fc-cdaf-4aff-baa3-bd125d85ebfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:01.600107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde98fc-cdaf-4aff-baa3-bd125d85ebfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:01.601523 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde98fc-cdaf-4aff-baa3-bd125d85ebfa service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:01.613847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1019/2030] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:40:01.741142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafde16-05d2-45e9-9260-291495fe1107 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:01.751945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafde16-05d2-45e9-9260-291495fe1107 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:01.756101 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d5349-a7bb-43ae-b2b3-428aed0432ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:01.756792 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d5349-a7bb-43ae-b2b3-428aed0432ac service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:01.757079 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d5349-a7bb-43ae-b2b3-428aed0432ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:01.757753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d5349-a7bb-43ae-b2b3-428aed0432ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:01.817520 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d5349-a7bb-43ae-b2b3-428aed0432ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:01.818982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d5349-a7bb-43ae-b2b3-428aed0432ac service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:01.829538 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1012/2031] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:40:14.291976 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde98fc-cdaf-4aff-baa3-bd125d85ebfa service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:14.353423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde98fc-cdaf-4aff-baa3-bd125d85ebfa service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:14.358262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dca44-f46d-4923-b263-86150b47966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:14.359168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dca44-f46d-4923-b263-86150b47966d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:14.359411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dca44-f46d-4923-b263-86150b47966d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:14.359687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dca44-f46d-4923-b263-86150b47966d admin admin] PATH_INFO: `/v3/users/22c16730df5744f6b209fcb6abbe3393` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:14.361132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224dca44-f46d-4923-b263-86150b47966d admin admin] RBAC: Authorizing `identity:delete_user(user_id=22c16730df5744f6b209fcb6abbe3393)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:14.363194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224dca44-f46d-4923-b263-86150b47966d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:14.606638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-224dca44-f46d-4923-b263-86150b47966d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22c16730df5744f6b209fcb6abbe3393'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:14.607772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-224dca44-f46d-4923-b263-86150b47966d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22c16730df5744f6b209fcb6abbe3393'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:14.678164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d5349-a7bb-43ae-b2b3-428aed0432ac service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:14.679603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d43d5349-a7bb-43ae-b2b3-428aed0432ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:14.687458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-224dca44-f46d-4923-b263-86150b47966d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22c16730df5744f6b209fcb6abbe3393'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:14.688110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-224dca44-f46d-4923-b263-86150b47966d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22c16730df5744f6b209fcb6abbe3393'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:14.696209 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d5349-a7bb-43ae-b2b3-428aed0432ac service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:14.701840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:14.702746 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:14.703033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:14.703308 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] PATH_INFO: `/v3/users/9d396a40388f45a8a4222eff05e2b84d` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:14.704566 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d396a40388f45a8a4222eff05e2b84d)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:14.706479 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:14.706809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-224dca44-f46d-4923-b263-86150b47966d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22c16730df5744f6b209fcb6abbe3393'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:14.722856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1020/2032] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:14 2022] DELETE /identity/v3/users/22c16730df5744f6b209fcb6abbe3393 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:14.727605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca7099-1636-416d-aac0-70afec0445c9 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:14.728067 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca7099-1636-416d-aac0-70afec0445c9 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:14.728385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca7099-1636-416d-aac0-70afec0445c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:14.745807 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-66ca7099-1636-416d-aac0-70afec0445c9 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:14.747008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-66ca7099-1636-416d-aac0-70afec0445c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:14.805384 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1021/2033] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:14.815811 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca7099-1636-416d-aac0-70afec0445c9 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:14.817238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-66ca7099-1636-416d-aac0-70afec0445c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:14.881076 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca7099-1636-416d-aac0-70afec0445c9 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:14.890060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b5a86-a18f-494b-bb89-6d7c14b5656e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:14.893760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b5a86-a18f-494b-bb89-6d7c14b5656e service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:14.893760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b5a86-a18f-494b-bb89-6d7c14b5656e service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:14.893760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b5a86-a18f-494b-bb89-6d7c14b5656e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:14.900838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d396a40388f45a8a4222eff05e2b84d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:14.901942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b5a86-a18f-494b-bb89-6d7c14b5656e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:14.903398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b5a86-a18f-494b-bb89-6d7c14b5656e service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:14.914452 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1022/2034] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:40:14.915364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b5a86-a18f-494b-bb89-6d7c14b5656e service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:14.916790 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-830b5a86-a18f-494b-bb89-6d7c14b5656e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:14.931840 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b5a86-a18f-494b-bb89-6d7c14b5656e service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:14.938824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:14.939810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:14.940187 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:14.940525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] PATH_INFO: `/v3/users/538fc5e836b14f649eb47dedc26a4b79` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:14.941987 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=538fc5e836b14f649eb47dedc26a4b79)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:14.944099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:14.993611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d396a40388f45a8a4222eff05e2b84d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.007193 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d396a40388f45a8a4222eff05e2b84d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.007871 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d396a40388f45a8a4222eff05e2b84d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.015306 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d396a40388f45a8a4222eff05e2b84d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.021586 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1013/2035] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:14 2022] DELETE /identity/v3/users/9d396a40388f45a8a4222eff05e2b84d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:15.215518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538fc5e836b14f649eb47dedc26a4b79'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.216440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538fc5e836b14f649eb47dedc26a4b79'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.325117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538fc5e836b14f649eb47dedc26a4b79'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.326258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538fc5e836b14f649eb47dedc26a4b79'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.332328 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:15.333884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:15.342386 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538fc5e836b14f649eb47dedc26a4b79'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.363702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1023/2036] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:14 2022] DELETE /identity/v3/users/538fc5e836b14f649eb47dedc26a4b79 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:15.366568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:15.366568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:15.418818 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750470e-b0ea-465a-82b8-b88a8ca2c968 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:15.431863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503be74-a0ca-4fd4-9561-5509c7b1ed60 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:15.437454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5385f-ba49-40aa-ab61-7c51618b2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:15.440996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5385f-ba49-40aa-ab61-7c51618b2ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:15.440996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5385f-ba49-40aa-ab61-7c51618b2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:15.440996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5385f-ba49-40aa-ab61-7c51618b2ac9 admin admin] PATH_INFO: `/v3/projects/a265d4a9f3b64336ad63510e42cf93b1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:15.440996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5385f-ba49-40aa-ab61-7c51618b2ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a265d4a9f3b64336ad63510e42cf93b1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:15.442048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5385f-ba49-40aa-ab61-7c51618b2ac9 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:15.474828 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:15.475689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:15.475979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:15.476286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] PATH_INFO: `/v3/projects/75fae950dc53423496a47a74e509f8c6` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:15.477512 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75fae950dc53423496a47a74e509f8c6)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:15.479403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:15.605735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-99f5385f-ba49-40aa-ab61-7c51618b2ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a265d4a9f3b64336ad63510e42cf93b1', 'request_id': 'req-99f5385f-ba49-40aa-ab61-7c51618b2ac9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.611619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-99f5385f-ba49-40aa-ab61-7c51618b2ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a265d4a9f3b64336ad63510e42cf93b1', 'request_id': 'req-99f5385f-ba49-40aa-ab61-7c51618b2ac9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.644982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75fae950dc53423496a47a74e509f8c6', 'request_id': 'req-6f667dde-cc8c-486b-8f52-3901a12a70b5'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.650170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75fae950dc53423496a47a74e509f8c6', 'request_id': 'req-6f667dde-cc8c-486b-8f52-3901a12a70b5'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.656997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75fae950dc53423496a47a74e509f8c6', 'request_id': 'req-6f667dde-cc8c-486b-8f52-3901a12a70b5'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.724723 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-99f5385f-ba49-40aa-ab61-7c51618b2ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a265d4a9f3b64336ad63510e42cf93b1', 'request_id': 'req-99f5385f-ba49-40aa-ab61-7c51618b2ac9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.737257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-99f5385f-ba49-40aa-ab61-7c51618b2ac9 admin admin] The token cache is being invalidate because project a265d4a9f3b64336ad63510e42cf93b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:15.737550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-99f5385f-ba49-40aa-ab61-7c51618b2ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.738196 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-99f5385f-ba49-40aa-ab61-7c51618b2ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.739978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1024/2037] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:15 2022] DELETE /identity/v3/projects/a265d4a9f3b64336ad63510e42cf93b1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:15.744182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c5801-429a-461d-abda-ff4988d09043 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:15.744474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c5801-429a-461d-abda-ff4988d09043 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:15.744755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c5801-429a-461d-abda-ff4988d09043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:15.761805 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-8c8c5801-429a-461d-abda-ff4988d09043 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:15.763069 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8c8c5801-429a-461d-abda-ff4988d09043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:15.827508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1025/2038] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:15.827508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c5801-429a-461d-abda-ff4988d09043 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:15.827508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8c8c5801-429a-461d-abda-ff4988d09043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:15.839384 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c5801-429a-461d-abda-ff4988d09043 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:15.840005 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] The token cache is being invalidate because project 75fae950dc53423496a47a74e509f8c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:15.840558 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.842103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:15.843875 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1014/2039] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:15 2022] DELETE /identity/v3/projects/75fae950dc53423496a47a74e509f8c6 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:15.844678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:15.845619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:15.846093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:15.846485 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:15.846764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:15.847036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] PATH_INFO: `/v3/users/d740dfdf55b74bd38d44f7834f1f5022` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:15.848327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d740dfdf55b74bd38d44f7834f1f5022)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:15.850300 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:15.906872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f667dde-cc8c-486b-8f52-3901a12a70b5 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:15.910665 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acafe20-40d8-40a0-9f03-8c0970b008b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:15.911317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acafe20-40d8-40a0-9f03-8c0970b008b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:15.911598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acafe20-40d8-40a0-9f03-8c0970b008b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:15.911891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acafe20-40d8-40a0-9f03-8c0970b008b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:15.913775 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4acafe20-40d8-40a0-9f03-8c0970b008b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:15.926455 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acafe20-40d8-40a0-9f03-8c0970b008b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:15.927989 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acafe20-40d8-40a0-9f03-8c0970b008b1 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:15.938035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1015/2040] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:15.939067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10111ec5-785b-4055-a133-6c15a89a5ebb None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:15.939351 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10111ec5-785b-4055-a133-6c15a89a5ebb None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:15.939627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10111ec5-785b-4055-a133-6c15a89a5ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:15.958058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-10111ec5-785b-4055-a133-6c15a89a5ebb None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:15.959399 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-10111ec5-785b-4055-a133-6c15a89a5ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:15.971842 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1016/2041] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:15.979871 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8faee-5524-4b5d-97ae-1491b69d2367 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:15.980188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8faee-5524-4b5d-97ae-1491b69d2367 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:15.980620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8faee-5524-4b5d-97ae-1491b69d2367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.001104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-f5f8faee-5524-4b5d-97ae-1491b69d2367 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:16.002307 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f5f8faee-5524-4b5d-97ae-1491b69d2367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:16.010358 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1017/2042] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:16.014929 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8faee-5524-4b5d-97ae-1491b69d2367 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:16.023812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8faee-5524-4b5d-97ae-1491b69d2367 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:16.029079 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395f2f1-bea1-4439-9210-0d15259fc2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:16.029726 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395f2f1-bea1-4439-9210-0d15259fc2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:16.030056 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395f2f1-bea1-4439-9210-0d15259fc2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:16.030247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395f2f1-bea1-4439-9210-0d15259fc2b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.030966 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395f2f1-bea1-4439-9210-0d15259fc2b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:40:16.031276 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395f2f1-bea1-4439-9210-0d15259fc2b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:16.032916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395f2f1-bea1-4439-9210-0d15259fc2b9 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:16.045735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1018/2043] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:40:16.049121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd740dfdf55b74bd38d44f7834f1f5022'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.049952 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395f2f1-bea1-4439-9210-0d15259fc2b9 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:16.050187 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd740dfdf55b74bd38d44f7834f1f5022'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.051708 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0395f2f1-bea1-4439-9210-0d15259fc2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:16.073530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395f2f1-bea1-4439-9210-0d15259fc2b9 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:16.073530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64e70-f8bf-48f3-9385-a2749c9c061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:16.073530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64e70-f8bf-48f3-9385-a2749c9c061c admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:16.073530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64e70-f8bf-48f3-9385-a2749c9c061c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:16.073939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64e70-f8bf-48f3-9385-a2749c9c061c admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.073939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b64e70-f8bf-48f3-9385-a2749c9c061c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:16.075267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b64e70-f8bf-48f3-9385-a2749c9c061c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:16.172831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd740dfdf55b74bd38d44f7834f1f5022'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.173406 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd740dfdf55b74bd38d44f7834f1f5022'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.187620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd740dfdf55b74bd38d44f7834f1f5022'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.203892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1019/2044] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:16 2022] POST /identity/v3/projects => generated 391 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:40:16.208241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64e70-f8bf-48f3-9385-a2749c9c061c admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:16.215891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1026/2045] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:15 2022] DELETE /identity/v3/users/d740dfdf55b74bd38d44f7834f1f5022 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:16.306909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64e70-f8bf-48f3-9385-a2749c9c061c admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:16.386166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6cbe9-2db9-4da7-8d8c-9aa7c0609975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:16.386166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6cbe9-2db9-4da7-8d8c-9aa7c0609975 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:16.386166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6cbe9-2db9-4da7-8d8c-9aa7c0609975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:16.386166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6cbe9-2db9-4da7-8d8c-9aa7c0609975 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.386498 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6cbe9-2db9-4da7-8d8c-9aa7c0609975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:16.388418 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6cbe9-2db9-4da7-8d8c-9aa7c0609975 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:16.413281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:16.414823 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:16.431950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7dfe2-f6a8-47f3-be0b-04c2a13cebc1 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:16.454432 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:16.455240 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:16.455835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:16.456212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] PATH_INFO: `/v3/projects/4ec78c37600a4949bc177baa1e274139` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.457576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec78c37600a4949bc177baa1e274139)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:16.461505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:16.518300 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1020/2046] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:16 2022] POST /identity/v3/users => generated 296 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:16.519496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6cbe9-2db9-4da7-8d8c-9aa7c0609975 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:16.529707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6cbe9-2db9-4da7-8d8c-9aa7c0609975 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:16.534519 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94305c0c-d93f-42c0-ac1f-414f04c087b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:16.535171 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94305c0c-d93f-42c0-ac1f-414f04c087b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:16.535452 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94305c0c-d93f-42c0-ac1f-414f04c087b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:16.535771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94305c0c-d93f-42c0-ac1f-414f04c087b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.537389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94305c0c-d93f-42c0-ac1f-414f04c087b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:16.539010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94305c0c-d93f-42c0-ac1f-414f04c087b0 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:16.551184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1021/2047] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:16.555028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94305c0c-d93f-42c0-ac1f-414f04c087b0 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:16.566216 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94305c0c-d93f-42c0-ac1f-414f04c087b0 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:16.570982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e5baf-b3bb-408b-b191-1c3f7d83e7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:16.571636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5baf-b3bb-408b-b191-1c3f7d83e7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:16.571924 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5baf-b3bb-408b-b191-1c3f7d83e7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:16.572254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5baf-b3bb-408b-b191-1c3f7d83e7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.572975 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e5baf-b3bb-408b-b191-1c3f7d83e7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:16.574569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e5baf-b3bb-408b-b191-1c3f7d83e7f1 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:16.584533 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1022/2048] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:40:16.588818 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e5baf-b3bb-408b-b191-1c3f7d83e7f1 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:16.603298 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e5baf-b3bb-408b-b191-1c3f7d83e7f1 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:16.607958 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec78c37600a4949bc177baa1e274139', 'request_id': 'req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.613746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec78c37600a4949bc177baa1e274139', 'request_id': 'req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.664985 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177a9cf-30b9-4416-81db-25e84df091ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:16.665662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177a9cf-30b9-4416-81db-25e84df091ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:16.665952 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177a9cf-30b9-4416-81db-25e84df091ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:16.666261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177a9cf-30b9-4416-81db-25e84df091ae admin admin] PATH_INFO: `/v3/projects/e004d80679784783a1f13d99e7bc0b1d/users/7e92df732abc406e8e49f270fac56e91/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.682493 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177a9cf-30b9-4416-81db-25e84df091ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e004d80679784783a1f13d99e7bc0b1d, user_id=7e92df732abc406e8e49f270fac56e91, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:16.685685 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177a9cf-30b9-4416-81db-25e84df091ae admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:16.697650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec78c37600a4949bc177baa1e274139', 'request_id': 'req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.710693 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] The token cache is being invalidate because project 4ec78c37600a4949bc177baa1e274139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:16.710972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.711864 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.713768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1027/2049] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:16 2022] DELETE /identity/v3/projects/4ec78c37600a4949bc177baa1e274139 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:16.714633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:16.717430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:16.732216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f68ed0-1a0b-4db2-a7f7-c8c92e1b1db8 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:16.737668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:16.738630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:16.738950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:16.739271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] PATH_INFO: `/v3/projects/3693de902107479a92170d4cc04533a2` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.740644 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3693de902107479a92170d4cc04533a2)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:16.742978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:16.778326 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1023/2050] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:16 2022] PUT /identity/v3/projects/e004d80679784783a1f13d99e7bc0b1d/users/7e92df732abc406e8e49f270fac56e91/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:16.784535 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891aa2-34e8-4dd8-b6bb-e8f3b1a74528 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:16.785001 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891aa2-34e8-4dd8-b6bb-e8f3b1a74528 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:16.785089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891aa2-34e8-4dd8-b6bb-e8f3b1a74528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.802417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-88891aa2-34e8-4dd8-b6bb-e8f3b1a74528 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:16.803619 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-88891aa2-34e8-4dd8-b6bb-e8f3b1a74528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:16.852057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3693de902107479a92170d4cc04533a2', 'request_id': 'req-01bb9c19-bfea-40b2-9713-122cca8a3517'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.857328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3693de902107479a92170d4cc04533a2', 'request_id': 'req-01bb9c19-bfea-40b2-9713-122cca8a3517'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.860291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1024/2051] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:16.862389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d746e-3009-440b-ac39-18a8f8433345 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:16.862389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d746e-3009-440b-ac39-18a8f8433345 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:16.862389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d746e-3009-440b-ac39-18a8f8433345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.878902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-017d746e-3009-440b-ac39-18a8f8433345 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:16.880082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-017d746e-3009-440b-ac39-18a8f8433345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:16.936167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1025/2052] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:16.937459 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43698b7b-a7cb-44e6-89ef-6474d63cd563 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:16.937754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43698b7b-a7cb-44e6-89ef-6474d63cd563 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:16.938028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43698b7b-a7cb-44e6-89ef-6474d63cd563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.954385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3693de902107479a92170d4cc04533a2', 'request_id': 'req-01bb9c19-bfea-40b2-9713-122cca8a3517'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.957044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-43698b7b-a7cb-44e6-89ef-6474d63cd563 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:16.958242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-43698b7b-a7cb-44e6-89ef-6474d63cd563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:16.968473 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1026/2053] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:16.968623 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] The token cache is being invalidate because project 3693de902107479a92170d4cc04533a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:16.968623 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.972686 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43698b7b-a7cb-44e6-89ef-6474d63cd563 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:16.972822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:16.972907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-43698b7b-a7cb-44e6-89ef-6474d63cd563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:16.972982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1028/2054] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:16 2022] DELETE /identity/v3/projects/3693de902107479a92170d4cc04533a2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:16.974935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:16.976314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:16.988818 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb9c19-bfea-40b2-9713-122cca8a3517 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:16.996354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc5f06-c3ee-4bb5-8527-f55b09e04ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:16.997011 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc5f06-c3ee-4bb5-8527-f55b09e04ace admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:16.997299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc5f06-c3ee-4bb5-8527-f55b09e04ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:16.997578 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc5f06-c3ee-4bb5-8527-f55b09e04ace admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:16.998302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc5f06-c3ee-4bb5-8527-f55b09e04ace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:40:16.998612 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc5f06-c3ee-4bb5-8527-f55b09e04ace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:17.000217 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc5f06-c3ee-4bb5-8527-f55b09e04ace admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:17.015428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1029/2055] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:40:17.015428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc5f06-c3ee-4bb5-8527-f55b09e04ace admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:17.015428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-afdc5f06-c3ee-4bb5-8527-f55b09e04ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:17.026534 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43698b7b-a7cb-44e6-89ef-6474d63cd563 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:17.026803 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc5f06-c3ee-4bb5-8527-f55b09e04ace admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:17.030709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2d6e8-84e9-410c-aaf8-6a9c6af23027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:17.031378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2d6e8-84e9-410c-aaf8-6a9c6af23027 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:17.031663 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2d6e8-84e9-410c-aaf8-6a9c6af23027 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:17.031939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2d6e8-84e9-410c-aaf8-6a9c6af23027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:17.032071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:17.032948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:17.033236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:17.033520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] PATH_INFO: `/v3/users/602b805808744cf299b4fc53bfef0285` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:17.033751 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b3d2d6e8-84e9-410c-aaf8-6a9c6af23027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:17.034770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=602b805808744cf299b4fc53bfef0285)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:17.036703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:17.045193 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2d6e8-84e9-410c-aaf8-6a9c6af23027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:17.046625 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2d6e8-84e9-410c-aaf8-6a9c6af23027 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:17.056013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1027/2056] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:17.056882 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2d6e8-84e9-410c-aaf8-6a9c6af23027 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:17.066473 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2d6e8-84e9-410c-aaf8-6a9c6af23027 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:17.071136 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9951ba-d33b-4bbd-a782-c3b7ffa1e2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:17.071800 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9951ba-d33b-4bbd-a782-c3b7ffa1e2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:17.073624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9951ba-d33b-4bbd-a782-c3b7ffa1e2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:17.073624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9951ba-d33b-4bbd-a782-c3b7ffa1e2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:17.073624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9951ba-d33b-4bbd-a782-c3b7ffa1e2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:17.074929 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9951ba-d33b-4bbd-a782-c3b7ffa1e2b0 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:17.236255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1028/2057] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:17 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:17.240193 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9951ba-d33b-4bbd-a782-c3b7ffa1e2b0 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:17.276635 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602b805808744cf299b4fc53bfef0285'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:17.277289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602b805808744cf299b4fc53bfef0285'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:17.304448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9951ba-d33b-4bbd-a782-c3b7ffa1e2b0 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:17.309189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70c3d0-086f-4486-832c-ce70ab241383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:17.310661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70c3d0-086f-4486-832c-ce70ab241383 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:17.310949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70c3d0-086f-4486-832c-ce70ab241383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:17.311228 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70c3d0-086f-4486-832c-ce70ab241383 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:17.311923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70c3d0-086f-4486-832c-ce70ab241383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:17.313958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70c3d0-086f-4486-832c-ce70ab241383 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:17.368647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602b805808744cf299b4fc53bfef0285'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:17.369340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602b805808744cf299b4fc53bfef0285'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:17.382652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602b805808744cf299b4fc53bfef0285'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:17.396965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1030/2058] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:17 2022] DELETE /identity/v3/users/602b805808744cf299b4fc53bfef0285 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:17.428098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1029/2059] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:17 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:40:17.429563 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:17.431261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:17.500489 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653af7cd-46e1-41f9-b7fa-6679a9eb1f36 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:17.505280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaff8b-bf14-4e97-832c-9f41169fdaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:17.514374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaff8b-bf14-4e97-832c-9f41169fdaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:17.514374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaff8b-bf14-4e97-832c-9f41169fdaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:17.514374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaff8b-bf14-4e97-832c-9f41169fdaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:17.514374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaff8b-bf14-4e97-832c-9f41169fdaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:17.514374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaff8b-bf14-4e97-832c-9f41169fdaa7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:17.518709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1031/2060] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:40:17.522762 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70c3d0-086f-4486-832c-ce70ab241383 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:17.533146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70c3d0-086f-4486-832c-ce70ab241383 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:17.538795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcc370-ddf9-4b8f-921f-ba34147a5444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:17.539846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcc370-ddf9-4b8f-921f-ba34147a5444 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:17.540169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcc370-ddf9-4b8f-921f-ba34147a5444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:17.540451 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcc370-ddf9-4b8f-921f-ba34147a5444 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:17.541184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcc370-ddf9-4b8f-921f-ba34147a5444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:17.542851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcc370-ddf9-4b8f-921f-ba34147a5444 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:17.558393 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1030/2061] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:17.560870 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaff8b-bf14-4e97-832c-9f41169fdaa7 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:17.571857 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaff8b-bf14-4e97-832c-9f41169fdaa7 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:17.577536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b134fb5-a323-4f5b-baae-0afb66087cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:17.578425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b134fb5-a323-4f5b-baae-0afb66087cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:17.578707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b134fb5-a323-4f5b-baae-0afb66087cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:17.578988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b134fb5-a323-4f5b-baae-0afb66087cb4 admin admin] PATH_INFO: `/v3/projects/5250fdc56e194e06b309fb04dc17bb64/users/0e22f221d715417a8ba1145f006e216c/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:17.608259 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b134fb5-a323-4f5b-baae-0afb66087cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5250fdc56e194e06b309fb04dc17bb64, user_id=0e22f221d715417a8ba1145f006e216c, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:17.612100 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b134fb5-a323-4f5b-baae-0afb66087cb4 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:17.713396 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1032/2062] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:17 2022] PUT /identity/v3/projects/5250fdc56e194e06b309fb04dc17bb64/users/0e22f221d715417a8ba1145f006e216c/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:17.726605 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2973-b2d0-4207-99fd-70f0e4dea235 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:17.726900 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2973-b2d0-4207-99fd-70f0e4dea235 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:17.727184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c2973-b2d0-4207-99fd-70f0e4dea235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:17.757874 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-a97c2973-b2d0-4207-99fd-70f0e4dea235 None None] MFA Rules not processed for user `0e22f221d715417a8ba1145f006e216c`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:17.759551 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a97c2973-b2d0-4207-99fd-70f0e4dea235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:17.819472 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b134fb5-a323-4f5b-baae-0afb66087cb4 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:17.821255 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2b134fb5-a323-4f5b-baae-0afb66087cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:17.835505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1031/2063] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:17.841979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c2973-b2d0-4207-99fd-70f0e4dea235 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:17.902418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b134fb5-a323-4f5b-baae-0afb66087cb4 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:17.908058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c800b13-e29c-4d62-804c-5d15e8c077b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:17.909265 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c800b13-e29c-4d62-804c-5d15e8c077b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:17.909616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c800b13-e29c-4d62-804c-5d15e8c077b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:17.909997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c800b13-e29c-4d62-804c-5d15e8c077b3 admin admin] PATH_INFO: `/v3/projects/3c1055e7f60946f2ba437393b15761b9` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:17.911261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c800b13-e29c-4d62-804c-5d15e8c077b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1055e7f60946f2ba437393b15761b9)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:17.913353 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c800b13-e29c-4d62-804c-5d15e8c077b3 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:17.916515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c2973-b2d0-4207-99fd-70f0e4dea235 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:17.922222 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a22f20-0428-494e-87f3-9033bbcf3469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:17.922723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a22f20-0428-494e-87f3-9033bbcf3469 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:17.923003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a22f20-0428-494e-87f3-9033bbcf3469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:17.923275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a22f20-0428-494e-87f3-9033bbcf3469 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:17.923962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a22f20-0428-494e-87f3-9033bbcf3469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:17.925930 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a22f20-0428-494e-87f3-9033bbcf3469 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.009778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2c800b13-e29c-4d62-804c-5d15e8c077b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1055e7f60946f2ba437393b15761b9', 'request_id': 'req-2c800b13-e29c-4d62-804c-5d15e8c077b3'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:18.016622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2c800b13-e29c-4d62-804c-5d15e8c077b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1055e7f60946f2ba437393b15761b9', 'request_id': 'req-2c800b13-e29c-4d62-804c-5d15e8c077b3'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:18.034799 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1032/2064] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:17 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:18.035520 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a22f20-0428-494e-87f3-9033bbcf3469 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:18.096164 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2c800b13-e29c-4d62-804c-5d15e8c077b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1055e7f60946f2ba437393b15761b9', 'request_id': 'req-2c800b13-e29c-4d62-804c-5d15e8c077b3'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:18.101483 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a22f20-0428-494e-87f3-9033bbcf3469 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:18.106677 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305af9d-4735-4ca3-88ed-ed4621701f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:18.107402 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305af9d-4735-4ca3-88ed-ed4621701f4d admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.107700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305af9d-4735-4ca3-88ed-ed4621701f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.107978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305af9d-4735-4ca3-88ed-ed4621701f4d admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.108300 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2c800b13-e29c-4d62-804c-5d15e8c077b3 admin admin] The token cache is being invalidate because project 3c1055e7f60946f2ba437393b15761b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:18.108592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2c800b13-e29c-4d62-804c-5d15e8c077b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:18.108693 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305af9d-4735-4ca3-88ed-ed4621701f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:18.109271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2c800b13-e29c-4d62-804c-5d15e8c077b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:18.110659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305af9d-4735-4ca3-88ed-ed4621701f4d admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.110779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1033/2065] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:17 2022] DELETE /identity/v3/projects/3c1055e7f60946f2ba437393b15761b9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:18.116882 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd685d-6a12-40a7-8739-4f212a07895a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.117167 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd685d-6a12-40a7-8739-4f212a07895a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.117470 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd685d-6a12-40a7-8739-4f212a07895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.136226 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f0fd685d-6a12-40a7-8739-4f212a07895a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:18.137455 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f0fd685d-6a12-40a7-8739-4f212a07895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:18.146068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1034/2066] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:40:18.155412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081067fd-d8d3-40fe-a382-7f1acddffccc None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.155705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081067fd-d8d3-40fe-a382-7f1acddffccc None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.155987 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081067fd-d8d3-40fe-a382-7f1acddffccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.175851 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-081067fd-d8d3-40fe-a382-7f1acddffccc None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:18.177092 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-081067fd-d8d3-40fe-a382-7f1acddffccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:18.186149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1035/2067] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:40:18.190170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081067fd-d8d3-40fe-a382-7f1acddffccc None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:18.199012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081067fd-d8d3-40fe-a382-7f1acddffccc None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:18.204173 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc982d-ae5d-474b-8aa9-b4aba41ef495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:18.204795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc982d-ae5d-474b-8aa9-b4aba41ef495 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.205074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc982d-ae5d-474b-8aa9-b4aba41ef495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.205347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc982d-ae5d-474b-8aa9-b4aba41ef495 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.206059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc982d-ae5d-474b-8aa9-b4aba41ef495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:40:18.206364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc982d-ae5d-474b-8aa9-b4aba41ef495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:18.207935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc982d-ae5d-474b-8aa9-b4aba41ef495 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.219529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1033/2068] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:18 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:18.228486 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1036/2069] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:40:18.231276 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305af9d-4735-4ca3-88ed-ed4621701f4d admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:18.234012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc982d-ae5d-474b-8aa9-b4aba41ef495 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:18.234621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3305af9d-4735-4ca3-88ed-ed4621701f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:18.244413 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc982d-ae5d-474b-8aa9-b4aba41ef495 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:18.247002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305af9d-4735-4ca3-88ed-ed4621701f4d admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:18.249872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375a4c3-ed95-4403-9e39-646a4fbbb547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:18.250526 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375a4c3-ed95-4403-9e39-646a4fbbb547 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.250835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375a4c3-ed95-4403-9e39-646a4fbbb547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.251129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375a4c3-ed95-4403-9e39-646a4fbbb547 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.251813 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375a4c3-ed95-4403-9e39-646a4fbbb547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:18.253287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b388cce-6265-46f1-be13-7bfa5aa5409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:18.257018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375a4c3-ed95-4403-9e39-646a4fbbb547 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.257173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b388cce-6265-46f1-be13-7bfa5aa5409d admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.257173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b388cce-6265-46f1-be13-7bfa5aa5409d admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.257173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b388cce-6265-46f1-be13-7bfa5aa5409d admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.257173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b388cce-6265-46f1-be13-7bfa5aa5409d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:18.257173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b388cce-6265-46f1-be13-7bfa5aa5409d admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.268324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1034/2070] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:18.272421 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b388cce-6265-46f1-be13-7bfa5aa5409d admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:18.282272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b388cce-6265-46f1-be13-7bfa5aa5409d admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:18.287514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2af4-e60a-43ca-88e0-22b7389d03e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:18.288427 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2af4-e60a-43ca-88e0-22b7389d03e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.288710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2af4-e60a-43ca-88e0-22b7389d03e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.288984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba2af4-e60a-43ca-88e0-22b7389d03e9 admin admin] PATH_INFO: `/v3/projects/9aa6dc454be7464491a9f538f7ad3eb6/users/63ef0675b11e4b3784bf6a8e8fbe8939/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.304241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba2af4-e60a-43ca-88e0-22b7389d03e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa6dc454be7464491a9f538f7ad3eb6, user_id=63ef0675b11e4b3784bf6a8e8fbe8939, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:18.306900 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba2af4-e60a-43ca-88e0-22b7389d03e9 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.360688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1037/2071] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:18 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:40:18.365835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375a4c3-ed95-4403-9e39-646a4fbbb547 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:18.416892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1035/2072] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:18 2022] PUT /identity/v3/projects/9aa6dc454be7464491a9f538f7ad3eb6/users/63ef0675b11e4b3784bf6a8e8fbe8939/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:18.422012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2af4-e60a-43ca-88e0-22b7389d03e9 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:18.441386 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375a4c3-ed95-4403-9e39-646a4fbbb547 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:18.505250 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557a3d8-268e-4d2a-8a3a-3f500c4f39da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:18.505951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557a3d8-268e-4d2a-8a3a-3f500c4f39da admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.506232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557a3d8-268e-4d2a-8a3a-3f500c4f39da admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.506506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557a3d8-268e-4d2a-8a3a-3f500c4f39da admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.507254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557a3d8-268e-4d2a-8a3a-3f500c4f39da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:18.509404 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557a3d8-268e-4d2a-8a3a-3f500c4f39da admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.511487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba2af4-e60a-43ca-88e0-22b7389d03e9 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:18.516645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32782d96-31c4-4580-a5c1-9b7185fd3359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:18.517388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32782d96-31c4-4580-a5c1-9b7185fd3359 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.517673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32782d96-31c4-4580-a5c1-9b7185fd3359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.517951 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32782d96-31c4-4580-a5c1-9b7185fd3359 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.518761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32782d96-31c4-4580-a5c1-9b7185fd3359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:18.520335 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32782d96-31c4-4580-a5c1-9b7185fd3359 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.531053 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1036/2073] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:40:18.534412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32782d96-31c4-4580-a5c1-9b7185fd3359 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:18.543802 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32782d96-31c4-4580-a5c1-9b7185fd3359 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:18.549053 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1545d0-ca7a-4e17-b841-d84f722b1b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:18.549894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1545d0-ca7a-4e17-b841-d84f722b1b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.550178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1545d0-ca7a-4e17-b841-d84f722b1b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.550453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1545d0-ca7a-4e17-b841-d84f722b1b48 admin admin] PATH_INFO: `/v3/projects/9aa6dc454be7464491a9f538f7ad3eb6/users/63ef0675b11e4b3784bf6a8e8fbe8939/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.552445 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1545d0-ca7a-4e17-b841-d84f722b1b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa6dc454be7464491a9f538f7ad3eb6, user_id=63ef0675b11e4b3784bf6a8e8fbe8939, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:18.555147 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1545d0-ca7a-4e17-b841-d84f722b1b48 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.565900 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1037/2074] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:18 2022] PUT /identity/v3/projects/9aa6dc454be7464491a9f538f7ad3eb6/users/63ef0675b11e4b3784bf6a8e8fbe8939/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:18.577307 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c429e31-9d98-433a-a8a8-8f1cdd606376 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.577591 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c429e31-9d98-433a-a8a8-8f1cdd606376 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.577863 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c429e31-9d98-433a-a8a8-8f1cdd606376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.604785 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-5c429e31-9d98-433a-a8a8-8f1cdd606376 None None] MFA Rules not processed for user `63ef0675b11e4b3784bf6a8e8fbe8939`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:18.605904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-5c429e31-9d98-433a-a8a8-8f1cdd606376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:18.617485 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1038/2075] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:18 2022] POST /identity/v3/users => generated 283 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:40:18.618886 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557a3d8-268e-4d2a-8a3a-3f500c4f39da admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:18.630029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557a3d8-268e-4d2a-8a3a-3f500c4f39da admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:18.680765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1038/2076] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:18.691974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c29e1-9c88-4815-8e92-a0ee139d11f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:18.692641 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c429e31-9d98-433a-a8a8-8f1cdd606376 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:18.692927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c29e1-9c88-4815-8e92-a0ee139d11f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.693315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c29e1-9c88-4815-8e92-a0ee139d11f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.693692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c29e1-9c88-4815-8e92-a0ee139d11f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.694009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-5c429e31-9d98-433a-a8a8-8f1cdd606376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:18.694642 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c29e1-9c88-4815-8e92-a0ee139d11f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:18.696973 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c29e1-9c88-4815-8e92-a0ee139d11f8 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.710429 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1039/2077] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:40:18.711964 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c29e1-9c88-4815-8e92-a0ee139d11f8 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:18.729392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c29e1-9c88-4815-8e92-a0ee139d11f8 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:18.738479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c573b0-5f20-45c2-b95f-2b626e8e7ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:18.739329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c573b0-5f20-45c2-b95f-2b626e8e7ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.739839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c573b0-5f20-45c2-b95f-2b626e8e7ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.740082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c573b0-5f20-45c2-b95f-2b626e8e7ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.741064 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c573b0-5f20-45c2-b95f-2b626e8e7ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:18.743990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c573b0-5f20-45c2-b95f-2b626e8e7ed3 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.758781 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1040/2078] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:40:18.759715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c573b0-5f20-45c2-b95f-2b626e8e7ed3 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:18.774360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c573b0-5f20-45c2-b95f-2b626e8e7ed3 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:18.774524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c429e31-9d98-433a-a8a8-8f1cdd606376 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:18.775032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51fc83-edfe-4b26-8b31-8120f8d26a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:18.775414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51fc83-edfe-4b26-8b31-8120f8d26a72 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.775527 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0c6ac-35e6-48bc-b234-58c5f191e264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:18.775825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51fc83-edfe-4b26-8b31-8120f8d26a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.776211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51fc83-edfe-4b26-8b31-8120f8d26a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.776635 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0c6ac-35e6-48bc-b234-58c5f191e264 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.777052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0c6ac-35e6-48bc-b234-58c5f191e264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.777342 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0c6ac-35e6-48bc-b234-58c5f191e264 admin admin] PATH_INFO: `/v3/projects/9efbc6196bc64af4b8064e89e3dc57fb/users/1045ea30ce454ca0b9fc2bf3cb544236/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.778998 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-da51fc83-edfe-4b26-8b31-8120f8d26a72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:18.793208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0c6ac-35e6-48bc-b234-58c5f191e264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efbc6196bc64af4b8064e89e3dc57fb, user_id=1045ea30ce454ca0b9fc2bf3cb544236, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:18.796800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0c6ac-35e6-48bc-b234-58c5f191e264 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.843031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51fc83-edfe-4b26-8b31-8120f8d26a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:18.844804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51fc83-edfe-4b26-8b31-8120f8d26a72 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:18.854078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1039/2079] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:40:18.893531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1041/2080] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:18 2022] PUT /identity/v3/projects/9efbc6196bc64af4b8064e89e3dc57fb/users/1045ea30ce454ca0b9fc2bf3cb544236/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:18.905627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53de1f-063c-42ab-a640-b36527dfccdf None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:18.906675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53de1f-063c-42ab-a640-b36527dfccdf None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:18.906675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53de1f-063c-42ab-a640-b36527dfccdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:18.938533 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-4a53de1f-063c-42ab-a640-b36527dfccdf None None] MFA Rules not processed for user `1045ea30ce454ca0b9fc2bf3cb544236`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:18.940324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4a53de1f-063c-42ab-a640-b36527dfccdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:19.022066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1040/2081] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:19.026719 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0c6ac-35e6-48bc-b234-58c5f191e264 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:19.090713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0c6ac-35e6-48bc-b234-58c5f191e264 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:19.102774 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e1b25-3dd6-4133-94a5-390769933982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:19.103671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e1b25-3dd6-4133-94a5-390769933982 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:19.104103 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e1b25-3dd6-4133-94a5-390769933982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:19.104476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e1b25-3dd6-4133-94a5-390769933982 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:19.105318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e1b25-3dd6-4133-94a5-390769933982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:19.107359 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e1b25-3dd6-4133-94a5-390769933982 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:19.237122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53de1f-063c-42ab-a640-b36527dfccdf None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:19.238071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1042/2082] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:19 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:40:19.251637 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53de1f-063c-42ab-a640-b36527dfccdf None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:19.314104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74122c2-6707-4b36-bed1-0bad3ba84c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:19.314687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74122c2-6707-4b36-bed1-0bad3ba84c67 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:19.314974 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74122c2-6707-4b36-bed1-0bad3ba84c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:19.315253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74122c2-6707-4b36-bed1-0bad3ba84c67 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:19.315940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74122c2-6707-4b36-bed1-0bad3ba84c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:19.317910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74122c2-6707-4b36-bed1-0bad3ba84c67 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:19.410608 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1041/2083] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:19 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:40:19.412742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e1b25-3dd6-4133-94a5-390769933982 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:19.425365 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e1b25-3dd6-4133-94a5-390769933982 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:19.431346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba112-3b4f-4eaa-84eb-e3c20d293904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:19.432415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba112-3b4f-4eaa-84eb-e3c20d293904 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:19.438927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba112-3b4f-4eaa-84eb-e3c20d293904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:19.438927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba112-3b4f-4eaa-84eb-e3c20d293904 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:19.438927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfba112-3b4f-4eaa-84eb-e3c20d293904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:19.438927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfba112-3b4f-4eaa-84eb-e3c20d293904 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:19.449057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1043/2084] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:19.460382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74122c2-6707-4b36-bed1-0bad3ba84c67 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:19.472379 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74122c2-6707-4b36-bed1-0bad3ba84c67 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:19.478005 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addbbbe-ad98-4152-bae8-2629d6e06b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:19.478894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addbbbe-ad98-4152-bae8-2629d6e06b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:19.479177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addbbbe-ad98-4152-bae8-2629d6e06b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:19.479452 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addbbbe-ad98-4152-bae8-2629d6e06b31 admin admin] PATH_INFO: `/v3/projects/a767af6a8d894d988c9d2d8064e12e55/users/21bef45d362b41a786a8901ea1a1f575/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:19.506260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addbbbe-ad98-4152-bae8-2629d6e06b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a767af6a8d894d988c9d2d8064e12e55, user_id=21bef45d362b41a786a8901ea1a1f575, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:19.509779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addbbbe-ad98-4152-bae8-2629d6e06b31 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:19.663220 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1042/2085] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:19 2022] PUT /identity/v3/projects/a767af6a8d894d988c9d2d8064e12e55/users/21bef45d362b41a786a8901ea1a1f575/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:19.667201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba112-3b4f-4eaa-84eb-e3c20d293904 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:19.677422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba112-3b4f-4eaa-84eb-e3c20d293904 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:19.740690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40a112-2d22-4f89-8713-8ddb4ea2698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:19.741378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40a112-2d22-4f89-8713-8ddb4ea2698c admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:19.741919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40a112-2d22-4f89-8713-8ddb4ea2698c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:19.742061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40a112-2d22-4f89-8713-8ddb4ea2698c admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:19.742733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40a112-2d22-4f89-8713-8ddb4ea2698c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:19.744473 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40a112-2d22-4f89-8713-8ddb4ea2698c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:19.755888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1044/2086] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:19.760499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addbbbe-ad98-4152-bae8-2629d6e06b31 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:19.771025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addbbbe-ad98-4152-bae8-2629d6e06b31 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:19.775857 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82f451-5cfb-40ab-a24e-5b386c11a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:19.777083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82f451-5cfb-40ab-a24e-5b386c11a9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:19.777367 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82f451-5cfb-40ab-a24e-5b386c11a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:19.777635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82f451-5cfb-40ab-a24e-5b386c11a9c2 admin admin] PATH_INFO: `/v3/projects/a767af6a8d894d988c9d2d8064e12e55/users/21bef45d362b41a786a8901ea1a1f575/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:19.779644 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82f451-5cfb-40ab-a24e-5b386c11a9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a767af6a8d894d988c9d2d8064e12e55, user_id=21bef45d362b41a786a8901ea1a1f575, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:19.782305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82f451-5cfb-40ab-a24e-5b386c11a9c2 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:19.793305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1043/2087] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:19 2022] PUT /identity/v3/projects/a767af6a8d894d988c9d2d8064e12e55/users/21bef45d362b41a786a8901ea1a1f575/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:19.804005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17603de-26b6-4346-b749-960e1f4360ce None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:19.804337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17603de-26b6-4346-b749-960e1f4360ce None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:19.804620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17603de-26b6-4346-b749-960e1f4360ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:19.834088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-e17603de-26b6-4346-b749-960e1f4360ce None None] MFA Rules not processed for user `21bef45d362b41a786a8901ea1a1f575`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:19.835275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e17603de-26b6-4346-b749-960e1f4360ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:19.909239 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1045/2088] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:40:19.921519 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82f451-5cfb-40ab-a24e-5b386c11a9c2 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:19.981885 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82f451-5cfb-40ab-a24e-5b386c11a9c2 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:19.986293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f7f3c-36b5-4fbc-a446-d79a0d13aee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:19.986942 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f7f3c-36b5-4fbc-a446-d79a0d13aee9 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:19.987225 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f7f3c-36b5-4fbc-a446-d79a0d13aee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:19.987522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f7f3c-36b5-4fbc-a446-d79a0d13aee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:19.997025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f7f3c-36b5-4fbc-a446-d79a0d13aee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:19.998979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f7f3c-36b5-4fbc-a446-d79a0d13aee9 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:20.008880 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1044/2089] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:20.229189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17603de-26b6-4346-b749-960e1f4360ce None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:20.230941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e17603de-26b6-4346-b749-960e1f4360ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:20.243103 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17603de-26b6-4346-b749-960e1f4360ce None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:20.246766 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ae243-2c0c-4c28-a00b-d871d7547751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:20.247399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ae243-2c0c-4c28-a00b-d871d7547751 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:20.247676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ae243-2c0c-4c28-a00b-d871d7547751 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:20.247950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ae243-2c0c-4c28-a00b-d871d7547751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:20.305631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ae243-2c0c-4c28-a00b-d871d7547751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:20.307091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ae243-2c0c-4c28-a00b-d871d7547751 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:20.316718 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1046/2090] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:22.609714 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501ad5c-e578-48db-8709-26f454b32500 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:22.610258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501ad5c-e578-48db-8709-26f454b32500 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:22.610258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501ad5c-e578-48db-8709-26f454b32500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:22.637759 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-1501ad5c-e578-48db-8709-26f454b32500 None None] MFA Rules not processed for user `7e92df732abc406e8e49f270fac56e91`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:22.639018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1501ad5c-e578-48db-8709-26f454b32500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:22.726539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1045/2091] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:22.736550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292c075-2e08-4ce5-8448-7256b3aa9f2a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:22.737081 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292c075-2e08-4ce5-8448-7256b3aa9f2a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:22.737081 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292c075-2e08-4ce5-8448-7256b3aa9f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:22.754765 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5292c075-2e08-4ce5-8448-7256b3aa9f2a None None] MFA Rules not processed for user `7e92df732abc406e8e49f270fac56e91`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:22.755982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5292c075-2e08-4ce5-8448-7256b3aa9f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:22.763915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1047/2092] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:22.774502 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501ad5c-e578-48db-8709-26f454b32500 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:22.777823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1501ad5c-e578-48db-8709-26f454b32500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:22.867173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501ad5c-e578-48db-8709-26f454b32500 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:22.872702 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483fe17-944c-448c-bf77-e4429ebef2a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:22.873341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483fe17-944c-448c-bf77-e4429ebef2a0 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:22.873623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483fe17-944c-448c-bf77-e4429ebef2a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:22.873896 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483fe17-944c-448c-bf77-e4429ebef2a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:22.882367 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483fe17-944c-448c-bf77-e4429ebef2a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:22.883967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483fe17-944c-448c-bf77-e4429ebef2a0 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:22.893755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1046/2093] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:23.575932 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6565f-f795-4beb-9a0f-5614ae3c60ac None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:23.576432 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6565f-f795-4beb-9a0f-5614ae3c60ac None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:23.576810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6565f-f795-4beb-9a0f-5614ae3c60ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:23.596176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-68b6565f-f795-4beb-9a0f-5614ae3c60ac None None] MFA Rules not processed for user `7e92df732abc406e8e49f270fac56e91`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:23.597515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-68b6565f-f795-4beb-9a0f-5614ae3c60ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:23.608219 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1048/2094] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:27.667610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483fe17-944c-448c-bf77-e4429ebef2a0 service nova] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:27.865577 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483fe17-944c-448c-bf77-e4429ebef2a0 service nova] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:27.871278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:27.872984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:27.873428 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:27.873861 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] PATH_INFO: `/v3/users/0e22f221d715417a8ba1145f006e216c` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:27.876211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e22f221d715417a8ba1145f006e216c)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:27.878331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:28.221124 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e22f221d715417a8ba1145f006e216c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:28.307933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e22f221d715417a8ba1145f006e216c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:28.321136 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e22f221d715417a8ba1145f006e216c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:28.322113 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e22f221d715417a8ba1145f006e216c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:28.329956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e22f221d715417a8ba1145f006e216c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:28.336405 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1047/2095] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:27 2022] DELETE /identity/v3/users/0e22f221d715417a8ba1145f006e216c => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:28.343628 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490f516-1192-4cd6-80b7-654070b624e4 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:28.344037 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490f516-1192-4cd6-80b7-654070b624e4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:28.344306 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490f516-1192-4cd6-80b7-654070b624e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:28.367663 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5490f516-1192-4cd6-80b7-654070b624e4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:28.369602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5490f516-1192-4cd6-80b7-654070b624e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:28.441919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1049/2096] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:40:28.452206 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:28.453696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:28.512971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241669e8-790a-4f5b-a467-5f8f810325f7 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:28.524288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86922b69-88f3-4daf-9b06-f906a091fc4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:28.524288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86922b69-88f3-4daf-9b06-f906a091fc4c service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:28.524288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86922b69-88f3-4daf-9b06-f906a091fc4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:28.524288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86922b69-88f3-4daf-9b06-f906a091fc4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:28.537253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86922b69-88f3-4daf-9b06-f906a091fc4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:28.539247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86922b69-88f3-4daf-9b06-f906a091fc4c service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:28.553101 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1048/2097] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:29.122048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490f516-1192-4cd6-80b7-654070b624e4 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:29.127731 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5490f516-1192-4cd6-80b7-654070b624e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:29.145506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490f516-1192-4cd6-80b7-654070b624e4 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:29.150715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:29.151576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:29.152030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:29.153122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] PATH_INFO: `/v3/projects/5250fdc56e194e06b309fb04dc17bb64` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:29.154848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5250fdc56e194e06b309fb04dc17bb64)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:29.161239 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:29.311375 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5250fdc56e194e06b309fb04dc17bb64', 'request_id': 'req-ff82a118-2752-469e-ae70-a7bb6f4009ca'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:29.319638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5250fdc56e194e06b309fb04dc17bb64', 'request_id': 'req-ff82a118-2752-469e-ae70-a7bb6f4009ca'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:29.416972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5250fdc56e194e06b309fb04dc17bb64', 'request_id': 'req-ff82a118-2752-469e-ae70-a7bb6f4009ca'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:29.428386 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] The token cache is being invalidate because project 5250fdc56e194e06b309fb04dc17bb64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:29.428677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:29.429310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:29.430909 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1050/2098] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:29 2022] DELETE /identity/v3/projects/5250fdc56e194e06b309fb04dc17bb64 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:29.435539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86922b69-88f3-4daf-9b06-f906a091fc4c service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:29.450215 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86922b69-88f3-4daf-9b06-f906a091fc4c service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:29.517398 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae33891-ffb2-46a5-ba57-638514f4e9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:29.518330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae33891-ffb2-46a5-ba57-638514f4e9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:29.518560 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae33891-ffb2-46a5-ba57-638514f4e9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:29.518839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae33891-ffb2-46a5-ba57-638514f4e9f8 admin admin] PATH_INFO: `/v3/users/63ef0675b11e4b3784bf6a8e8fbe8939` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:29.520068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae33891-ffb2-46a5-ba57-638514f4e9f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ef0675b11e4b3784bf6a8e8fbe8939)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:29.522122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae33891-ffb2-46a5-ba57-638514f4e9f8 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:29.721269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-eae33891-ffb2-46a5-ba57-638514f4e9f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ef0675b11e4b3784bf6a8e8fbe8939'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:29.856461 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-eae33891-ffb2-46a5-ba57-638514f4e9f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ef0675b11e4b3784bf6a8e8fbe8939'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:29.872661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-eae33891-ffb2-46a5-ba57-638514f4e9f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ef0675b11e4b3784bf6a8e8fbe8939'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:29.873458 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-eae33891-ffb2-46a5-ba57-638514f4e9f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ef0675b11e4b3784bf6a8e8fbe8939'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:29.881544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-eae33891-ffb2-46a5-ba57-638514f4e9f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ef0675b11e4b3784bf6a8e8fbe8939'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:29.888414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1049/2099] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:29 2022] DELETE /identity/v3/users/63ef0675b11e4b3784bf6a8e8fbe8939 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:30.395688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:30.397237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:30.410941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82a118-2752-469e-ae70-a7bb6f4009ca admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:30.465786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747da18d-b757-401b-ab69-25f3dd078591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:30.467044 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747da18d-b757-401b-ab69-25f3dd078591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:30.467044 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747da18d-b757-401b-ab69-25f3dd078591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:30.467289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747da18d-b757-401b-ab69-25f3dd078591 admin admin] PATH_INFO: `/v3/projects/9aa6dc454be7464491a9f538f7ad3eb6` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:30.468371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747da18d-b757-401b-ab69-25f3dd078591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa6dc454be7464491a9f538f7ad3eb6)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:30.470269 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747da18d-b757-401b-ab69-25f3dd078591 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:30.577133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-747da18d-b757-401b-ab69-25f3dd078591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa6dc454be7464491a9f538f7ad3eb6', 'request_id': 'req-747da18d-b757-401b-ab69-25f3dd078591'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:30.582339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-747da18d-b757-401b-ab69-25f3dd078591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa6dc454be7464491a9f538f7ad3eb6', 'request_id': 'req-747da18d-b757-401b-ab69-25f3dd078591'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:30.656415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-747da18d-b757-401b-ab69-25f3dd078591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa6dc454be7464491a9f538f7ad3eb6', 'request_id': 'req-747da18d-b757-401b-ab69-25f3dd078591'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:30.668378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-747da18d-b757-401b-ab69-25f3dd078591 admin admin] The token cache is being invalidate because project 9aa6dc454be7464491a9f538f7ad3eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:30.668682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-747da18d-b757-401b-ab69-25f3dd078591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:30.669320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-747da18d-b757-401b-ab69-25f3dd078591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:30.670856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1051/2100] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:30 2022] DELETE /identity/v3/projects/9aa6dc454be7464491a9f538f7ad3eb6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:30.682350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f52bc-6905-4dc7-8417-ac1bdd548dd7 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:30.682894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f52bc-6905-4dc7-8417-ac1bdd548dd7 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:30.683138 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f52bc-6905-4dc7-8417-ac1bdd548dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:30.705337 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-834f52bc-6905-4dc7-8417-ac1bdd548dd7 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:30.709897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-834f52bc-6905-4dc7-8417-ac1bdd548dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:30.766664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1050/2101] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:30.774528 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c98ee-f464-4a0f-bccc-85c5b3434b8a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:30.774891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c98ee-f464-4a0f-bccc-85c5b3434b8a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:30.775182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c98ee-f464-4a0f-bccc-85c5b3434b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:30.793627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-e79c98ee-f464-4a0f-bccc-85c5b3434b8a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:30.794819 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e79c98ee-f464-4a0f-bccc-85c5b3434b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:30.802794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1052/2102] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:40:30.806994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f52bc-6905-4dc7-8417-ac1bdd548dd7 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:30.817110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f52bc-6905-4dc7-8417-ac1bdd548dd7 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:30.821991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92ffe7-548f-47e6-86f3-83e5a53fb01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:30.822280 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92ffe7-548f-47e6-86f3-83e5a53fb01c admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:30.822565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92ffe7-548f-47e6-86f3-83e5a53fb01c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:30.822839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92ffe7-548f-47e6-86f3-83e5a53fb01c admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:30.823549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92ffe7-548f-47e6-86f3-83e5a53fb01c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:40:30.823853 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92ffe7-548f-47e6-86f3-83e5a53fb01c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:30.826111 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92ffe7-548f-47e6-86f3-83e5a53fb01c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:30.836956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1051/2103] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:40:30.841058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c98ee-f464-4a0f-bccc-85c5b3434b8a None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:30.850078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c98ee-f464-4a0f-bccc-85c5b3434b8a None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:30.854880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdf613-53f6-4fa9-bd17-3017e82ffa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:30.855516 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdf613-53f6-4fa9-bd17-3017e82ffa8f admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:30.855829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdf613-53f6-4fa9-bd17-3017e82ffa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:30.856113 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdf613-53f6-4fa9-bd17-3017e82ffa8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:30.856844 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdf613-53f6-4fa9-bd17-3017e82ffa8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:30.858734 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdf613-53f6-4fa9-bd17-3017e82ffa8f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:30.938230 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1053/2104] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:30 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:30.942346 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92ffe7-548f-47e6-86f3-83e5a53fb01c admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:30.952758 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92ffe7-548f-47e6-86f3-83e5a53fb01c admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:31.007189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb5825-7873-4da3-86f3-865cf0f52c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:31.007862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb5825-7873-4da3-86f3-865cf0f52c10 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:31.008179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb5825-7873-4da3-86f3-865cf0f52c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:31.008454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb5825-7873-4da3-86f3-865cf0f52c10 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:31.009147 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb5825-7873-4da3-86f3-865cf0f52c10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:31.011096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb5825-7873-4da3-86f3-865cf0f52c10 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:31.141651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1052/2105] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:30 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:40:31.149298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdf613-53f6-4fa9-bd17-3017e82ffa8f admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:31.161206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdf613-53f6-4fa9-bd17-3017e82ffa8f admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:31.167088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025ff33-79be-479c-a128-9c6e84d1d3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:31.167805 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025ff33-79be-479c-a128-9c6e84d1d3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:31.168624 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025ff33-79be-479c-a128-9c6e84d1d3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:31.168906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025ff33-79be-479c-a128-9c6e84d1d3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:31.169676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025ff33-79be-479c-a128-9c6e84d1d3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:31.171497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025ff33-79be-479c-a128-9c6e84d1d3d0 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:31.183069 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1054/2106] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:31.189213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb5825-7873-4da3-86f3-865cf0f52c10 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:31.201466 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb5825-7873-4da3-86f3-865cf0f52c10 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:31.206496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6704a-4f7f-4f4d-ba3c-c7d2cec282f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:31.207097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6704a-4f7f-4f4d-ba3c-c7d2cec282f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:31.207384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6704a-4f7f-4f4d-ba3c-c7d2cec282f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:31.207865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6704a-4f7f-4f4d-ba3c-c7d2cec282f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:31.208650 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6704a-4f7f-4f4d-ba3c-c7d2cec282f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:31.210303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6704a-4f7f-4f4d-ba3c-c7d2cec282f5 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:31.222744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1053/2107] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:40:31.227002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025ff33-79be-479c-a128-9c6e84d1d3d0 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:31.238791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025ff33-79be-479c-a128-9c6e84d1d3d0 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:31.243646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1625b-a5a7-4c41-8e2a-0412af5f9d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:31.244642 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1625b-a5a7-4c41-8e2a-0412af5f9d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:31.244994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1625b-a5a7-4c41-8e2a-0412af5f9d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:31.245464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1625b-a5a7-4c41-8e2a-0412af5f9d34 admin admin] PATH_INFO: `/v3/projects/c953ad9e6bb34ff794fc4b1d2abe456d/users/d4eaddc6bda3475bac2e4923dea36d3c/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:31.263450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1625b-a5a7-4c41-8e2a-0412af5f9d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c953ad9e6bb34ff794fc4b1d2abe456d, user_id=d4eaddc6bda3475bac2e4923dea36d3c, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:31.266541 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1625b-a5a7-4c41-8e2a-0412af5f9d34 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:31.320891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1055/2108] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:31 2022] PUT /identity/v3/projects/c953ad9e6bb34ff794fc4b1d2abe456d/users/d4eaddc6bda3475bac2e4923dea36d3c/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:31.335098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca99db-16e6-442c-8c72-6005740b88cd None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:31.335389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca99db-16e6-442c-8c72-6005740b88cd None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:31.335688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca99db-16e6-442c-8c72-6005740b88cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:31.390698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-0aca99db-16e6-442c-8c72-6005740b88cd None None] MFA Rules not processed for user `d4eaddc6bda3475bac2e4923dea36d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:31.391907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0aca99db-16e6-442c-8c72-6005740b88cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:31.475135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1054/2109] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:31.489515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1625b-a5a7-4c41-8e2a-0412af5f9d34 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:31.493236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ddd1625b-a5a7-4c41-8e2a-0412af5f9d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:31.560443 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1625b-a5a7-4c41-8e2a-0412af5f9d34 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:31.565329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00935f47-26c8-4c2c-812c-73a7e66866bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:31.566172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00935f47-26c8-4c2c-812c-73a7e66866bd service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:31.566626 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00935f47-26c8-4c2c-812c-73a7e66866bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:31.566909 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00935f47-26c8-4c2c-812c-73a7e66866bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:31.576369 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00935f47-26c8-4c2c-812c-73a7e66866bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:31.577815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00935f47-26c8-4c2c-812c-73a7e66866bd service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:31.594508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1056/2110] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:33.587727 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca99db-16e6-442c-8c72-6005740b88cd None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:33.589344 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0aca99db-16e6-442c-8c72-6005740b88cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:33.655439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca99db-16e6-442c-8c72-6005740b88cd None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:33.661501 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:33.662448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:33.662791 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:33.663191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] PATH_INFO: `/v3/users/1045ea30ce454ca0b9fc2bf3cb544236` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:33.666945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1045ea30ce454ca0b9fc2bf3cb544236)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:33.666945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:33.896375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1045ea30ce454ca0b9fc2bf3cb544236'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:33.999110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1045ea30ce454ca0b9fc2bf3cb544236'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.023449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1045ea30ce454ca0b9fc2bf3cb544236'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.025838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1045ea30ce454ca0b9fc2bf3cb544236'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.035239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1045ea30ce454ca0b9fc2bf3cb544236'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.044183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1055/2111] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:33 2022] DELETE /identity/v3/users/1045ea30ce454ca0b9fc2bf3cb544236 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:34.048612 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754d9af-da2f-4825-8f63-3f80c5f37d7f None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:34.049077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754d9af-da2f-4825-8f63-3f80c5f37d7f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:34.049177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754d9af-da2f-4825-8f63-3f80c5f37d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:34.071009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-7754d9af-da2f-4825-8f63-3f80c5f37d7f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:34.072703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7754d9af-da2f-4825-8f63-3f80c5f37d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:34.149048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1057/2112] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:34.161310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:34.162763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:34.230076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261dec4-c23e-444c-a823-d07ead0da08b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:34.234338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b3e13-787f-4b56-8859-e1f437bc3b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:34.234991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b3e13-787f-4b56-8859-e1f437bc3b05 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:34.235274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b3e13-787f-4b56-8859-e1f437bc3b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:34.235553 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b3e13-787f-4b56-8859-e1f437bc3b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:34.244895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b3e13-787f-4b56-8859-e1f437bc3b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:34.246919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b3e13-787f-4b56-8859-e1f437bc3b05 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:34.256932 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1056/2113] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:40:34.528574 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754d9af-da2f-4825-8f63-3f80c5f37d7f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:34.529726 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7754d9af-da2f-4825-8f63-3f80c5f37d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:34.543558 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754d9af-da2f-4825-8f63-3f80c5f37d7f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:34.548595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:34.549475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:34.549754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:34.550030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] PATH_INFO: `/v3/users/d6655396ca7547e68d85ff81ffb9a666` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:34.551225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6655396ca7547e68d85ff81ffb9a666)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:34.553335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:34.667312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b3e13-787f-4b56-8859-e1f437bc3b05 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:34.668732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-173b3e13-787f-4b56-8859-e1f437bc3b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:34.683822 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b3e13-787f-4b56-8859-e1f437bc3b05 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:34.690707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022d937-83e7-4622-806f-88fcfe7eb287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:34.690707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022d937-83e7-4622-806f-88fcfe7eb287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:34.690707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022d937-83e7-4622-806f-88fcfe7eb287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:34.690707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022d937-83e7-4622-806f-88fcfe7eb287 admin admin] PATH_INFO: `/v3/projects/9efbc6196bc64af4b8064e89e3dc57fb` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:34.692999 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022d937-83e7-4622-806f-88fcfe7eb287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9efbc6196bc64af4b8064e89e3dc57fb)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:34.695056 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022d937-83e7-4622-806f-88fcfe7eb287 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:34.742662 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6655396ca7547e68d85ff81ffb9a666'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.743358 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6655396ca7547e68d85ff81ffb9a666'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.833345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1022d937-83e7-4622-806f-88fcfe7eb287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efbc6196bc64af4b8064e89e3dc57fb', 'request_id': 'req-1022d937-83e7-4622-806f-88fcfe7eb287'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.838794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1022d937-83e7-4622-806f-88fcfe7eb287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efbc6196bc64af4b8064e89e3dc57fb', 'request_id': 'req-1022d937-83e7-4622-806f-88fcfe7eb287'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.845322 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1022d937-83e7-4622-806f-88fcfe7eb287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efbc6196bc64af4b8064e89e3dc57fb', 'request_id': 'req-1022d937-83e7-4622-806f-88fcfe7eb287'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.850814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6655396ca7547e68d85ff81ffb9a666'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.851453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6655396ca7547e68d85ff81ffb9a666'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.863388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6655396ca7547e68d85ff81ffb9a666'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.874942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1058/2114] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:34 2022] DELETE /identity/v3/users/d6655396ca7547e68d85ff81ffb9a666 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:34.878008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:34.878008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:34.937766 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23f98b-073a-4515-ad0a-3f6faf9448e5 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:34.947010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1022d937-83e7-4622-806f-88fcfe7eb287 admin admin] The token cache is being invalidate because project 9efbc6196bc64af4b8064e89e3dc57fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:34.947010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1022d937-83e7-4622-806f-88fcfe7eb287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.947010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1022d937-83e7-4622-806f-88fcfe7eb287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:34.947305 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:34.947305 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:34.947305 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:34.947649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1057/2115] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:34 2022] DELETE /identity/v3/projects/9efbc6196bc64af4b8064e89e3dc57fb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:34.947733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] PATH_INFO: `/v3/users/d4eaddc6bda3475bac2e4923dea36d3c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:34.947733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4eaddc6bda3475bac2e4923dea36d3c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:34.947881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ea313-54c9-4b3c-90a3-5edaa1bc05d0 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:34.947881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ea313-54c9-4b3c-90a3-5edaa1bc05d0 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:34.947881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ea313-54c9-4b3c-90a3-5edaa1bc05d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:34.948100 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:34.965934 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-446ea313-54c9-4b3c-90a3-5edaa1bc05d0 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:34.967149 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-446ea313-54c9-4b3c-90a3-5edaa1bc05d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:34.975391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1058/2116] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:34.976194 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ea313-54c9-4b3c-90a3-5edaa1bc05d0 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:34.977411 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-446ea313-54c9-4b3c-90a3-5edaa1bc05d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:34.989105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ea313-54c9-4b3c-90a3-5edaa1bc05d0 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:34.993959 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:34.994833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:34.995111 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:34.995409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] PATH_INFO: `/v3/users/21bef45d362b41a786a8901ea1a1f575` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:34.997078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21bef45d362b41a786a8901ea1a1f575)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:34.999024 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:35.121911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4eaddc6bda3475bac2e4923dea36d3c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.121911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4eaddc6bda3475bac2e4923dea36d3c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.215916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21bef45d362b41a786a8901ea1a1f575'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.228176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4eaddc6bda3475bac2e4923dea36d3c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.228966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4eaddc6bda3475bac2e4923dea36d3c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.243174 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4eaddc6bda3475bac2e4923dea36d3c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.259278 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1059/2117] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:34 2022] DELETE /identity/v3/users/d4eaddc6bda3475bac2e4923dea36d3c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:35.261204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:35.263924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:35.325390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21bef45d362b41a786a8901ea1a1f575'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.330331 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c315e-0c0c-4d1c-8b21-712fe01ce7c3 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:35.334045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5691c5-6081-40da-a8e1-17ba0aaa4b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:35.334687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5691c5-6081-40da-a8e1-17ba0aaa4b53 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:35.334974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5691c5-6081-40da-a8e1-17ba0aaa4b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:35.335266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5691c5-6081-40da-a8e1-17ba0aaa4b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:35.337341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-aa5691c5-6081-40da-a8e1-17ba0aaa4b53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:35.338811 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21bef45d362b41a786a8901ea1a1f575'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.339559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21bef45d362b41a786a8901ea1a1f575'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.346544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21bef45d362b41a786a8901ea1a1f575'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.355541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1059/2118] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:34 2022] DELETE /identity/v3/users/21bef45d362b41a786a8901ea1a1f575 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:35.355541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:35.357198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:35.413447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5691c5-6081-40da-a8e1-17ba0aaa4b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:35.414965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5691c5-6081-40da-a8e1-17ba0aaa4b53 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:35.424624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514287f-4552-4723-9dc0-a593b6929411 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:35.425961 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1060/2119] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:35.427564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e870-1e49-4533-870c-c3727ffe49f9 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:35.428012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e870-1e49-4533-870c-c3727ffe49f9 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:35.428615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4e870-1e49-4533-870c-c3727ffe49f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:35.430150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:35.431102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:35.431455 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:35.431848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] PATH_INFO: `/v3/users/133049c03baa4fe2a3cda02ed35b2d44` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:35.433315 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133049c03baa4fe2a3cda02ed35b2d44)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:35.436249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:35.448697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-6cc4e870-1e49-4533-870c-c3727ffe49f9 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:35.450581 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-6cc4e870-1e49-4533-870c-c3727ffe49f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:35.459510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1061/2120] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:35.471146 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4e870-1e49-4533-870c-c3727ffe49f9 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:35.472724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-6cc4e870-1e49-4533-870c-c3727ffe49f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:35.541493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4e870-1e49-4533-870c-c3727ffe49f9 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:35.545669 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed3898-149a-4401-8abc-afd15e42293b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:35.546352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed3898-149a-4401-8abc-afd15e42293b service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:35.546639 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed3898-149a-4401-8abc-afd15e42293b service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:35.546944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed3898-149a-4401-8abc-afd15e42293b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:35.556298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed3898-149a-4401-8abc-afd15e42293b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:35.557743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed3898-149a-4401-8abc-afd15e42293b service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:35.576232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1062/2121] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:35.718601 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133049c03baa4fe2a3cda02ed35b2d44'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.821954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133049c03baa4fe2a3cda02ed35b2d44'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.838344 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133049c03baa4fe2a3cda02ed35b2d44'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.839137 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133049c03baa4fe2a3cda02ed35b2d44'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.846738 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133049c03baa4fe2a3cda02ed35b2d44'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:35.852685 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1060/2122] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:35 2022] DELETE /identity/v3/users/133049c03baa4fe2a3cda02ed35b2d44 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:35.857881 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fda9b-5913-45d7-9a8e-679293f19733 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:35.858250 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fda9b-5913-45d7-9a8e-679293f19733 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:35.858604 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fda9b-5913-45d7-9a8e-679293f19733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:35.886777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a19fda9b-5913-45d7-9a8e-679293f19733 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:35.888234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a19fda9b-5913-45d7-9a8e-679293f19733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:35.951116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1063/2123] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:35.954304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:35.963824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:35.972297 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fda9b-5913-45d7-9a8e-679293f19733 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:35.974514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a19fda9b-5913-45d7-9a8e-679293f19733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:36.008833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb79360-61ef-4fa7-8cb4-16312f75f025 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:36.021536 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:36.022568 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:36.022850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:36.023126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] PATH_INFO: `/v3/projects/a767af6a8d894d988c9d2d8064e12e55` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:36.024816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a767af6a8d894d988c9d2d8064e12e55)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:36.029300 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:36.052862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fda9b-5913-45d7-9a8e-679293f19733 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:36.056970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cb6cc-94c9-4f9c-97a9-a1494c41a45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:36.057735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cb6cc-94c9-4f9c-97a9-a1494c41a45d service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:36.058126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cb6cc-94c9-4f9c-97a9-a1494c41a45d service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:36.058543 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cb6cc-94c9-4f9c-97a9-a1494c41a45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:36.073974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cb6cc-94c9-4f9c-97a9-a1494c41a45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:36.073974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2cb6cc-94c9-4f9c-97a9-a1494c41a45d service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:36.082419 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1064/2124] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:36.082686 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cb6cc-94c9-4f9c-97a9-a1494c41a45d service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:36.084595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3f2cb6cc-94c9-4f9c-97a9-a1494c41a45d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:36.104704 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cb6cc-94c9-4f9c-97a9-a1494c41a45d service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:36.111995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:36.113176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:36.114066 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:36.115107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a admin admin] PATH_INFO: `/v3/projects/fadba8d7c7934bbfa7ba479edcda305f` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:36.119398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fadba8d7c7934bbfa7ba479edcda305f)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:36.123029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:36.148129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a767af6a8d894d988c9d2d8064e12e55', 'request_id': 'req-60771b23-34d4-4891-af08-8a7445e8aba2'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.166745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a767af6a8d894d988c9d2d8064e12e55', 'request_id': 'req-60771b23-34d4-4891-af08-8a7445e8aba2'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.175266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a767af6a8d894d988c9d2d8064e12e55', 'request_id': 'req-60771b23-34d4-4891-af08-8a7445e8aba2'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.240114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fadba8d7c7934bbfa7ba479edcda305f', 'request_id': 'req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.241177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] The token cache is being invalidate because project a767af6a8d894d988c9d2d8064e12e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:36.241495 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.242184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.247271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1061/2125] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:35 2022] DELETE /identity/v3/projects/a767af6a8d894d988c9d2d8064e12e55 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:36.247271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:36.247499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fadba8d7c7934bbfa7ba479edcda305f', 'request_id': 'req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.249565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:36.313611 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fadba8d7c7934bbfa7ba479edcda305f', 'request_id': 'req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.333510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a admin admin] The token cache is being invalidate because project fadba8d7c7934bbfa7ba479edcda305f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:36.333811 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.341268 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e8eecefe-8fc5-48ef-8d2d-d676ee25792a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.345126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1065/2126] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:36 2022] DELETE /identity/v3/projects/fadba8d7c7934bbfa7ba479edcda305f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:36.347309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d2fa4-240b-4d20-86c9-f2abdf4928a0 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:36.348375 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d2fa4-240b-4d20-86c9-f2abdf4928a0 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:36.348676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d2fa4-240b-4d20-86c9-f2abdf4928a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:36.372767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-602d2fa4-240b-4d20-86c9-f2abdf4928a0 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:36.374095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60771b23-34d4-4891-af08-8a7445e8aba2 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:36.374610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-602d2fa4-240b-4d20-86c9-f2abdf4928a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:36.438084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:36.439912 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:36.440346 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:36.440632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04 admin admin] PATH_INFO: `/v3/projects/c953ad9e6bb34ff794fc4b1d2abe456d` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:36.442033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c953ad9e6bb34ff794fc4b1d2abe456d)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:36.443988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:36.456828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1066/2127] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:36.456828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d2fa4-240b-4d20-86c9-f2abdf4928a0 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:36.456828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-602d2fa4-240b-4d20-86c9-f2abdf4928a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:36.467688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d2fa4-240b-4d20-86c9-f2abdf4928a0 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:36.473587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492e14c-624a-4526-8408-a7a9710c6c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:36.474533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492e14c-624a-4526-8408-a7a9710c6c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:36.475215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492e14c-624a-4526-8408-a7a9710c6c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:36.475215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492e14c-624a-4526-8408-a7a9710c6c82 admin admin] PATH_INFO: `/v3/users/e832c254993848c1beb8f4116647af3f` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:36.476834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492e14c-624a-4526-8408-a7a9710c6c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e832c254993848c1beb8f4116647af3f)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:36.478913 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492e14c-624a-4526-8408-a7a9710c6c82 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:36.532915 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c953ad9e6bb34ff794fc4b1d2abe456d', 'request_id': 'req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.546742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c953ad9e6bb34ff794fc4b1d2abe456d', 'request_id': 'req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.546971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c953ad9e6bb34ff794fc4b1d2abe456d', 'request_id': 'req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.622518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04 admin admin] The token cache is being invalidate because project c953ad9e6bb34ff794fc4b1d2abe456d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:36.622813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.623450 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1bee0a74-fc32-48a0-bb8e-1a8751e80b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.625017 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1062/2128] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:36 2022] DELETE /identity/v3/projects/c953ad9e6bb34ff794fc4b1d2abe456d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:36.626246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09138d2-a4df-4056-a4c5-7ae02a434579 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:36.626535 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09138d2-a4df-4056-a4c5-7ae02a434579 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:36.626813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09138d2-a4df-4056-a4c5-7ae02a434579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:36.644939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-a09138d2-a4df-4056-a4c5-7ae02a434579 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:36.646366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a09138d2-a4df-4056-a4c5-7ae02a434579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:36.658411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7492e14c-624a-4526-8408-a7a9710c6c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e832c254993848c1beb8f4116647af3f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.659081 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7492e14c-624a-4526-8408-a7a9710c6c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e832c254993848c1beb8f4116647af3f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.707797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1063/2129] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:36.708997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09138d2-a4df-4056-a4c5-7ae02a434579 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:36.710498 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a09138d2-a4df-4056-a4c5-7ae02a434579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:36.722383 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09138d2-a4df-4056-a4c5-7ae02a434579 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:36.726954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:36.727789 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:36.728075 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:36.728394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] PATH_INFO: `/v3/projects/2bb39c194e3546d0b9c9afbd3e27b345` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:36.729599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb39c194e3546d0b9c9afbd3e27b345)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:36.731375 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7492e14c-624a-4526-8408-a7a9710c6c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e832c254993848c1beb8f4116647af3f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.732009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7492e14c-624a-4526-8408-a7a9710c6c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e832c254993848c1beb8f4116647af3f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.732103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:36.744817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7492e14c-624a-4526-8408-a7a9710c6c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e832c254993848c1beb8f4116647af3f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.757474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1067/2130] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:36 2022] DELETE /identity/v3/users/e832c254993848c1beb8f4116647af3f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:36.758752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198bbdb-70d1-4dee-a951-7397e9ff36be None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:36.759045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198bbdb-70d1-4dee-a951-7397e9ff36be None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:36.759324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198bbdb-70d1-4dee-a951-7397e9ff36be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:36.778808 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-1198bbdb-70d1-4dee-a951-7397e9ff36be None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:36.780013 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-1198bbdb-70d1-4dee-a951-7397e9ff36be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:36.852186 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1068/2131] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:36.853180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198bbdb-70d1-4dee-a951-7397e9ff36be None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:36.859017 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb39c194e3546d0b9c9afbd3e27b345', 'request_id': 'req-21b2af2f-5b8f-484e-959a-af07d3a8c773'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.865778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198bbdb-70d1-4dee-a951-7397e9ff36be None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:36.865989 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb39c194e3546d0b9c9afbd3e27b345', 'request_id': 'req-21b2af2f-5b8f-484e-959a-af07d3a8c773'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.872391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb39c194e3546d0b9c9afbd3e27b345', 'request_id': 'req-21b2af2f-5b8f-484e-959a-af07d3a8c773'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.924347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76100b00-c7d1-4790-a729-6cb74e2473b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:36.925008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76100b00-c7d1-4790-a729-6cb74e2473b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:36.925294 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76100b00-c7d1-4790-a729-6cb74e2473b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:36.925633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76100b00-c7d1-4790-a729-6cb74e2473b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:36.926358 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76100b00-c7d1-4790-a729-6cb74e2473b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:40:36.926667 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76100b00-c7d1-4790-a729-6cb74e2473b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:36.928309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76100b00-c7d1-4790-a729-6cb74e2473b1 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:36.942651 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1069/2132] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:40:36.947967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] The token cache is being invalidate because project 2bb39c194e3546d0b9c9afbd3e27b345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:36.948286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.950282 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a2e73-9458-47d7-9e58-cb6c967ed5c7 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:36.950568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a2e73-9458-47d7-9e58-cb6c967ed5c7 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:36.950842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a2e73-9458-47d7-9e58-cb6c967ed5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:36.952491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:36.954087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1064/2133] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:36 2022] DELETE /identity/v3/projects/2bb39c194e3546d0b9c9afbd3e27b345 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:36.954828 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:36.956187 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:36.971860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2af2f-5b8f-484e-959a-af07d3a8c773 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:36.977665 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a87aa-e2f0-4615-a8f3-087def875b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:36.978324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a87aa-e2f0-4615-a8f3-087def875b19 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:36.978602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a87aa-e2f0-4615-a8f3-087def875b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:36.978926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a87aa-e2f0-4615-a8f3-087def875b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:36.979702 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a87aa-e2f0-4615-a8f3-087def875b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:36.980424 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-265a2e73-9458-47d7-9e58-cb6c967ed5c7 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:36.981711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a87aa-e2f0-4615-a8f3-087def875b19 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:36.981827 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-265a2e73-9458-47d7-9e58-cb6c967ed5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:36.999957 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1070/2134] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:37.001588 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a7054-e12c-4861-a6d9-d87bf9d73b90 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.001885 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a7054-e12c-4861-a6d9-d87bf9d73b90 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.002169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a7054-e12c-4861-a6d9-d87bf9d73b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.025671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-ae8a7054-e12c-4861-a6d9-d87bf9d73b90 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:37.027209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ae8a7054-e12c-4861-a6d9-d87bf9d73b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:37.036266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1071/2135] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:37.037122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a7054-e12c-4861-a6d9-d87bf9d73b90 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.052643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a7054-e12c-4861-a6d9-d87bf9d73b90 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.056865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1065/2136] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:36 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:37.059569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228351b6-af1f-4810-8cf1-9544ac339f17 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.060330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228351b6-af1f-4810-8cf1-9544ac339f17 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.060808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228351b6-af1f-4810-8cf1-9544ac339f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.082704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-228351b6-af1f-4810-8cf1-9544ac339f17 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:37.084041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-228351b6-af1f-4810-8cf1-9544ac339f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:37.132099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4223e-a4b4-47f4-8bde-d8b1c4bbf964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.132856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4223e-a4b4-47f4-8bde-d8b1c4bbf964 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.133245 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4223e-a4b4-47f4-8bde-d8b1c4bbf964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.133584 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4223e-a4b4-47f4-8bde-d8b1c4bbf964 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.134499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4223e-a4b4-47f4-8bde-d8b1c4bbf964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:40:37.134926 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4223e-a4b4-47f4-8bde-d8b1c4bbf964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.136721 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4223e-a4b4-47f4-8bde-d8b1c4bbf964 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.151624 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1072/2137] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:40:37.152609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4223e-a4b4-47f4-8bde-d8b1c4bbf964 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.162795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4223e-a4b4-47f4-8bde-d8b1c4bbf964 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.167641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0adcf-453b-4e31-9c82-6a75ce73ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.168915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0adcf-453b-4e31-9c82-6a75ce73ecc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.169280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0adcf-453b-4e31-9c82-6a75ce73ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.169632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0adcf-453b-4e31-9c82-6a75ce73ecc6 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.170401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0adcf-453b-4e31-9c82-6a75ce73ecc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.170981 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1066/2138] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:37.172079 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228351b6-af1f-4810-8cf1-9544ac339f17 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.174023 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0adcf-453b-4e31-9c82-6a75ce73ecc6 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.186289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228351b6-af1f-4810-8cf1-9544ac339f17 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.191014 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368dec1-be6f-4a11-968f-a1c7790eb312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.191675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368dec1-be6f-4a11-968f-a1c7790eb312 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.192055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368dec1-be6f-4a11-968f-a1c7790eb312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.192273 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368dec1-be6f-4a11-968f-a1c7790eb312 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.192968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368dec1-be6f-4a11-968f-a1c7790eb312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.194880 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368dec1-be6f-4a11-968f-a1c7790eb312 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.264402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1073/2139] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:37 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:37.265510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0adcf-453b-4e31-9c82-6a75ce73ecc6 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.275399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0adcf-453b-4e31-9c82-6a75ce73ecc6 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.280236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c83f0-9334-4197-b913-6e89de63b21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.280817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c83f0-9334-4197-b913-6e89de63b21f admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.281105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c83f0-9334-4197-b913-6e89de63b21f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.281415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c83f0-9334-4197-b913-6e89de63b21f admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.282149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c83f0-9334-4197-b913-6e89de63b21f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:40:37.282459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c83f0-9334-4197-b913-6e89de63b21f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.284050 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c83f0-9334-4197-b913-6e89de63b21f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.296850 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1074/2140] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:40:37.297779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c83f0-9334-4197-b913-6e89de63b21f admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.299428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-835c83f0-9334-4197-b913-6e89de63b21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:37.312513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c83f0-9334-4197-b913-6e89de63b21f admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.317402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.318281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.318565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.318839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] PATH_INFO: `/v3/projects/c0a59855787840a3a99707b54545954e` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.320014 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a59855787840a3a99707b54545954e)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.321953 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.331874 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1067/2141] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:37 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:37.333075 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368dec1-be6f-4a11-968f-a1c7790eb312 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.399006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368dec1-be6f-4a11-968f-a1c7790eb312 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.404453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af00ac7-cf91-4919-a158-6f4b33bc139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.405303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00ac7-cf91-4919-a158-6f4b33bc139e admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.405594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00ac7-cf91-4919-a158-6f4b33bc139e admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.405873 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00ac7-cf91-4919-a158-6f4b33bc139e admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.407754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af00ac7-cf91-4919-a158-6f4b33bc139e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.410983 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af00ac7-cf91-4919-a158-6f4b33bc139e admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.430927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1068/2142] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:37.432322 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af00ac7-cf91-4919-a158-6f4b33bc139e admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.445782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af00ac7-cf91-4919-a158-6f4b33bc139e admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.457916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a59855787840a3a99707b54545954e', 'request_id': 'req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:37.464250 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a59855787840a3a99707b54545954e', 'request_id': 'req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:37.537039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba600dc-8812-4911-ab6d-48ac27a2c08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.537703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba600dc-8812-4911-ab6d-48ac27a2c08a admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.538039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba600dc-8812-4911-ab6d-48ac27a2c08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.538626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba600dc-8812-4911-ab6d-48ac27a2c08a admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.539134 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba600dc-8812-4911-ab6d-48ac27a2c08a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.541561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba600dc-8812-4911-ab6d-48ac27a2c08a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.551415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a59855787840a3a99707b54545954e', 'request_id': 'req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:37.593959 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] The token cache is being invalidate because project c0a59855787840a3a99707b54545954e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:37.594338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:37.596632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:37.598197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1075/2143] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:37 2022] DELETE /identity/v3/projects/c0a59855787840a3a99707b54545954e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:37.599339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.601799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:37.624599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bfb20-d3db-47a0-adf8-c6eb0fdd8209 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.630156 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6fe55-36a8-4baa-b754-7fe73a56e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.631098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6fe55-36a8-4baa-b754-7fe73a56e529 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.631524 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6fe55-36a8-4baa-b754-7fe73a56e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.632112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6fe55-36a8-4baa-b754-7fe73a56e529 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.633256 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6fe55-36a8-4baa-b754-7fe73a56e529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.636794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6fe55-36a8-4baa-b754-7fe73a56e529 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.709731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1069/2144] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:37 2022] POST /identity/v3/projects => generated 375 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:37.710664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba600dc-8812-4911-ab6d-48ac27a2c08a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.712432 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-aba600dc-8812-4911-ab6d-48ac27a2c08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:37.754760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1076/2145] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:37 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:37.756178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc2c63-7fa7-4553-82eb-1b4042058da2 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.756478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc2c63-7fa7-4553-82eb-1b4042058da2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.758039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc2c63-7fa7-4553-82eb-1b4042058da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.796615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-decc2c63-7fa7-4553-82eb-1b4042058da2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:37.797845 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-decc2c63-7fa7-4553-82eb-1b4042058da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:37.801118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba600dc-8812-4911-ab6d-48ac27a2c08a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.806183 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1077/2146] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:37.806470 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd56ab-cfa7-4555-a31f-456c7bdec130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.807070 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc2c63-7fa7-4553-82eb-1b4042058da2 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.807180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd56ab-cfa7-4555-a31f-456c7bdec130 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.807401 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd56ab-cfa7-4555-a31f-456c7bdec130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.807674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd56ab-cfa7-4555-a31f-456c7bdec130 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.808459 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd56ab-cfa7-4555-a31f-456c7bdec130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.810491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd56ab-cfa7-4555-a31f-456c7bdec130 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.817293 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-decc2c63-7fa7-4553-82eb-1b4042058da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:37.821052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1070/2147] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:37.821914 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd56ab-cfa7-4555-a31f-456c7bdec130 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.831162 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc2c63-7fa7-4553-82eb-1b4042058da2 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.831944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd56ab-cfa7-4555-a31f-456c7bdec130 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.835978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48df87e-c3db-44e6-8819-830e624b9394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.836650 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e670926-878f-47ce-9e87-b701f952e7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.836779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48df87e-c3db-44e6-8819-830e624b9394 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.837007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48df87e-c3db-44e6-8819-830e624b9394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.838008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48df87e-c3db-44e6-8819-830e624b9394 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.838251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e670926-878f-47ce-9e87-b701f952e7ee admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.838251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e670926-878f-47ce-9e87-b701f952e7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.838251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e670926-878f-47ce-9e87-b701f952e7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.838573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48df87e-c3db-44e6-8819-830e624b9394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.838714 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e670926-878f-47ce-9e87-b701f952e7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.840771 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48df87e-c3db-44e6-8819-830e624b9394 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.859618 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e670926-878f-47ce-9e87-b701f952e7ee admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.881854 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1071/2148] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:37.883429 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77ee6-babf-404f-b54e-2f956d742bf5 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.884109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77ee6-babf-404f-b54e-2f956d742bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.884640 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77ee6-babf-404f-b54e-2f956d742bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.906720 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-c0e77ee6-babf-404f-b54e-2f956d742bf5 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:37.908815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c0e77ee6-babf-404f-b54e-2f956d742bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:37.921824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1072/2149] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:37.923283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e77ee6-babf-404f-b54e-2f956d742bf5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.935638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e77ee6-babf-404f-b54e-2f956d742bf5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.943491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2571f6-98ac-462b-8e56-c6b48435ac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.944656 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2571f6-98ac-462b-8e56-c6b48435ac88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.946772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2571f6-98ac-462b-8e56-c6b48435ac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.946772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2571f6-98ac-462b-8e56-c6b48435ac88 admin admin] PATH_INFO: `/v3/projects/86301fa71e874428bf4624eb4015bd15/users/2323762c0b0b478ab554b57ba34ebaf2/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.947240 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1078/2150] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:37 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:37.948247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48df87e-c3db-44e6-8819-830e624b9394 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:37.966499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48df87e-c3db-44e6-8819-830e624b9394 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:37.971265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2571f6-98ac-462b-8e56-c6b48435ac88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86301fa71e874428bf4624eb4015bd15, user_id=2323762c0b0b478ab554b57ba34ebaf2, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.974000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2571f6-98ac-462b-8e56-c6b48435ac88 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.982367 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ed1f2-954f-4754-b787-6182939b1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:37.982933 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ed1f2-954f-4754-b787-6182939b1b2c admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:37.984939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ed1f2-954f-4754-b787-6182939b1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:37.984939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ed1f2-954f-4754-b787-6182939b1b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:37.984939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ed1f2-954f-4754-b787-6182939b1b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:37.985826 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ed1f2-954f-4754-b787-6182939b1b2c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:37.996187 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1079/2151] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:37.996916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ed1f2-954f-4754-b787-6182939b1b2c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.007021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ed1f2-954f-4754-b787-6182939b1b2c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.012579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e8ff0-0fd1-4a62-9174-d263492ec55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.013952 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e8ff0-0fd1-4a62-9174-d263492ec55b admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.014252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e8ff0-0fd1-4a62-9174-d263492ec55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.016047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e8ff0-0fd1-4a62-9174-d263492ec55b admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.016047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e8ff0-0fd1-4a62-9174-d263492ec55b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:40:38.016047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e8ff0-0fd1-4a62-9174-d263492ec55b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.017332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e8ff0-0fd1-4a62-9174-d263492ec55b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:38.031145 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1080/2152] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:40:38.031875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e8ff0-0fd1-4a62-9174-d263492ec55b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.042329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e8ff0-0fd1-4a62-9174-d263492ec55b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.048479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dd177-27b4-47dc-bf87-4f19e92ff137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.049173 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dd177-27b4-47dc-bf87-4f19e92ff137 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.049715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dd177-27b4-47dc-bf87-4f19e92ff137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.049992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939dd177-27b4-47dc-bf87-4f19e92ff137 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.050727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dd177-27b4-47dc-bf87-4f19e92ff137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.052375 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939dd177-27b4-47dc-bf87-4f19e92ff137 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:38.062234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1073/2153] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:37 2022] PUT /identity/v3/projects/86301fa71e874428bf4624eb4015bd15/users/2323762c0b0b478ab554b57ba34ebaf2/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:38.062234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2571f6-98ac-462b-8e56-c6b48435ac88 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.073114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1081/2154] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:38.073976 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dd177-27b4-47dc-bf87-4f19e92ff137 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.084772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939dd177-27b4-47dc-bf87-4f19e92ff137 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.135354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2571f6-98ac-462b-8e56-c6b48435ac88 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.148928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17530f08-d9d2-4347-8f08-1c62f5655ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.149951 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17530f08-d9d2-4347-8f08-1c62f5655ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.150244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17530f08-d9d2-4347-8f08-1c62f5655ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.150543 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17530f08-d9d2-4347-8f08-1c62f5655ca0 admin admin] PATH_INFO: `/v3/projects/1b1f0c826cd243c0a12b16ca8e775024/users/4182b7fac7d140158b95e84d05243a4d/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.158286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03495e-a942-44f5-92f4-569d9c198e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.159858 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03495e-a942-44f5-92f4-569d9c198e30 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.160180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03495e-a942-44f5-92f4-569d9c198e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.160678 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03495e-a942-44f5-92f4-569d9c198e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.161553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03495e-a942-44f5-92f4-569d9c198e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.163706 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03495e-a942-44f5-92f4-569d9c198e30 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:38.165765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17530f08-d9d2-4347-8f08-1c62f5655ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1f0c826cd243c0a12b16ca8e775024, user_id=4182b7fac7d140158b95e84d05243a4d, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.168477 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17530f08-d9d2-4347-8f08-1c62f5655ca0 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:38.289410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1074/2155] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:38 2022] PUT /identity/v3/projects/1b1f0c826cd243c0a12b16ca8e775024/users/4182b7fac7d140158b95e84d05243a4d/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:38.290856 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250974e-1a29-4b17-b9f9-82417ca965c5 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.291157 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250974e-1a29-4b17-b9f9-82417ca965c5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.291501 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250974e-1a29-4b17-b9f9-82417ca965c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.308126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-2250974e-1a29-4b17-b9f9-82417ca965c5 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:38.310118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2250974e-1a29-4b17-b9f9-82417ca965c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:38.361100 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1082/2156] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:38 2022] POST /identity/v3/projects => generated 355 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:38.361956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03495e-a942-44f5-92f4-569d9c198e30 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.369413 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1075/2157] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:38.370765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced014-f3ce-46d2-9adb-9b88aa5fdda4 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.371777 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced014-f3ce-46d2-9adb-9b88aa5fdda4 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.372063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ced014-f3ce-46d2-9adb-9b88aa5fdda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.405676 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-16ced014-f3ce-46d2-9adb-9b88aa5fdda4 None None] MFA Rules not processed for user `4182b7fac7d140158b95e84d05243a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:38.406916 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-16ced014-f3ce-46d2-9adb-9b88aa5fdda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:38.426378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03495e-a942-44f5-92f4-569d9c198e30 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.431101 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421013e-497c-42f1-8616-e3ada714b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.431773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421013e-497c-42f1-8616-e3ada714b51f admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.432043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421013e-497c-42f1-8616-e3ada714b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.432344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421013e-497c-42f1-8616-e3ada714b51f admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.433069 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421013e-497c-42f1-8616-e3ada714b51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.435435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421013e-497c-42f1-8616-e3ada714b51f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:38.445426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1083/2158] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:38.446220 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421013e-497c-42f1-8616-e3ada714b51f admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.456893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421013e-497c-42f1-8616-e3ada714b51f admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.462269 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fb817-fb1c-4665-aec9-f8b7046625b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.462969 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fb817-fb1c-4665-aec9-f8b7046625b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.463305 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fb817-fb1c-4665-aec9-f8b7046625b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.463589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fb817-fb1c-4665-aec9-f8b7046625b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.464352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fb817-fb1c-4665-aec9-f8b7046625b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.466415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fb817-fb1c-4665-aec9-f8b7046625b4 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:38.471845 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1076/2159] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:38.472938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ced014-f3ce-46d2-9adb-9b88aa5fdda4 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.477127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-16ced014-f3ce-46d2-9adb-9b88aa5fdda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:38.530554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ced014-f3ce-46d2-9adb-9b88aa5fdda4 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.534167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcd3bd-19c0-459f-b071-d8f9593363d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.534804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcd3bd-19c0-459f-b071-d8f9593363d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.535086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcd3bd-19c0-459f-b071-d8f9593363d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.535361 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcd3bd-19c0-459f-b071-d8f9593363d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.544710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcd3bd-19c0-459f-b071-d8f9593363d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.546076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcd3bd-19c0-459f-b071-d8f9593363d0 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:38.553801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1084/2160] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:38 2022] POST /identity/v3/users => generated 278 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:38.554791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fb817-fb1c-4665-aec9-f8b7046625b4 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.558293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1077/2161] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:38.559891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcd3bd-19c0-459f-b071-d8f9593363d0 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.561312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-42dcd3bd-19c0-459f-b071-d8f9593363d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:38.565791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fb817-fb1c-4665-aec9-f8b7046625b4 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.573417 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b8a0-cdb4-4e1d-bce6-0708bd8ab828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.574412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b8a0-cdb4-4e1d-bce6-0708bd8ab828 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.574798 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b8a0-cdb4-4e1d-bce6-0708bd8ab828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.575190 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b8a0-cdb4-4e1d-bce6-0708bd8ab828 admin admin] PATH_INFO: `/v3/projects/da07659cfdb44e13ad4a9de71a9468e9/users/01d8dad9b88a4a3bafdd70c72186a67c/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.600696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57b8a0-cdb4-4e1d-bce6-0708bd8ab828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da07659cfdb44e13ad4a9de71a9468e9, user_id=01d8dad9b88a4a3bafdd70c72186a67c, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.603903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57b8a0-cdb4-4e1d-bce6-0708bd8ab828 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:38.632339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcd3bd-19c0-459f-b071-d8f9593363d0 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.632339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bde82c-2e0c-4bff-8516-83cee0c18432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.632339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bde82c-2e0c-4bff-8516-83cee0c18432 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.632339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bde82c-2e0c-4bff-8516-83cee0c18432 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.633278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bde82c-2e0c-4bff-8516-83cee0c18432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.640534 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bde82c-2e0c-4bff-8516-83cee0c18432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.641970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bde82c-2e0c-4bff-8516-83cee0c18432 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:38.650893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1078/2162] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:38.651748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bde82c-2e0c-4bff-8516-83cee0c18432 service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.663314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bde82c-2e0c-4bff-8516-83cee0c18432 service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.677379 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39647a-8a93-41e8-81d8-942538919b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.678057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39647a-8a93-41e8-81d8-942538919b78 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.678342 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39647a-8a93-41e8-81d8-942538919b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.678620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39647a-8a93-41e8-81d8-942538919b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.679348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39647a-8a93-41e8-81d8-942538919b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.680980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39647a-8a93-41e8-81d8-942538919b78 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:38.692085 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1079/2163] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:38.692938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39647a-8a93-41e8-81d8-942538919b78 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.702722 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39647a-8a93-41e8-81d8-942538919b78 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.707422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.708283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.708572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.708846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] PATH_INFO: `/v3/users/4182b7fac7d140158b95e84d05243a4d` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.710076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4182b7fac7d140158b95e84d05243a4d)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.711982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:38.730043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1085/2164] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:38 2022] PUT /identity/v3/projects/da07659cfdb44e13ad4a9de71a9468e9/users/01d8dad9b88a4a3bafdd70c72186a67c/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:38.737399 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b8a0-cdb4-4e1d-bce6-0708bd8ab828 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.799630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b8a0-cdb4-4e1d-bce6-0708bd8ab828 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.804255 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98282040-73e1-459f-80b7-599be390b2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.804909 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98282040-73e1-459f-80b7-599be390b2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.805521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98282040-73e1-459f-80b7-599be390b2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.805521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98282040-73e1-459f-80b7-599be390b2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.806160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98282040-73e1-459f-80b7-599be390b2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.807739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98282040-73e1-459f-80b7-599be390b2a6 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:38.818618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1086/2165] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:38.819943 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af273e75-bb3c-403d-9ab1-d5897f49945c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.820318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af273e75-bb3c-403d-9ab1-d5897f49945c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.820652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af273e75-bb3c-403d-9ab1-d5897f49945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.848891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-af273e75-bb3c-403d-9ab1-d5897f49945c None None] MFA Rules not processed for user `01d8dad9b88a4a3bafdd70c72186a67c`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:38.850090 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-af273e75-bb3c-403d-9ab1-d5897f49945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:38.918422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1087/2166] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:38.919262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af273e75-bb3c-403d-9ab1-d5897f49945c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:38.934095 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af273e75-bb3c-403d-9ab1-d5897f49945c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:38.942656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b0744-b0d0-4b1d-8d7b-ecd607953676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:38.943888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b0744-b0d0-4b1d-8d7b-ecd607953676 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:38.944139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b0744-b0d0-4b1d-8d7b-ecd607953676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:38.944462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b0744-b0d0-4b1d-8d7b-ecd607953676 admin admin] PATH_INFO: `/v3/projects/616c6aea36824a658430bb6056094825/users/9b92b50c4dff46269161855fba0dcea4/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:38.960045 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4182b7fac7d140158b95e84d05243a4d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:38.981582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b0744-b0d0-4b1d-8d7b-ecd607953676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=616c6aea36824a658430bb6056094825, user_id=9b92b50c4dff46269161855fba0dcea4, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:38.984647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b0744-b0d0-4b1d-8d7b-ecd607953676 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:39.045131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4182b7fac7d140158b95e84d05243a4d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:39.057752 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4182b7fac7d140158b95e84d05243a4d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:39.058539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4182b7fac7d140158b95e84d05243a4d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:39.065590 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4182b7fac7d140158b95e84d05243a4d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:39.076398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1088/2168] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:38 2022] PUT /identity/v3/projects/616c6aea36824a658430bb6056094825/users/9b92b50c4dff46269161855fba0dcea4/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:39.076398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b0744-b0d0-4b1d-8d7b-ecd607953676 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:39.076658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1080/2168] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:38 2022] DELETE /identity/v3/users/4182b7fac7d140158b95e84d05243a4d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:39.076658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:39.077691 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:39.078534 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f30b0744-b0d0-4b1d-8d7b-ecd607953676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:39.162931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b0744-b0d0-4b1d-8d7b-ecd607953676 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:39.187588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5193bd-00f0-4d3c-bf75-a9dd27f8cf31 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:39.192692 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:39.193577 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:39.196181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:39.196181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] PATH_INFO: `/v3/users/c901302360434c6ca5ba698adc4e2ff7` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:39.196181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c901302360434c6ca5ba698adc4e2ff7)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:39.197956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:39.229189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974a4c7-03db-41da-b44e-e1b24c63efcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:39.230166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974a4c7-03db-41da-b44e-e1b24c63efcb service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:39.230563 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974a4c7-03db-41da-b44e-e1b24c63efcb service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:39.231038 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974a4c7-03db-41da-b44e-e1b24c63efcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:39.233225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7974a4c7-03db-41da-b44e-e1b24c63efcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:39.297768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974a4c7-03db-41da-b44e-e1b24c63efcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:39.299584 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974a4c7-03db-41da-b44e-e1b24c63efcb service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:39.311363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1089/2169] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:39.312939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b90d6-463d-4e3b-b4d1-625e05ef8825 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:39.320505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b90d6-463d-4e3b-b4d1-625e05ef8825 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:39.320505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b90d6-463d-4e3b-b4d1-625e05ef8825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:39.332885 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b42b90d6-463d-4e3b-b4d1-625e05ef8825 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:39.334243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b42b90d6-463d-4e3b-b4d1-625e05ef8825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:39.343355 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1090/2170] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:39.349298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ba3a8-5f76-49cf-b4c3-e60861f687c4 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:39.349298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ba3a8-5f76-49cf-b4c3-e60861f687c4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:39.349298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ba3a8-5f76-49cf-b4c3-e60861f687c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:39.380047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-733ba3a8-5f76-49cf-b4c3-e60861f687c4 None None] MFA Rules not processed for user `9b92b50c4dff46269161855fba0dcea4`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:39.381569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-733ba3a8-5f76-49cf-b4c3-e60861f687c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:39.399818 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c901302360434c6ca5ba698adc4e2ff7'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:39.466639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c901302360434c6ca5ba698adc4e2ff7'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:39.485225 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c901302360434c6ca5ba698adc4e2ff7'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:39.486063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c901302360434c6ca5ba698adc4e2ff7'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:39.499776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c901302360434c6ca5ba698adc4e2ff7'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:39.506205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1091/2171] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:39 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:39.506205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ba3a8-5f76-49cf-b4c3-e60861f687c4 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:39.507715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1081/2172] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:39 2022] DELETE /identity/v3/users/c901302360434c6ca5ba698adc4e2ff7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:39.507715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:39.508793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:39.510587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-733ba3a8-5f76-49cf-b4c3-e60861f687c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:39.582280 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b38b70-837b-4d62-bf48-cca91dcf41c7 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:39.589293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4236e-4552-4301-b4c8-68d952308447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:39.590554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4236e-4552-4301-b4c8-68d952308447 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:39.590844 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4236e-4552-4301-b4c8-68d952308447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:39.591125 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4236e-4552-4301-b4c8-68d952308447 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:39.591829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4236e-4552-4301-b4c8-68d952308447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:39.593605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ba3a8-5f76-49cf-b4c3-e60861f687c4 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:39.594779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4236e-4552-4301-b4c8-68d952308447 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:39.666386 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632ee51-9f37-4fde-ac61-27cf6069571f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:39.666826 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632ee51-9f37-4fde-ac61-27cf6069571f service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:39.667106 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632ee51-9f37-4fde-ac61-27cf6069571f service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:39.667381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632ee51-9f37-4fde-ac61-27cf6069571f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:39.670204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d632ee51-9f37-4fde-ac61-27cf6069571f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:39.683104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632ee51-9f37-4fde-ac61-27cf6069571f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:39.686589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632ee51-9f37-4fde-ac61-27cf6069571f service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:39.696616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1092/2173] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:39.698034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f7e25-23f8-48fe-89ba-175cdfa912e1 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:39.698330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f7e25-23f8-48fe-89ba-175cdfa912e1 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:39.698636 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f7e25-23f8-48fe-89ba-175cdfa912e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:39.719328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f83f7e25-23f8-48fe-89ba-175cdfa912e1 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:39.721279 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f83f7e25-23f8-48fe-89ba-175cdfa912e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:39.734239 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1093/2174] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:39.736230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1082/2175] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:39 2022] POST /identity/v3/projects => generated 357 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:39.736361 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f7e25-23f8-48fe-89ba-175cdfa912e1 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:39.742091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4236e-4552-4301-b4c8-68d952308447 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:39.745409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-cec4236e-4552-4301-b4c8-68d952308447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:39.747661 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f7e25-23f8-48fe-89ba-175cdfa912e1 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:39.825251 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba16769-c655-4a92-988b-e063717be18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:39.826027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba16769-c655-4a92-988b-e063717be18c admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:39.826373 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba16769-c655-4a92-988b-e063717be18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:39.826774 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba16769-c655-4a92-988b-e063717be18c admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:39.827714 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba16769-c655-4a92-988b-e063717be18c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:39.829831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba16769-c655-4a92-988b-e063717be18c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:39.845420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4236e-4552-4301-b4c8-68d952308447 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:39.849330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa5c33-e291-4b62-bd88-b9a91b29ec5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:39.855128 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa5c33-e291-4b62-bd88-b9a91b29ec5b service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:39.855128 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa5c33-e291-4b62-bd88-b9a91b29ec5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:39.855128 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa5c33-e291-4b62-bd88-b9a91b29ec5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:39.861307 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa5c33-e291-4b62-bd88-b9a91b29ec5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:39.862745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa5c33-e291-4b62-bd88-b9a91b29ec5b service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:39.873280 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1083/2176] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:39.943213 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1094/2177] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:39 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:40:39.947311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa5c33-e291-4b62-bd88-b9a91b29ec5b service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:39.959030 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa5c33-e291-4b62-bd88-b9a91b29ec5b service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:39.965842 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa0c88-cdc1-4e36-876e-7577d93a7684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:39.967234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa0c88-cdc1-4e36-876e-7577d93a7684 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:39.967234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa0c88-cdc1-4e36-876e-7577d93a7684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:39.967234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa0c88-cdc1-4e36-876e-7577d93a7684 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:39.967821 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa0c88-cdc1-4e36-876e-7577d93a7684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:39.969621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa0c88-cdc1-4e36-876e-7577d93a7684 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:39.982721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1084/2178] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:40:39.987537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba16769-c655-4a92-988b-e063717be18c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:39.998938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba16769-c655-4a92-988b-e063717be18c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:40.012385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d88fe8-e5a3-47cd-ad2d-3a58d9a98d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:40.013594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d88fe8-e5a3-47cd-ad2d-3a58d9a98d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:40.013954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d88fe8-e5a3-47cd-ad2d-3a58d9a98d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:40.014305 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d88fe8-e5a3-47cd-ad2d-3a58d9a98d84 admin admin] PATH_INFO: `/v3/projects/606637c4c51142a29baa4b5b0899e6e4/users/bc6a4b65bbc449a5bf3adfec3c2b02bd/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:40.107098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d88fe8-e5a3-47cd-ad2d-3a58d9a98d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606637c4c51142a29baa4b5b0899e6e4, user_id=bc6a4b65bbc449a5bf3adfec3c2b02bd, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:40.110577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d88fe8-e5a3-47cd-ad2d-3a58d9a98d84 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:40.227155 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5898d6-1abf-4134-bc9a-57509c5163f5 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:40.230898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5898d6-1abf-4134-bc9a-57509c5163f5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:40.230898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5898d6-1abf-4134-bc9a-57509c5163f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:40.256001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1095/2179] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:39 2022] PUT /identity/v3/projects/606637c4c51142a29baa4b5b0899e6e4/users/bc6a4b65bbc449a5bf3adfec3c2b02bd/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:40.263586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d88fe8-e5a3-47cd-ad2d-3a58d9a98d84 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:40.324684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-8f5898d6-1abf-4134-bc9a-57509c5163f5 None None] MFA Rules not processed for user `2323762c0b0b478ab554b57ba34ebaf2`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:40.329908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8f5898d6-1abf-4134-bc9a-57509c5163f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:40.436524 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d88fe8-e5a3-47cd-ad2d-3a58d9a98d84 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:40.446867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b7265-7c02-4669-84d0-7f15c602f5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:40.447621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7265-7c02-4669-84d0-7f15c602f5cc admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:40.447978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7265-7c02-4669-84d0-7f15c602f5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:40.448352 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b7265-7c02-4669-84d0-7f15c602f5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:40.449759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b7265-7c02-4669-84d0-7f15c602f5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:40.453576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b7265-7c02-4669-84d0-7f15c602f5cc admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:40.482376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1096/2180] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:40.486607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b7265-7c02-4669-84d0-7f15c602f5cc admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:40.495394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1085/2181] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:40.499270 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b7265-7c02-4669-84d0-7f15c602f5cc admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:40.500327 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5898d6-1abf-4134-bc9a-57509c5163f5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:40.501990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8f5898d6-1abf-4134-bc9a-57509c5163f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:40.504744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf2f95-1640-4a02-a363-c3ec4cc198e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:40.515944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf2f95-1640-4a02-a363-c3ec4cc198e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:40.516414 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf2f95-1640-4a02-a363-c3ec4cc198e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:40.516707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf2f95-1640-4a02-a363-c3ec4cc198e7 admin admin] PATH_INFO: `/v3/projects/606637c4c51142a29baa4b5b0899e6e4/users/bc6a4b65bbc449a5bf3adfec3c2b02bd/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:40.519045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf2f95-1640-4a02-a363-c3ec4cc198e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606637c4c51142a29baa4b5b0899e6e4, user_id=bc6a4b65bbc449a5bf3adfec3c2b02bd, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:40.522011 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf2f95-1640-4a02-a363-c3ec4cc198e7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:40.522150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5898d6-1abf-4134-bc9a-57509c5163f5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:40.531061 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd673c1-219b-461b-a327-b7f092327c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:40.532035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd673c1-219b-461b-a327-b7f092327c79 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:40.532358 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd673c1-219b-461b-a327-b7f092327c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:40.532641 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd673c1-219b-461b-a327-b7f092327c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:40.533352 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd673c1-219b-461b-a327-b7f092327c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:40.535389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd673c1-219b-461b-a327-b7f092327c79 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:40.542080 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1097/2182] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:40 2022] PUT /identity/v3/projects/606637c4c51142a29baa4b5b0899e6e4/users/bc6a4b65bbc449a5bf3adfec3c2b02bd/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:40.553941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83ca94-6e11-4da6-8e12-a7b61373dc88 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:40.554272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83ca94-6e11-4da6-8e12-a7b61373dc88 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:40.554650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83ca94-6e11-4da6-8e12-a7b61373dc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:40.592109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-ac83ca94-6e11-4da6-8e12-a7b61373dc88 None None] MFA Rules not processed for user `bc6a4b65bbc449a5bf3adfec3c2b02bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:40.593488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ac83ca94-6e11-4da6-8e12-a7b61373dc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:40.667572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1086/2183] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:40 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:40.669755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1098/2184] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:40 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:40:40.670840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd673c1-219b-461b-a327-b7f092327c79 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:40.682802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83ca94-6e11-4da6-8e12-a7b61373dc88 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:40.685613 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ac83ca94-6e11-4da6-8e12-a7b61373dc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:40.747076 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd673c1-219b-461b-a327-b7f092327c79 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:40.752638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e355f8-504d-4ae9-bd67-3c5349d16fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:40.753332 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e355f8-504d-4ae9-bd67-3c5349d16fcf admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:40.753623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e355f8-504d-4ae9-bd67-3c5349d16fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:40.753902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e355f8-504d-4ae9-bd67-3c5349d16fcf admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:40.754606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e355f8-504d-4ae9-bd67-3c5349d16fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:40.756678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e355f8-504d-4ae9-bd67-3c5349d16fcf admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:40.768865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83ca94-6e11-4da6-8e12-a7b61373dc88 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:40.816122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e607-1557-4f5a-96d1-73553aa40538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:40.816784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e607-1557-4f5a-96d1-73553aa40538 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:40.817065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e607-1557-4f5a-96d1-73553aa40538 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:40.817342 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869e607-1557-4f5a-96d1-73553aa40538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:40.833410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1087/2185] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:40 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:40.835642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e355f8-504d-4ae9-bd67-3c5349d16fcf admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:40.835754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-61e355f8-504d-4ae9-bd67-3c5349d16fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:40.847565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e355f8-504d-4ae9-bd67-3c5349d16fcf admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:40.852326 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:40.853168 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:40.853459 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:40.853741 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] PATH_INFO: `/v3/projects/58d36da8d95c4ab39fcfaf7dd148e3aa` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:40.854940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d36da8d95c4ab39fcfaf7dd148e3aa)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:40.857436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:40.880467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869e607-1557-4f5a-96d1-73553aa40538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:40.881831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869e607-1557-4f5a-96d1-73553aa40538 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:40.891230 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1099/2186] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:40 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:40:40.893133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e607-1557-4f5a-96d1-73553aa40538 service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:40.893477 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f869e607-1557-4f5a-96d1-73553aa40538 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:40.906426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869e607-1557-4f5a-96d1-73553aa40538 service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:40.911328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689260c3-4490-4fcd-a70d-22c2f43d6817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:40.912206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689260c3-4490-4fcd-a70d-22c2f43d6817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:40.912488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689260c3-4490-4fcd-a70d-22c2f43d6817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:40.912788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689260c3-4490-4fcd-a70d-22c2f43d6817 admin admin] PATH_INFO: `/v3/projects/1b1f0c826cd243c0a12b16ca8e775024` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:40.913976 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689260c3-4490-4fcd-a70d-22c2f43d6817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1f0c826cd243c0a12b16ca8e775024)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:40.915891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689260c3-4490-4fcd-a70d-22c2f43d6817 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:40.992877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d36da8d95c4ab39fcfaf7dd148e3aa', 'request_id': 'req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:40.998164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d36da8d95c4ab39fcfaf7dd148e3aa', 'request_id': 'req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:41.004698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d36da8d95c4ab39fcfaf7dd148e3aa', 'request_id': 'req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:41.062701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-689260c3-4490-4fcd-a70d-22c2f43d6817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1f0c826cd243c0a12b16ca8e775024', 'request_id': 'req-689260c3-4490-4fcd-a70d-22c2f43d6817'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:41.068037 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-689260c3-4490-4fcd-a70d-22c2f43d6817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1f0c826cd243c0a12b16ca8e775024', 'request_id': 'req-689260c3-4490-4fcd-a70d-22c2f43d6817'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:41.072996 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] The token cache is being invalidate because project 58d36da8d95c4ab39fcfaf7dd148e3aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:41.073293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:41.074567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:41.079403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1088/2187] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:40 2022] DELETE /identity/v3/projects/58d36da8d95c4ab39fcfaf7dd148e3aa => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:41.079403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:41.079403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:41.141850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c6ca2-4d9d-4c1a-a62c-770f89ad1c7f admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:41.169635 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-689260c3-4490-4fcd-a70d-22c2f43d6817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1f0c826cd243c0a12b16ca8e775024', 'request_id': 'req-689260c3-4490-4fcd-a70d-22c2f43d6817'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:41.188775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-689260c3-4490-4fcd-a70d-22c2f43d6817 admin admin] The token cache is being invalidate because project 1b1f0c826cd243c0a12b16ca8e775024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:41.189070 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-689260c3-4490-4fcd-a70d-22c2f43d6817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:41.189739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-689260c3-4490-4fcd-a70d-22c2f43d6817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:41.191329 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1100/2188] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:40 2022] DELETE /identity/v3/projects/1b1f0c826cd243c0a12b16ca8e775024 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:41.192638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f53567-61bc-49f4-99c3-64c3436211f5 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:41.192928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f53567-61bc-49f4-99c3-64c3436211f5 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:41.193206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f53567-61bc-49f4-99c3-64c3436211f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:41.202902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961378ec-4fa0-4bec-96c6-ddf71d56c23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:41.203599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961378ec-4fa0-4bec-96c6-ddf71d56c23a admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:41.203911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961378ec-4fa0-4bec-96c6-ddf71d56c23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:41.204267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961378ec-4fa0-4bec-96c6-ddf71d56c23a admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:41.206456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961378ec-4fa0-4bec-96c6-ddf71d56c23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:41.209763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961378ec-4fa0-4bec-96c6-ddf71d56c23a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:41.219142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-95f53567-61bc-49f4-99c3-64c3436211f5 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:41.220611 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-95f53567-61bc-49f4-99c3-64c3436211f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:41.228953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1089/2189] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:41.228953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961378ec-4fa0-4bec-96c6-ddf71d56c23a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:41.230803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-961378ec-4fa0-4bec-96c6-ddf71d56c23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:41.238997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1101/2190] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:41.238997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f53567-61bc-49f4-99c3-64c3436211f5 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:41.238997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-95f53567-61bc-49f4-99c3-64c3436211f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:41.249124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f53567-61bc-49f4-99c3-64c3436211f5 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:41.255456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7aada-f6fa-47b2-8bb3-254990443db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:41.256517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7aada-f6fa-47b2-8bb3-254990443db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:41.257068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7aada-f6fa-47b2-8bb3-254990443db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:41.257068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7aada-f6fa-47b2-8bb3-254990443db7 admin admin] PATH_INFO: `/v3/projects/1d7723e076c340ab911e598769ba25b8/users/6ba86cfb2a084cd4acd1a79b1966f13c/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:41.274209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7aada-f6fa-47b2-8bb3-254990443db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7723e076c340ab911e598769ba25b8, user_id=6ba86cfb2a084cd4acd1a79b1966f13c, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:41.277086 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7aada-f6fa-47b2-8bb3-254990443db7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:41.304200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961378ec-4fa0-4bec-96c6-ddf71d56c23a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:41.308815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc921805-6697-409d-bf20-93fcaf13fa34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:41.313051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc921805-6697-409d-bf20-93fcaf13fa34 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:41.313051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc921805-6697-409d-bf20-93fcaf13fa34 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:41.313051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc921805-6697-409d-bf20-93fcaf13fa34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:41.313051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-dc921805-6697-409d-bf20-93fcaf13fa34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:41.369751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1102/2191] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:41 2022] PUT /identity/v3/projects/1d7723e076c340ab911e598769ba25b8/users/6ba86cfb2a084cd4acd1a79b1966f13c/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:41.369751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da4bd-668f-4f86-a0e0-c8983385b96e None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:41.369751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da4bd-668f-4f86-a0e0-c8983385b96e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:41.369751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da4bd-668f-4f86-a0e0-c8983385b96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:41.391688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-be9da4bd-668f-4f86-a0e0-c8983385b96e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:41.393694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc921805-6697-409d-bf20-93fcaf13fa34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:41.394033 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-be9da4bd-668f-4f86-a0e0-c8983385b96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:41.395126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc921805-6697-409d-bf20-93fcaf13fa34 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:41.417605 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1090/2192] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:41 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:41.420174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc921805-6697-409d-bf20-93fcaf13fa34 service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:41.440020 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc921805-6697-409d-bf20-93fcaf13fa34 service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:41.487694 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1103/2193] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:41.491762 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9da4bd-668f-4f86-a0e0-c8983385b96e None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:41.501668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9da4bd-668f-4f86-a0e0-c8983385b96e None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:41.506991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d361c-d11c-423c-99e5-92cfea2323a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:41.510693 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d361c-d11c-423c-99e5-92cfea2323a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:41.510693 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d361c-d11c-423c-99e5-92cfea2323a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:41.510693 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d361c-d11c-423c-99e5-92cfea2323a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:41.510693 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d361c-d11c-423c-99e5-92cfea2323a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:40:41.511373 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60ce47-302c-4c1f-8fd7-7623577410e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:41.511503 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d361c-d11c-423c-99e5-92cfea2323a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:41.511660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60ce47-302c-4c1f-8fd7-7623577410e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:41.511660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60ce47-302c-4c1f-8fd7-7623577410e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:41.511660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60ce47-302c-4c1f-8fd7-7623577410e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:41.511998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d361c-d11c-423c-99e5-92cfea2323a1 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:41.512084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60ce47-302c-4c1f-8fd7-7623577410e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:41.512825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60ce47-302c-4c1f-8fd7-7623577410e3 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:41.522855 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1091/2194] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:41.525319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1104/2195] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:40:41.526945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60ce47-302c-4c1f-8fd7-7623577410e3 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:41.530397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d361c-d11c-423c-99e5-92cfea2323a1 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:41.548011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60ce47-302c-4c1f-8fd7-7623577410e3 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:41.553256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c22f95-1402-4984-81b5-4c89ea63e9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:41.553713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d361c-d11c-423c-99e5-92cfea2323a1 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:41.554272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c22f95-1402-4984-81b5-4c89ea63e9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:41.554616 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c22f95-1402-4984-81b5-4c89ea63e9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:41.555066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c22f95-1402-4984-81b5-4c89ea63e9f7 admin admin] PATH_INFO: `/v3/projects/1d7723e076c340ab911e598769ba25b8/users/6ba86cfb2a084cd4acd1a79b1966f13c/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:41.559822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed0f83-b681-4abe-8a80-7667d4fe9388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:41.560057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c22f95-1402-4984-81b5-4c89ea63e9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7723e076c340ab911e598769ba25b8, user_id=6ba86cfb2a084cd4acd1a79b1966f13c, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:41.560265 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed0f83-b681-4abe-8a80-7667d4fe9388 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:41.560784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed0f83-b681-4abe-8a80-7667d4fe9388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:41.560904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed0f83-b681-4abe-8a80-7667d4fe9388 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:41.561498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed0f83-b681-4abe-8a80-7667d4fe9388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:41.563184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c22f95-1402-4984-81b5-4c89ea63e9f7 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:41.563545 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed0f83-b681-4abe-8a80-7667d4fe9388 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:41.583801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1092/2196] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:41 2022] PUT /identity/v3/projects/1d7723e076c340ab911e598769ba25b8/users/6ba86cfb2a084cd4acd1a79b1966f13c/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:41.716108 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1105/2197] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:41 2022] POST /identity/v3/projects => generated 397 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:41.720378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c22f95-1402-4984-81b5-4c89ea63e9f7 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:41.797517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c22f95-1402-4984-81b5-4c89ea63e9f7 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:41.879239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b982311-a8ca-4f92-a2d2-90f3f0fa4543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:41.879904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b982311-a8ca-4f92-a2d2-90f3f0fa4543 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:41.880223 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b982311-a8ca-4f92-a2d2-90f3f0fa4543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:41.880503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b982311-a8ca-4f92-a2d2-90f3f0fa4543 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:41.881189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b982311-a8ca-4f92-a2d2-90f3f0fa4543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:41.883096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b982311-a8ca-4f92-a2d2-90f3f0fa4543 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:41.972640 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1093/2198] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:41 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:41.976586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed0f83-b681-4abe-8a80-7667d4fe9388 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:41.993040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed0f83-b681-4abe-8a80-7667d4fe9388 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:41.999956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b6979-a168-4202-b849-1dafd138eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:42.000653 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b6979-a168-4202-b849-1dafd138eb60 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:42.001002 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b6979-a168-4202-b849-1dafd138eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:42.001285 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b6979-a168-4202-b849-1dafd138eb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:42.002019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b6979-a168-4202-b849-1dafd138eb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:42.003934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b6979-a168-4202-b849-1dafd138eb60 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:42.016306 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1106/2199] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:42.022013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b982311-a8ca-4f92-a2d2-90f3f0fa4543 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:42.034980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b982311-a8ca-4f92-a2d2-90f3f0fa4543 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:42.041597 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4edba-3e88-4930-9f75-cd95aecf70ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:42.042583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4edba-3e88-4930-9f75-cd95aecf70ae admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:42.043478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4edba-3e88-4930-9f75-cd95aecf70ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:42.043762 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4edba-3e88-4930-9f75-cd95aecf70ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:42.044539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4edba-3e88-4930-9f75-cd95aecf70ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:42.046153 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4edba-3e88-4930-9f75-cd95aecf70ae admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:42.064034 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1094/2200] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:42.065239 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b6979-a168-4202-b849-1dafd138eb60 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:42.075495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b6979-a168-4202-b849-1dafd138eb60 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:42.080349 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ae20f-2dc3-41c6-9abd-d646b88c3ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:42.081280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ae20f-2dc3-41c6-9abd-d646b88c3ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:42.081567 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ae20f-2dc3-41c6-9abd-d646b88c3ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:42.081850 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ae20f-2dc3-41c6-9abd-d646b88c3ba6 admin admin] PATH_INFO: `/v3/projects/9949b429da664a16b6428565eb5d5ce1/users/23b93432278246349d7b87334d40ce4d/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:42.098600 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ae20f-2dc3-41c6-9abd-d646b88c3ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9949b429da664a16b6428565eb5d5ce1, user_id=23b93432278246349d7b87334d40ce4d, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:42.102351 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ae20f-2dc3-41c6-9abd-d646b88c3ba6 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:42.190240 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1107/2201] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:42 2022] PUT /identity/v3/projects/9949b429da664a16b6428565eb5d5ce1/users/23b93432278246349d7b87334d40ce4d/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:42.192417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821b70c-6a34-4868-afd1-0fea0daa78bf None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:42.192744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821b70c-6a34-4868-afd1-0fea0daa78bf None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:42.193037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821b70c-6a34-4868-afd1-0fea0daa78bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:42.225039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-9821b70c-6a34-4868-afd1-0fea0daa78bf None None] MFA Rules not processed for user `23b93432278246349d7b87334d40ce4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:42.226738 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9821b70c-6a34-4868-afd1-0fea0daa78bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:42.293279 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1095/2202] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:42.308034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ae20f-2dc3-41c6-9abd-d646b88c3ba6 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:42.365455 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ae20f-2dc3-41c6-9abd-d646b88c3ba6 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:42.369218 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08c53e-e3e5-4814-8559-263a388b71df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:42.369857 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08c53e-e3e5-4814-8559-263a388b71df service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:42.370147 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08c53e-e3e5-4814-8559-263a388b71df service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:42.370431 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08c53e-e3e5-4814-8559-263a388b71df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:42.379395 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08c53e-e3e5-4814-8559-263a388b71df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:42.380874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08c53e-e3e5-4814-8559-263a388b71df service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:42.390228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1108/2203] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:42.955267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a82aa-7dce-4662-b4c8-68405d6a0536 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:42.956087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a82aa-7dce-4662-b4c8-68405d6a0536 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:42.956087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a82aa-7dce-4662-b4c8-68405d6a0536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:42.992178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-354a82aa-7dce-4662-b4c8-68405d6a0536 None None] MFA Rules not processed for user `6ba86cfb2a084cd4acd1a79b1966f13c`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:42.994230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-354a82aa-7dce-4662-b4c8-68405d6a0536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:43.097200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1096/2204] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:43.426379 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08c53e-e3e5-4814-8559-263a388b71df service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:43.427908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-df08c53e-e3e5-4814-8559-263a388b71df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:43.440047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08c53e-e3e5-4814-8559-263a388b71df service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:43.444668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557d287-1780-4c39-b6c5-ee90be1c1e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:43.445587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557d287-1780-4c39-b6c5-ee90be1c1e56 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:43.446024 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557d287-1780-4c39-b6c5-ee90be1c1e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:43.446835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557d287-1780-4c39-b6c5-ee90be1c1e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:43.449161 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f557d287-1780-4c39-b6c5-ee90be1c1e56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:43.530898 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557d287-1780-4c39-b6c5-ee90be1c1e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:43.532570 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557d287-1780-4c39-b6c5-ee90be1c1e56 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:43.541796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1109/2205] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:43.971757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a82aa-7dce-4662-b4c8-68405d6a0536 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:43.973197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-354a82aa-7dce-4662-b4c8-68405d6a0536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:44.036770 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a82aa-7dce-4662-b4c8-68405d6a0536 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:44.041289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:44.042142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:44.042425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:44.042756 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] PATH_INFO: `/v3/users/01d8dad9b88a4a3bafdd70c72186a67c` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:44.043937 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d8dad9b88a4a3bafdd70c72186a67c)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:44.045915 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:44.240627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d8dad9b88a4a3bafdd70c72186a67c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:44.307647 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d8dad9b88a4a3bafdd70c72186a67c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:44.320509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d8dad9b88a4a3bafdd70c72186a67c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:44.321146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d8dad9b88a4a3bafdd70c72186a67c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:44.328291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d8dad9b88a4a3bafdd70c72186a67c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:44.334084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1097/2206] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:43 2022] DELETE /identity/v3/users/01d8dad9b88a4a3bafdd70c72186a67c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:44.338644 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0c453-8044-4879-9406-7723ae895b58 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:44.338941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0c453-8044-4879-9406-7723ae895b58 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:44.339254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0c453-8044-4879-9406-7723ae895b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:44.361675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-37e0c453-8044-4879-9406-7723ae895b58 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:44.361675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-37e0c453-8044-4879-9406-7723ae895b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:44.416982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1110/2207] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:40:44.426711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:44.428201 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:44.486314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531d42a-3e90-4757-aa32-cd97c117b7f3 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:44.490310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8336b0-523c-46d6-b88c-777392356a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:44.490986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8336b0-523c-46d6-b88c-777392356a3f service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:44.491272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8336b0-523c-46d6-b88c-777392356a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:44.491548 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8336b0-523c-46d6-b88c-777392356a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:44.501924 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8336b0-523c-46d6-b88c-777392356a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:44.503434 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8336b0-523c-46d6-b88c-777392356a3f service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:44.513409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1098/2208] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:44.972522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0c453-8044-4879-9406-7723ae895b58 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:44.973978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-37e0c453-8044-4879-9406-7723ae895b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:44.986440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0c453-8044-4879-9406-7723ae895b58 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:44.992385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:44.993243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:44.998724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:44.998724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] PATH_INFO: `/v3/projects/da07659cfdb44e13ad4a9de71a9468e9` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:44.998724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da07659cfdb44e13ad4a9de71a9468e9)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:44.998724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:45.159015 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da07659cfdb44e13ad4a9de71a9468e9', 'request_id': 'req-32f40848-6d2f-499f-9e41-456c7a79cb64'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:45.164250 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da07659cfdb44e13ad4a9de71a9468e9', 'request_id': 'req-32f40848-6d2f-499f-9e41-456c7a79cb64'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:45.279770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da07659cfdb44e13ad4a9de71a9468e9', 'request_id': 'req-32f40848-6d2f-499f-9e41-456c7a79cb64'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:45.292263 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] The token cache is being invalidate because project da07659cfdb44e13ad4a9de71a9468e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:40:45.292616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:45.293278 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:45.294896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1111/2209] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:40:44 2022] DELETE /identity/v3/projects/da07659cfdb44e13ad4a9de71a9468e9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:40:45.303262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c7b33-23e9-45ad-9a74-11ad899e85be None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:45.304177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c7b33-23e9-45ad-9a74-11ad899e85be None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:45.304680 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c7b33-23e9-45ad-9a74-11ad899e85be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:45.311851 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:45.313280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:45.331351 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-595c7b33-23e9-45ad-9a74-11ad899e85be None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:45.333094 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-595c7b33-23e9-45ad-9a74-11ad899e85be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:45.378018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f40848-6d2f-499f-9e41-456c7a79cb64 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:45.382319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ce1ba-f0a7-4ac2-ba36-b302ea21e97d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:45.382969 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ce1ba-f0a7-4ac2-ba36-b302ea21e97d service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:45.383429 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ce1ba-f0a7-4ac2-ba36-b302ea21e97d service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:45.383713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ce1ba-f0a7-4ac2-ba36-b302ea21e97d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:45.385858 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f96ce1ba-f0a7-4ac2-ba36-b302ea21e97d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:45.400496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1099/2210] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:40:45.409710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87129a45-139d-44cf-9fc4-bc0e15bd5705 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:45.410089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87129a45-139d-44cf-9fc4-bc0e15bd5705 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:45.410546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87129a45-139d-44cf-9fc4-bc0e15bd5705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:45.437177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-87129a45-139d-44cf-9fc4-bc0e15bd5705 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:45.439318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-87129a45-139d-44cf-9fc4-bc0e15bd5705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:45.448472 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1100/2211] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:45.452857 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87129a45-139d-44cf-9fc4-bc0e15bd5705 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:45.463635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87129a45-139d-44cf-9fc4-bc0e15bd5705 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:45.470768 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910d72a-d038-4227-a06d-8b6bf5fd9ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:45.471675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910d72a-d038-4227-a06d-8b6bf5fd9ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:45.471942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ce1ba-f0a7-4ac2-ba36-b302ea21e97d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:45.472391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910d72a-d038-4227-a06d-8b6bf5fd9ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:45.472829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910d72a-d038-4227-a06d-8b6bf5fd9ef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:45.473777 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910d72a-d038-4227-a06d-8b6bf5fd9ef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:40:45.474276 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910d72a-d038-4227-a06d-8b6bf5fd9ef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:45.475007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ce1ba-f0a7-4ac2-ba36-b302ea21e97d service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:45.476363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910d72a-d038-4227-a06d-8b6bf5fd9ef9 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:45.490682 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1112/2212] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:40:45.499510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1101/2213] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:40:45.501445 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ce1ba-f0a7-4ac2-ba36-b302ea21e97d service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:45.519806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ce1ba-f0a7-4ac2-ba36-b302ea21e97d service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:45.527729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a3015-8da1-4806-9aed-7856157ba66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:45.528676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a3015-8da1-4806-9aed-7856157ba66e admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:45.529073 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a3015-8da1-4806-9aed-7856157ba66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:45.529424 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a3015-8da1-4806-9aed-7856157ba66e admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:45.530178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a3015-8da1-4806-9aed-7856157ba66e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:45.533236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a3015-8da1-4806-9aed-7856157ba66e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:45.655739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1113/2214] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:40:45 2022] POST /identity/v3/projects => generated 391 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:45.659633 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910d72a-d038-4227-a06d-8b6bf5fd9ef9 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:45.685433 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910d72a-d038-4227-a06d-8b6bf5fd9ef9 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:45.752396 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f95d0-3e36-425a-93a4-c575a4a4c5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:45.753341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f95d0-3e36-425a-93a4-c575a4a4c5ff admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:45.753635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f95d0-3e36-425a-93a4-c575a4a4c5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:45.753910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f95d0-3e36-425a-93a4-c575a4a4c5ff admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:45.754601 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f95d0-3e36-425a-93a4-c575a4a4c5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:45.756545 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f95d0-3e36-425a-93a4-c575a4a4c5ff admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:45.879030 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1102/2215] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:40:45 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:40:45.882980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a3015-8da1-4806-9aed-7856157ba66e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:45.893675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a3015-8da1-4806-9aed-7856157ba66e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:45.898205 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ef91-fc29-4373-a0f3-d2201b59d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:45.898846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ef91-fc29-4373-a0f3-d2201b59d554 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:45.899128 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ef91-fc29-4373-a0f3-d2201b59d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:45.899433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ef91-fc29-4373-a0f3-d2201b59d554 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:45.900203 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ef91-fc29-4373-a0f3-d2201b59d554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:45.901811 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ef91-fc29-4373-a0f3-d2201b59d554 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:45.912131 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1114/2216] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:40:45.916212 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f95d0-3e36-425a-93a4-c575a4a4c5ff admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:45.926305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f95d0-3e36-425a-93a4-c575a4a4c5ff admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:45.931041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cac1c-6a3b-4066-a492-a41e26b4dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:45.931682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cac1c-6a3b-4066-a492-a41e26b4dd19 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:45.931967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cac1c-6a3b-4066-a492-a41e26b4dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:45.932281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cac1c-6a3b-4066-a492-a41e26b4dd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:45.933012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cac1c-6a3b-4066-a492-a41e26b4dd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:45.935466 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cac1c-6a3b-4066-a492-a41e26b4dd19 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:45.945465 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1103/2217] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:40:45.950053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ef91-fc29-4373-a0f3-d2201b59d554 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:45.959940 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ef91-fc29-4373-a0f3-d2201b59d554 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:45.965164 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424c384-a1cb-4eac-8803-18b1774faafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:45.969787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424c384-a1cb-4eac-8803-18b1774faafc admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:45.969787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424c384-a1cb-4eac-8803-18b1774faafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:45.969787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424c384-a1cb-4eac-8803-18b1774faafc admin admin] PATH_INFO: `/v3/projects/120ec55ab5704dd9a3205009e0d4c341/users/dc15014b11be4ceea732300a49c70033/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:45.981832 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424c384-a1cb-4eac-8803-18b1774faafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=120ec55ab5704dd9a3205009e0d4c341, user_id=dc15014b11be4ceea732300a49c70033, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:45.984522 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424c384-a1cb-4eac-8803-18b1774faafc admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:46.079889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1115/2218] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:40:45 2022] PUT /identity/v3/projects/120ec55ab5704dd9a3205009e0d4c341/users/dc15014b11be4ceea732300a49c70033/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:46.091611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b753166-4d58-41e1-9941-73d0f5d43f26 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:46.091946 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b753166-4d58-41e1-9941-73d0f5d43f26 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:46.092330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b753166-4d58-41e1-9941-73d0f5d43f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:46.120477 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-0b753166-4d58-41e1-9941-73d0f5d43f26 None None] MFA Rules not processed for user `dc15014b11be4ceea732300a49c70033`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:46.122226 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0b753166-4d58-41e1-9941-73d0f5d43f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:46.182394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1104/2219] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:46.193847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424c384-a1cb-4eac-8803-18b1774faafc admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:46.195725 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5424c384-a1cb-4eac-8803-18b1774faafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:46.251301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424c384-a1cb-4eac-8803-18b1774faafc admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:46.255017 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14ac9d-09e3-4764-8f99-959e7f9eeb27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:46.255652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14ac9d-09e3-4764-8f99-959e7f9eeb27 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:46.255936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14ac9d-09e3-4764-8f99-959e7f9eeb27 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:46.256248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14ac9d-09e3-4764-8f99-959e7f9eeb27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:46.264321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14ac9d-09e3-4764-8f99-959e7f9eeb27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:46.266082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14ac9d-09e3-4764-8f99-959e7f9eeb27 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:46.274950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1116/2220] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:40:53.359702 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d23fc4-d0b7-4c74-bd04-207e9e95b39b None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:53.360233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d23fc4-d0b7-4c74-bd04-207e9e95b39b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:53.360329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d23fc4-d0b7-4c74-bd04-207e9e95b39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:53.387292 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-06d23fc4-d0b7-4c74-bd04-207e9e95b39b None None] MFA Rules not processed for user `fb710b14dbb44ea3b8d8942e89088b17`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:53.388523 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-06d23fc4-d0b7-4c74-bd04-207e9e95b39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:53.455881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1105/2221] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:59.157540 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14ac9d-09e3-4764-8f99-959e7f9eeb27 service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:59.161339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4f14ac9d-09e3-4764-8f99-959e7f9eeb27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:59.409556 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14ac9d-09e3-4764-8f99-959e7f9eeb27 service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:40:59.415136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:40:59.416023 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:59.416344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:59.416622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] PATH_INFO: `/v3/users/23b93432278246349d7b87334d40ce4d` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:59.417846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b93432278246349d7b87334d40ce4d)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:40:59.420355 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:40:59.703926 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b93432278246349d7b87334d40ce4d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:59.704621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b93432278246349d7b87334d40ce4d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:59.787172 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b93432278246349d7b87334d40ce4d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:59.787804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b93432278246349d7b87334d40ce4d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:59.802469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b93432278246349d7b87334d40ce4d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:40:59.824252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1117/2222] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:40:59 2022] DELETE /identity/v3/users/23b93432278246349d7b87334d40ce4d => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:40:59.836627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee92b-4732-4557-b23c-08cee11e2d0e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:40:59.837112 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee92b-4732-4557-b23c-08cee11e2d0e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:40:59.837265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ee92b-4732-4557-b23c-08cee11e2d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:40:59.863606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-c70ee92b-4732-4557-b23c-08cee11e2d0e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:40:59.864825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c70ee92b-4732-4557-b23c-08cee11e2d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:40:59.923934 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1106/2223] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:40:59.934202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:40:59.935843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:00.041255 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00f852-3536-4b40-85e1-83a47358ad62 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:00.045904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84539f61-75b3-4010-9626-9be2d7a2ec56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:00.046563 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84539f61-75b3-4010-9626-9be2d7a2ec56 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:00.046856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84539f61-75b3-4010-9626-9be2d7a2ec56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:00.047191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84539f61-75b3-4010-9626-9be2d7a2ec56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:00.057158 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84539f61-75b3-4010-9626-9be2d7a2ec56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:00.058634 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84539f61-75b3-4010-9626-9be2d7a2ec56 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:00.071574 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1118/2224] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:41:00.572526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ee92b-4732-4557-b23c-08cee11e2d0e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:00.573651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c70ee92b-4732-4557-b23c-08cee11e2d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:00.591845 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ee92b-4732-4557-b23c-08cee11e2d0e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:00.597285 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:00.598360 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:00.598672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:00.598947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b admin admin] PATH_INFO: `/v3/projects/9949b429da664a16b6428565eb5d5ce1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:00.600161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9949b429da664a16b6428565eb5d5ce1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:00.603090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:00.724456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9949b429da664a16b6428565eb5d5ce1', 'request_id': 'req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:00.730044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9949b429da664a16b6428565eb5d5ce1', 'request_id': 'req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:00.736691 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9949b429da664a16b6428565eb5d5ce1', 'request_id': 'req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:00.906771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b admin admin] The token cache is being invalidate because project 9949b429da664a16b6428565eb5d5ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:41:00.907370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:00.907762 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c6a1d0fd-d4dd-4431-8af7-f42fa276404b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:00.909432 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1107/2225] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:41:00 2022] DELETE /identity/v3/projects/9949b429da664a16b6428565eb5d5ce1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:00.914272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff47a8-93ac-4f63-9fd6-7be7c7dd5f85 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:00.914698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff47a8-93ac-4f63-9fd6-7be7c7dd5f85 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:00.914848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff47a8-93ac-4f63-9fd6-7be7c7dd5f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:00.955739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-dfff47a8-93ac-4f63-9fd6-7be7c7dd5f85 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:00.957105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-dfff47a8-93ac-4f63-9fd6-7be7c7dd5f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:01.013036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1119/2226] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:01.020674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb25aa-9a63-4c18-a11b-5e6d5d4a2fcc None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:01.020964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb25aa-9a63-4c18-a11b-5e6d5d4a2fcc None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:01.021242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb25aa-9a63-4c18-a11b-5e6d5d4a2fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:01.044961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7deb25aa-9a63-4c18-a11b-5e6d5d4a2fcc None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:01.046145 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7deb25aa-9a63-4c18-a11b-5e6d5d4a2fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:01.054656 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1108/2227] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:01.059166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff47a8-93ac-4f63-9fd6-7be7c7dd5f85 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:01.068627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff47a8-93ac-4f63-9fd6-7be7c7dd5f85 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:01.073255 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115ee9f-7e9e-4354-92bc-9bd40deee257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:01.073838 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115ee9f-7e9e-4354-92bc-9bd40deee257 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:01.074122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115ee9f-7e9e-4354-92bc-9bd40deee257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:01.074395 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115ee9f-7e9e-4354-92bc-9bd40deee257 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:01.075612 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115ee9f-7e9e-4354-92bc-9bd40deee257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:41:01.075929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115ee9f-7e9e-4354-92bc-9bd40deee257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:01.077551 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115ee9f-7e9e-4354-92bc-9bd40deee257 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:01.088541 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1120/2228] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:41:01.093328 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb25aa-9a63-4c18-a11b-5e6d5d4a2fcc None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:01.102369 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb25aa-9a63-4c18-a11b-5e6d5d4a2fcc None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:01.106949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42fe78-02c9-4485-8ae6-6139d269ab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:01.107567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42fe78-02c9-4485-8ae6-6139d269ab99 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:01.107852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42fe78-02c9-4485-8ae6-6139d269ab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:01.108124 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42fe78-02c9-4485-8ae6-6139d269ab99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:01.108849 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42fe78-02c9-4485-8ae6-6139d269ab99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:01.110734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42fe78-02c9-4485-8ae6-6139d269ab99 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:01.199316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1109/2229] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:41:01 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:01.203978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115ee9f-7e9e-4354-92bc-9bd40deee257 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:01.213647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115ee9f-7e9e-4354-92bc-9bd40deee257 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:01.269374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78f392-b3ec-42b6-828c-e456f21e182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:01.270044 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78f392-b3ec-42b6-828c-e456f21e182a admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:01.270326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78f392-b3ec-42b6-828c-e456f21e182a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:01.270602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78f392-b3ec-42b6-828c-e456f21e182a admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:01.271317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78f392-b3ec-42b6-828c-e456f21e182a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:01.273264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78f392-b3ec-42b6-828c-e456f21e182a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:01.380989 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1121/2230] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:41:01 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:01.385109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42fe78-02c9-4485-8ae6-6139d269ab99 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:01.396634 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42fe78-02c9-4485-8ae6-6139d269ab99 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:01.401473 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03163c-d11b-48e0-8d89-7cf7ab4b6371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:01.402117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03163c-d11b-48e0-8d89-7cf7ab4b6371 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:01.402401 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03163c-d11b-48e0-8d89-7cf7ab4b6371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:01.402677 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03163c-d11b-48e0-8d89-7cf7ab4b6371 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:01.403501 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03163c-d11b-48e0-8d89-7cf7ab4b6371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:01.405133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03163c-d11b-48e0-8d89-7cf7ab4b6371 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:01.418635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1110/2231] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:01.419828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78f392-b3ec-42b6-828c-e456f21e182a admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:01.429713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78f392-b3ec-42b6-828c-e456f21e182a admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:01.434748 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803f081-992c-45e7-96f8-51d859e3b7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:01.436034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803f081-992c-45e7-96f8-51d859e3b7dc admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:01.436346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803f081-992c-45e7-96f8-51d859e3b7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:01.436619 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803f081-992c-45e7-96f8-51d859e3b7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:01.437341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803f081-992c-45e7-96f8-51d859e3b7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:01.438939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803f081-992c-45e7-96f8-51d859e3b7dc admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:01.449406 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1122/2232] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:41:01.454700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03163c-d11b-48e0-8d89-7cf7ab4b6371 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:01.464801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03163c-d11b-48e0-8d89-7cf7ab4b6371 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:01.470387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04b79e-b442-425a-be6a-6e21e0569568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:01.471276 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04b79e-b442-425a-be6a-6e21e0569568 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:01.471558 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04b79e-b442-425a-be6a-6e21e0569568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:01.471864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04b79e-b442-425a-be6a-6e21e0569568 admin admin] PATH_INFO: `/v3/projects/a501642d06b54b94b85256a66c6be5fb/users/8c2c1098e3254bc492cf24761a664a1b/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:01.489119 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04b79e-b442-425a-be6a-6e21e0569568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a501642d06b54b94b85256a66c6be5fb, user_id=8c2c1098e3254bc492cf24761a664a1b, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:01.491769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04b79e-b442-425a-be6a-6e21e0569568 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:01.604436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1111/2233] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:41:01 2022] PUT /identity/v3/projects/a501642d06b54b94b85256a66c6be5fb/users/8c2c1098e3254bc492cf24761a664a1b/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:01.610806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1274ca7-624e-4db3-aa6e-0b332658b2b4 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:01.611106 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1274ca7-624e-4db3-aa6e-0b332658b2b4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:01.611393 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1274ca7-624e-4db3-aa6e-0b332658b2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:01.629375 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a1274ca7-624e-4db3-aa6e-0b332658b2b4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:01.630573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a1274ca7-624e-4db3-aa6e-0b332658b2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:01.688722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1123/2234] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:01.697910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04b79e-b442-425a-be6a-6e21e0569568 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:01.699610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-da04b79e-b442-425a-be6a-6e21e0569568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:01.763759 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04b79e-b442-425a-be6a-6e21e0569568 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:01.767603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca8c5d-c2f4-4122-a06e-ee6f81229523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:01.768280 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca8c5d-c2f4-4122-a06e-ee6f81229523 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:01.768565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca8c5d-c2f4-4122-a06e-ee6f81229523 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:01.768846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca8c5d-c2f4-4122-a06e-ee6f81229523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:01.778336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca8c5d-c2f4-4122-a06e-ee6f81229523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:01.779783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca8c5d-c2f4-4122-a06e-ee6f81229523 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:01.789440 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1112/2235] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:41:07.069571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b37f8-1e17-439f-b3e4-1a3c35fe88d1 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:07.070719 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b37f8-1e17-439f-b3e4-1a3c35fe88d1 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:07.074456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b37f8-1e17-439f-b3e4-1a3c35fe88d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:07.097783 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b53b37f8-1e17-439f-b3e4-1a3c35fe88d1 None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:07.100456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b53b37f8-1e17-439f-b3e4-1a3c35fe88d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:07.204683 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1124/2236] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:07.260715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca8c5d-c2f4-4122-a06e-ee6f81229523 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:07.261440 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-04ca8c5d-c2f4-4122-a06e-ee6f81229523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:07.345862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca8c5d-c2f4-4122-a06e-ee6f81229523 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:07.354081 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c42cc-2973-4026-8d36-27eb18a14e78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:07.355001 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c42cc-2973-4026-8d36-27eb18a14e78 service swift] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:07.355289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c42cc-2973-4026-8d36-27eb18a14e78 service swift] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:07.355572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c42cc-2973-4026-8d36-27eb18a14e78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:07.369031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c42cc-2973-4026-8d36-27eb18a14e78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:07.370866 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c42cc-2973-4026-8d36-27eb18a14e78 service swift] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:07.380317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1113/2237] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:41:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:41:09.255134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b37f8-1e17-439f-b3e4-1a3c35fe88d1 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:09.257321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b53b37f8-1e17-439f-b3e4-1a3c35fe88d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:09.285085 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b37f8-1e17-439f-b3e4-1a3c35fe88d1 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:09.293238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a95385-9ad5-420a-ba34-dcb38c935ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:09.294648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a95385-9ad5-420a-ba34-dcb38c935ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:09.294941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a95385-9ad5-420a-ba34-dcb38c935ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:09.295224 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a95385-9ad5-420a-ba34-dcb38c935ea7 admin admin] PATH_INFO: `/v3/users/dc15014b11be4ceea732300a49c70033` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:09.296721 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a95385-9ad5-420a-ba34-dcb38c935ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc15014b11be4ceea732300a49c70033)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:09.298875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a95385-9ad5-420a-ba34-dcb38c935ea7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:09.485463 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be016fc-d22e-45d3-9d61-94c03b2e370f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:09.486011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be016fc-d22e-45d3-9d61-94c03b2e370f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:09.486133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be016fc-d22e-45d3-9d61-94c03b2e370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:09.567919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-4be016fc-d22e-45d3-9d61-94c03b2e370f None None] MFA Rules not processed for user `8c2c1098e3254bc492cf24761a664a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:09.569878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4be016fc-d22e-45d3-9d61-94c03b2e370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:09.657590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-10a95385-9ad5-420a-ba34-dcb38c935ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc15014b11be4ceea732300a49c70033'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:09.658652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-10a95385-9ad5-420a-ba34-dcb38c935ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc15014b11be4ceea732300a49c70033'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:09.684057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1114/2238] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:41:09.695354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be016fc-d22e-45d3-9d61-94c03b2e370f None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:09.705164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be016fc-d22e-45d3-9d61-94c03b2e370f None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:09.711413 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71020ba-4d9c-4fe3-a664-741fdd98060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:09.713937 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71020ba-4d9c-4fe3-a664-741fdd98060e admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:09.714235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71020ba-4d9c-4fe3-a664-741fdd98060e admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:09.714569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71020ba-4d9c-4fe3-a664-741fdd98060e admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:09.717725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71020ba-4d9c-4fe3-a664-741fdd98060e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:09.723447 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71020ba-4d9c-4fe3-a664-741fdd98060e admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:09.778177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-10a95385-9ad5-420a-ba34-dcb38c935ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc15014b11be4ceea732300a49c70033'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:09.778724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-10a95385-9ad5-420a-ba34-dcb38c935ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc15014b11be4ceea732300a49c70033'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:09.800297 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-10a95385-9ad5-420a-ba34-dcb38c935ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc15014b11be4ceea732300a49c70033'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:09.832620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1125/2239] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:41:09 2022] DELETE /identity/v3/users/dc15014b11be4ceea732300a49c70033 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:09.834905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16073ad3-01ef-49e2-83ce-fbec5e690869 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:09.835496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16073ad3-01ef-49e2-83ce-fbec5e690869 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:09.836625 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16073ad3-01ef-49e2-83ce-fbec5e690869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:09.864768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-16073ad3-01ef-49e2-83ce-fbec5e690869 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:09.864768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-16073ad3-01ef-49e2-83ce-fbec5e690869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:09.888907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1115/2240] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:41:09 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:09.893203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71020ba-4d9c-4fe3-a664-741fdd98060e admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:09.897012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f71020ba-4d9c-4fe3-a664-741fdd98060e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:09.937271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1126/2241] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:09.947227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16073ad3-01ef-49e2-83ce-fbec5e690869 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:09.954194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-16073ad3-01ef-49e2-83ce-fbec5e690869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:10.021563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71020ba-4d9c-4fe3-a664-741fdd98060e admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:10.026883 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16073ad3-01ef-49e2-83ce-fbec5e690869 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:10.031042 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7894e6-e115-4fa7-9b5c-3c3736a7d27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:10.032014 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7894e6-e115-4fa7-9b5c-3c3736a7d27b admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:10.032765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7894e6-e115-4fa7-9b5c-3c3736a7d27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:10.033268 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7894e6-e115-4fa7-9b5c-3c3736a7d27b admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:10.034298 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7894e6-e115-4fa7-9b5c-3c3736a7d27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:10.036944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7894e6-e115-4fa7-9b5c-3c3736a7d27b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:10.110615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c0aab-debf-4433-9986-c53227118b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:10.111218 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0aab-debf-4433-9986-c53227118b44 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:10.111504 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0aab-debf-4433-9986-c53227118b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:10.111837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0aab-debf-4433-9986-c53227118b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:10.125749 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c0aab-debf-4433-9986-c53227118b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:10.127478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c0aab-debf-4433-9986-c53227118b44 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:10.150855 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1127/2242] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:41:10.182167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1116/2243] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:41:09 2022] POST /identity/v3/users => generated 298 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:10.184335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c0aab-debf-4433-9986-c53227118b44 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:10.196778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c0aab-debf-4433-9986-c53227118b44 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:10.211759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79617c6-34e1-441e-ba77-e4896412babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:10.212472 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79617c6-34e1-441e-ba77-e4896412babf admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:10.212762 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79617c6-34e1-441e-ba77-e4896412babf admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:10.213047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79617c6-34e1-441e-ba77-e4896412babf admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:10.213843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79617c6-34e1-441e-ba77-e4896412babf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:10.225183 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79617c6-34e1-441e-ba77-e4896412babf admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:10.288894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1128/2244] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:10.289963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7894e6-e115-4fa7-9b5c-3c3736a7d27b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:10.330734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7894e6-e115-4fa7-9b5c-3c3736a7d27b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:10.361756 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cacf3e-67de-4f46-b2bf-3961cf584822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:10.362678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cacf3e-67de-4f46-b2bf-3961cf584822 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:10.363116 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cacf3e-67de-4f46-b2bf-3961cf584822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:10.363442 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cacf3e-67de-4f46-b2bf-3961cf584822 admin admin] PATH_INFO: `/v3/projects/c6756c1e2e044897b12a0201794685d1/users/7fe44104ac9f4b9bb50b18d3f12f477d/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:10.411684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cacf3e-67de-4f46-b2bf-3961cf584822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6756c1e2e044897b12a0201794685d1, user_id=7fe44104ac9f4b9bb50b18d3f12f477d, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:10.418831 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cacf3e-67de-4f46-b2bf-3961cf584822 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:10.538696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1117/2245] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:41:10 2022] PUT /identity/v3/projects/c6756c1e2e044897b12a0201794685d1/users/7fe44104ac9f4b9bb50b18d3f12f477d/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:10.542800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79617c6-34e1-441e-ba77-e4896412babf admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:10.556646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79617c6-34e1-441e-ba77-e4896412babf admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:10.662492 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bda90-83b6-4880-981f-664c37555558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:10.663345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bda90-83b6-4880-981f-664c37555558 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:10.667573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bda90-83b6-4880-981f-664c37555558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:10.667573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bda90-83b6-4880-981f-664c37555558 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:10.667573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bda90-83b6-4880-981f-664c37555558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:10.670229 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bda90-83b6-4880-981f-664c37555558 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:10.684222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1129/2246] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:10.688239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cacf3e-67de-4f46-b2bf-3961cf584822 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:10.707408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cacf3e-67de-4f46-b2bf-3961cf584822 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:10.723447 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d284e6-4415-42b2-b826-8bb498c78dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:10.724962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d284e6-4415-42b2-b826-8bb498c78dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:10.724962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d284e6-4415-42b2-b826-8bb498c78dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:10.728692 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d284e6-4415-42b2-b826-8bb498c78dc4 admin admin] PATH_INFO: `/v3/projects/c6756c1e2e044897b12a0201794685d1/users/7fe44104ac9f4b9bb50b18d3f12f477d/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:10.734622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d284e6-4415-42b2-b826-8bb498c78dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6756c1e2e044897b12a0201794685d1, user_id=7fe44104ac9f4b9bb50b18d3f12f477d, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:10.744970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d284e6-4415-42b2-b826-8bb498c78dc4 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:10.774601 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1118/2247] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:41:10 2022] PUT /identity/v3/projects/c6756c1e2e044897b12a0201794685d1/users/7fe44104ac9f4b9bb50b18d3f12f477d/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:10.873959 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bda90-83b6-4880-981f-664c37555558 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:10.873959 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e24bda90-83b6-4880-981f-664c37555558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:10.894872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bda90-83b6-4880-981f-664c37555558 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:11.000042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf312d-64ac-4afa-9803-e9dea5ca4b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:11.000976 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf312d-64ac-4afa-9803-e9dea5ca4b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:11.001260 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf312d-64ac-4afa-9803-e9dea5ca4b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:11.001534 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf312d-64ac-4afa-9803-e9dea5ca4b99 admin admin] PATH_INFO: `/v3/projects/120ec55ab5704dd9a3205009e0d4c341` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:11.002857 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf312d-64ac-4afa-9803-e9dea5ca4b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=120ec55ab5704dd9a3205009e0d4c341)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:11.004835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf312d-64ac-4afa-9803-e9dea5ca4b99 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:11.195292 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bacf312d-64ac-4afa-9803-e9dea5ca4b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120ec55ab5704dd9a3205009e0d4c341', 'request_id': 'req-bacf312d-64ac-4afa-9803-e9dea5ca4b99'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:11.204691 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bacf312d-64ac-4afa-9803-e9dea5ca4b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120ec55ab5704dd9a3205009e0d4c341', 'request_id': 'req-bacf312d-64ac-4afa-9803-e9dea5ca4b99'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:11.290121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bacf312d-64ac-4afa-9803-e9dea5ca4b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120ec55ab5704dd9a3205009e0d4c341', 'request_id': 'req-bacf312d-64ac-4afa-9803-e9dea5ca4b99'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:11.320414 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bacf312d-64ac-4afa-9803-e9dea5ca4b99 admin admin] The token cache is being invalidate because project 120ec55ab5704dd9a3205009e0d4c341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:41:11.322815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bacf312d-64ac-4afa-9803-e9dea5ca4b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:11.325081 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bacf312d-64ac-4afa-9803-e9dea5ca4b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:11.333192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1130/2248] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:41:10 2022] DELETE /identity/v3/projects/120ec55ab5704dd9a3205009e0d4c341 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:12.189295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d284e6-4415-42b2-b826-8bb498c78dc4 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:12.196223 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f9d284e6-4415-42b2-b826-8bb498c78dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:12.217316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d284e6-4415-42b2-b826-8bb498c78dc4 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:12.386333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:12.398087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:12.398087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:12.398087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] PATH_INFO: `/v3/users/9b92b50c4dff46269161855fba0dcea4` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:12.398087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b92b50c4dff46269161855fba0dcea4)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:12.398087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:12.663167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b92b50c4dff46269161855fba0dcea4'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:12.737899 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b92b50c4dff46269161855fba0dcea4'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:12.768604 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b92b50c4dff46269161855fba0dcea4'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:12.770509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b92b50c4dff46269161855fba0dcea4'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:12.793988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b92b50c4dff46269161855fba0dcea4'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:12.806197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1119/2249] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:41:12 2022] DELETE /identity/v3/users/9b92b50c4dff46269161855fba0dcea4 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:12.812776 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f52770-50d7-4ca9-823d-c1135db44b53 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:12.813751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f52770-50d7-4ca9-823d-c1135db44b53 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:12.814268 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f52770-50d7-4ca9-823d-c1135db44b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:12.859169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-77f52770-50d7-4ca9-823d-c1135db44b53 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:12.861301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-77f52770-50d7-4ca9-823d-c1135db44b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:12.982998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1131/2250] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:12.995266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:13.004343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:13.144584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44907210-f323-40d3-a06c-f924fe42f6d1 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:13.144584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a701aba-936f-443a-873f-52846608cd00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:13.144584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a701aba-936f-443a-873f-52846608cd00 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:13.144584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a701aba-936f-443a-873f-52846608cd00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:13.145393 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a701aba-936f-443a-873f-52846608cd00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:13.150230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a701aba-936f-443a-873f-52846608cd00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:13.151747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a701aba-936f-443a-873f-52846608cd00 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:13.164765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1120/2251] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:41:13.660026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f52770-50d7-4ca9-823d-c1135db44b53 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:13.663313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-77f52770-50d7-4ca9-823d-c1135db44b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:13.673963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f52770-50d7-4ca9-823d-c1135db44b53 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:13.694143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:13.694143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:13.694143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:13.694143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] PATH_INFO: `/v3/users/2323762c0b0b478ab554b57ba34ebaf2` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:13.703107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2323762c0b0b478ab554b57ba34ebaf2)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:13.706223 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:13.986132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2323762c0b0b478ab554b57ba34ebaf2'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:13.986829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2323762c0b0b478ab554b57ba34ebaf2'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:14.083824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2323762c0b0b478ab554b57ba34ebaf2'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:14.084543 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2323762c0b0b478ab554b57ba34ebaf2'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:14.104193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2323762c0b0b478ab554b57ba34ebaf2'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:14.139673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1132/2252] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:41:13 2022] DELETE /identity/v3/users/2323762c0b0b478ab554b57ba34ebaf2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:14.210289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a701aba-936f-443a-873f-52846608cd00 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:14.212582 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6a701aba-936f-443a-873f-52846608cd00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:14.237449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a701aba-936f-443a-873f-52846608cd00 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:14.368524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:14.369410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:14.369690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:14.369974 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] PATH_INFO: `/v3/projects/616c6aea36824a658430bb6056094825` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:14.371245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=616c6aea36824a658430bb6056094825)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:14.373913 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:14.561010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616c6aea36824a658430bb6056094825', 'request_id': 'req-e890f665-061e-48fc-bd8c-01487f4eb488'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:14.566386 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:14.574887 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:14.588303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616c6aea36824a658430bb6056094825', 'request_id': 'req-e890f665-061e-48fc-bd8c-01487f4eb488'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:14.597984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616c6aea36824a658430bb6056094825', 'request_id': 'req-e890f665-061e-48fc-bd8c-01487f4eb488'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:14.608637 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d60bb-4b00-468c-b2ef-9106d64bfd0a admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:14.714083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] The token cache is being invalidate because project 616c6aea36824a658430bb6056094825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:41:14.714436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:14.716494 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:14.726729 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1121/2253] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:41:14 2022] DELETE /identity/v3/projects/616c6aea36824a658430bb6056094825 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:14.727915 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:14.734426 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:14.807453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:14.809956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:14.810250 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:14.812338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] PATH_INFO: `/v3/projects/86301fa71e874428bf4624eb4015bd15` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:14.813248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86301fa71e874428bf4624eb4015bd15)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:14.818843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:14.910783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890f665-061e-48fc-bd8c-01487f4eb488 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:14.926524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:14.927582 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:14.927877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:14.928271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] PATH_INFO: `/v3/users/bc6a4b65bbc449a5bf3adfec3c2b02bd` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:14.929830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc6a4b65bbc449a5bf3adfec3c2b02bd)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:14.932902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:14.996034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86301fa71e874428bf4624eb4015bd15', 'request_id': 'req-37bb29eb-1a0c-4810-b73c-37bb9ed96127'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.015401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86301fa71e874428bf4624eb4015bd15', 'request_id': 'req-37bb29eb-1a0c-4810-b73c-37bb9ed96127'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.098515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86301fa71e874428bf4624eb4015bd15', 'request_id': 'req-37bb29eb-1a0c-4810-b73c-37bb9ed96127'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.119813 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] The token cache is being invalidate because project 86301fa71e874428bf4624eb4015bd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:41:15.120128 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.121170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.128990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1133/2254] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:41:14 2022] DELETE /identity/v3/projects/86301fa71e874428bf4624eb4015bd15 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:41:15.132980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:15.135418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:15.222272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc6a4b65bbc449a5bf3adfec3c2b02bd'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.329250 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc6a4b65bbc449a5bf3adfec3c2b02bd'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.349949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc6a4b65bbc449a5bf3adfec3c2b02bd'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.354918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc6a4b65bbc449a5bf3adfec3c2b02bd'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.355141 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb29eb-1a0c-4810-b73c-37bb9ed96127 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:15.383770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:15.385859 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc6a4b65bbc449a5bf3adfec3c2b02bd'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.386727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:15.388673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:15.389042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] PATH_INFO: `/v3/users/6ba86cfb2a084cd4acd1a79b1966f13c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:15.393579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba86cfb2a084cd4acd1a79b1966f13c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:15.400925 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:15.407531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1122/2255] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:41:14 2022] DELETE /identity/v3/users/bc6a4b65bbc449a5bf3adfec3c2b02bd => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:15.736418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba86cfb2a084cd4acd1a79b1966f13c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.744213 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba86cfb2a084cd4acd1a79b1966f13c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.839136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba86cfb2a084cd4acd1a79b1966f13c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.839136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba86cfb2a084cd4acd1a79b1966f13c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.870104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba86cfb2a084cd4acd1a79b1966f13c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:15.899802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1134/2256] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:41:15 2022] DELETE /identity/v3/users/6ba86cfb2a084cd4acd1a79b1966f13c => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:16.411209 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:16.413241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:16.596902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21f41b-da95-4114-9e51-c725c1bc1a8f admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:16.737814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:16.741434 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:16.744439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:16.746214 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f admin admin] PATH_INFO: `/v3/projects/606637c4c51142a29baa4b5b0899e6e4` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:16.753169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=606637c4c51142a29baa4b5b0899e6e4)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:16.758361 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:16.956950 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606637c4c51142a29baa4b5b0899e6e4', 'request_id': 'req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:16.963558 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606637c4c51142a29baa4b5b0899e6e4', 'request_id': 'req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:16.980009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606637c4c51142a29baa4b5b0899e6e4', 'request_id': 'req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:16.992450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:16.994323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:17.047303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73301ce-9b0c-4b2b-964d-a86cf7a83634 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:17.080236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f admin admin] The token cache is being invalidate because project 606637c4c51142a29baa4b5b0899e6e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:41:17.081259 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:17.081713 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-94ce5017-f576-47ba-84a0-37b8ba8a4a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:17.084327 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1123/2257] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:41:16 2022] DELETE /identity/v3/projects/606637c4c51142a29baa4b5b0899e6e4 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:17.089610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5aec3e-823a-4398-b9c2-86b0e06c6369 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:17.090129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5aec3e-823a-4398-b9c2-86b0e06c6369 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:17.090612 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5aec3e-823a-4398-b9c2-86b0e06c6369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:17.210738 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-1a5aec3e-823a-4398-b9c2-86b0e06c6369 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:17.214407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1a5aec3e-823a-4398-b9c2-86b0e06c6369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:17.261690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e734d1e-0181-42de-ba58-fb5e51856bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:17.261690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e734d1e-0181-42de-ba58-fb5e51856bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:17.261690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e734d1e-0181-42de-ba58-fb5e51856bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:17.261690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e734d1e-0181-42de-ba58-fb5e51856bfe admin admin] PATH_INFO: `/v3/projects/1d7723e076c340ab911e598769ba25b8` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:17.265261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e734d1e-0181-42de-ba58-fb5e51856bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7723e076c340ab911e598769ba25b8)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:17.272499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e734d1e-0181-42de-ba58-fb5e51856bfe admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:17.339255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1124/2258] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:17.348909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73940fcd-d374-4bdf-b3bf-960aa8976c49 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:17.349203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73940fcd-d374-4bdf-b3bf-960aa8976c49 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:17.350162 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73940fcd-d374-4bdf-b3bf-960aa8976c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:17.395842 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-73940fcd-d374-4bdf-b3bf-960aa8976c49 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:17.397246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-73940fcd-d374-4bdf-b3bf-960aa8976c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:17.423413 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1125/2259] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:17.427841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73940fcd-d374-4bdf-b3bf-960aa8976c49 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:17.442155 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0e734d1e-0181-42de-ba58-fb5e51856bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7723e076c340ab911e598769ba25b8', 'request_id': 'req-0e734d1e-0181-42de-ba58-fb5e51856bfe'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:17.458522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73940fcd-d374-4bdf-b3bf-960aa8976c49 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:17.460894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0e734d1e-0181-42de-ba58-fb5e51856bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7723e076c340ab911e598769ba25b8', 'request_id': 'req-0e734d1e-0181-42de-ba58-fb5e51856bfe'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:17.552938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0e734d1e-0181-42de-ba58-fb5e51856bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7723e076c340ab911e598769ba25b8', 'request_id': 'req-0e734d1e-0181-42de-ba58-fb5e51856bfe'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:17.572321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0e734d1e-0181-42de-ba58-fb5e51856bfe admin admin] The token cache is being invalidate because project 1d7723e076c340ab911e598769ba25b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:41:17.572935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0e734d1e-0181-42de-ba58-fb5e51856bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:17.574269 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0e734d1e-0181-42de-ba58-fb5e51856bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:17.577743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86420da8-c9d6-4a06-9170-879031cca5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:17.578438 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86420da8-c9d6-4a06-9170-879031cca5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:17.578787 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86420da8-c9d6-4a06-9170-879031cca5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:17.578994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86420da8-c9d6-4a06-9170-879031cca5d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:17.579621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1135/2260] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:41:16 2022] DELETE /identity/v3/projects/1d7723e076c340ab911e598769ba25b8 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:17.580395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86420da8-c9d6-4a06-9170-879031cca5d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:41:17.580723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86420da8-c9d6-4a06-9170-879031cca5d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:17.582358 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86420da8-c9d6-4a06-9170-879031cca5d4 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:17.584512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066b5a3-43d0-45a6-b316-5fd73dd26f4c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:17.585148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066b5a3-43d0-45a6-b316-5fd73dd26f4c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:17.585629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066b5a3-43d0-45a6-b316-5fd73dd26f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:17.616859 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1126/2261] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:41:17.621833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86420da8-c9d6-4a06-9170-879031cca5d4 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:17.625347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-86420da8-c9d6-4a06-9170-879031cca5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:17.626048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-3066b5a3-43d0-45a6-b316-5fd73dd26f4c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:17.630789 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3066b5a3-43d0-45a6-b316-5fd73dd26f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:17.643450 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86420da8-c9d6-4a06-9170-879031cca5d4 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:17.648852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b098f7-88d7-47e6-b6e3-095d8f6d2561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:17.649497 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b098f7-88d7-47e6-b6e3-095d8f6d2561 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:17.649730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b098f7-88d7-47e6-b6e3-095d8f6d2561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:17.650190 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b098f7-88d7-47e6-b6e3-095d8f6d2561 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:17.650609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1136/2262] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:41:17.650914 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b098f7-88d7-47e6-b6e3-095d8f6d2561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:17.653385 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b098f7-88d7-47e6-b6e3-095d8f6d2561 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:17.657662 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a9dc1-8534-4972-a781-e3f84df6885c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:17.658328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a9dc1-8534-4972-a781-e3f84df6885c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:17.658801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a9dc1-8534-4972-a781-e3f84df6885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:17.717030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a05a9dc1-8534-4972-a781-e3f84df6885c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:17.722091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a05a9dc1-8534-4972-a781-e3f84df6885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:17.742995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1137/2263] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:41:17.747385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a9dc1-8534-4972-a781-e3f84df6885c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:17.767965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a9dc1-8534-4972-a781-e3f84df6885c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:17.780112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c993ea3-7b35-4eba-99ef-34f4759e6496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:17.784869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c993ea3-7b35-4eba-99ef-34f4759e6496 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:17.784869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c993ea3-7b35-4eba-99ef-34f4759e6496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:17.784869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c993ea3-7b35-4eba-99ef-34f4759e6496 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:17.784869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c993ea3-7b35-4eba-99ef-34f4759e6496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:41:17.784869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c993ea3-7b35-4eba-99ef-34f4759e6496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:17.787095 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c993ea3-7b35-4eba-99ef-34f4759e6496 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:17.793913 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1127/2264] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:41:17 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:17.795947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b098f7-88d7-47e6-b6e3-095d8f6d2561 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:17.824166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1138/2265] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:41:17.828068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c993ea3-7b35-4eba-99ef-34f4759e6496 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:17.851601 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c993ea3-7b35-4eba-99ef-34f4759e6496 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:17.955887 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b098f7-88d7-47e6-b6e3-095d8f6d2561 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:17.965096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ade4-31c0-490d-a175-666357e6d19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:17.966562 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ade4-31c0-490d-a175-666357e6d19b admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:17.967052 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ade4-31c0-490d-a175-666357e6d19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:17.971612 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af22f0-456b-4240-bc80-49c044e1d376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:17.974599 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af22f0-456b-4240-bc80-49c044e1d376 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:17.974797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af22f0-456b-4240-bc80-49c044e1d376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:17.975044 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af22f0-456b-4240-bc80-49c044e1d376 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:17.975760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af22f0-456b-4240-bc80-49c044e1d376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:17.979862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ade4-31c0-490d-a175-666357e6d19b admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:17.980995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9ade4-31c0-490d-a175-666357e6d19b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:17.982207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af22f0-456b-4240-bc80-49c044e1d376 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:17.993540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9ade4-31c0-490d-a175-666357e6d19b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:18.103287 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1139/2266] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:41:17 2022] POST /identity/v3/projects => generated 371 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:18.108446 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af22f0-456b-4240-bc80-49c044e1d376 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:18.137475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1128/2267] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:41:17 2022] POST /identity/v3/users => generated 292 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:18.146623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ade4-31c0-490d-a175-666357e6d19b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:18.189251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ade4-31c0-490d-a175-666357e6d19b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:18.321684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6032c-79ed-45d1-a1ad-ec448f3c226a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:18.323145 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6032c-79ed-45d1-a1ad-ec448f3c226a admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:18.323697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6032c-79ed-45d1-a1ad-ec448f3c226a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:18.324229 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6032c-79ed-45d1-a1ad-ec448f3c226a admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:18.325954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6032c-79ed-45d1-a1ad-ec448f3c226a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:18.326861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af22f0-456b-4240-bc80-49c044e1d376 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:18.343130 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6032c-79ed-45d1-a1ad-ec448f3c226a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:18.356042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40f675-8a98-4dc7-b8c5-edcfa680bd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:18.356042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f675-8a98-4dc7-b8c5-edcfa680bd4b admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:18.356042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f675-8a98-4dc7-b8c5-edcfa680bd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:18.356042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40f675-8a98-4dc7-b8c5-edcfa680bd4b admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:18.367448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40f675-8a98-4dc7-b8c5-edcfa680bd4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:18.367448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40f675-8a98-4dc7-b8c5-edcfa680bd4b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:18.379447 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1129/2268] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:18.382215 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6032c-79ed-45d1-a1ad-ec448f3c226a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:18.406682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6032c-79ed-45d1-a1ad-ec448f3c226a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:18.412065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40136f10-5d05-41be-ad5c-a0e3ca734cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:18.412793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40136f10-5d05-41be-ad5c-a0e3ca734cce admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:18.413268 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40136f10-5d05-41be-ad5c-a0e3ca734cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:18.413715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40136f10-5d05-41be-ad5c-a0e3ca734cce admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:18.414480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40136f10-5d05-41be-ad5c-a0e3ca734cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:18.416727 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40136f10-5d05-41be-ad5c-a0e3ca734cce admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:18.450945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1140/2269] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:41:18 2022] POST /identity/v3/users => generated 286 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:41:18.453849 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1130/2270] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:18.458480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40f675-8a98-4dc7-b8c5-edcfa680bd4b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:18.458698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40136f10-5d05-41be-ad5c-a0e3ca734cce admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:18.479716 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40f675-8a98-4dc7-b8c5-edcfa680bd4b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:18.482688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40136f10-5d05-41be-ad5c-a0e3ca734cce admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:18.487746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d5796-1a4f-4c60-971b-7bdace1d4232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:18.489452 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d5796-1a4f-4c60-971b-7bdace1d4232 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:18.489924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d5796-1a4f-4c60-971b-7bdace1d4232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:18.490467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d5796-1a4f-4c60-971b-7bdace1d4232 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:18.492533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d5796-1a4f-4c60-971b-7bdace1d4232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:18.494808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6233e-dbc5-4c5c-bf68-adbebed5b016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:18.495303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d5796-1a4f-4c60-971b-7bdace1d4232 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:18.495924 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6233e-dbc5-4c5c-bf68-adbebed5b016 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:18.496221 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6233e-dbc5-4c5c-bf68-adbebed5b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:18.496572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6233e-dbc5-4c5c-bf68-adbebed5b016 admin admin] PATH_INFO: `/v3/projects/46819bc1cbc34aeaaf5bd9144106c36e/users/0bb4358924634dbaa68c900f6a3023e1/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:18.514033 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1141/2271] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:18.518681 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d5796-1a4f-4c60-971b-7bdace1d4232 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:18.532936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d5796-1a4f-4c60-971b-7bdace1d4232 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:18.539656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf914fc3-74ac-41b6-9ba9-e71be7f12282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:18.540562 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf914fc3-74ac-41b6-9ba9-e71be7f12282 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:18.541626 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf914fc3-74ac-41b6-9ba9-e71be7f12282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:18.542065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf914fc3-74ac-41b6-9ba9-e71be7f12282 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:18.543075 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf914fc3-74ac-41b6-9ba9-e71be7f12282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:18.545475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf914fc3-74ac-41b6-9ba9-e71be7f12282 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:18.556012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6233e-dbc5-4c5c-bf68-adbebed5b016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46819bc1cbc34aeaaf5bd9144106c36e, user_id=0bb4358924634dbaa68c900f6a3023e1, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:18.560791 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6233e-dbc5-4c5c-bf68-adbebed5b016 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:18.566493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1142/2272] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:41:18.570333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf914fc3-74ac-41b6-9ba9-e71be7f12282 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:18.611314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf914fc3-74ac-41b6-9ba9-e71be7f12282 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:18.645370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4efc4-ce79-422a-9e4d-e59d9b39772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:18.647274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4efc4-ce79-422a-9e4d-e59d9b39772b admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:18.647644 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4efc4-ce79-422a-9e4d-e59d9b39772b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:18.648017 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4efc4-ce79-422a-9e4d-e59d9b39772b admin admin] PATH_INFO: `/v3/projects/7884dfbd2d0342c7bb160bf352044b87/users/0926d1e73af84cd99e7a8f2e2a1c454b/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:18.655953 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1131/2273] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:41:18 2022] PUT /identity/v3/projects/46819bc1cbc34aeaaf5bd9144106c36e/users/0bb4358924634dbaa68c900f6a3023e1/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:18.666992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d0c47-afbb-4c35-8d23-bc534cbd1223 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:18.667678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d0c47-afbb-4c35-8d23-bc534cbd1223 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:18.668514 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d0c47-afbb-4c35-8d23-bc534cbd1223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:18.674393 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4efc4-ce79-422a-9e4d-e59d9b39772b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7884dfbd2d0342c7bb160bf352044b87, user_id=0926d1e73af84cd99e7a8f2e2a1c454b, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:18.677451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4efc4-ce79-422a-9e4d-e59d9b39772b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:18.715029 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-2d6d0c47-afbb-4c35-8d23-bc534cbd1223 None None] MFA Rules not processed for user `0bb4358924634dbaa68c900f6a3023e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:18.716575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2d6d0c47-afbb-4c35-8d23-bc534cbd1223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:18.788890 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1143/2274] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:41:18 2022] PUT /identity/v3/projects/7884dfbd2d0342c7bb160bf352044b87/users/0926d1e73af84cd99e7a8f2e2a1c454b/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:41:18.807115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd44ca1-f52a-4253-97e3-4da72d74d32a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:18.807561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd44ca1-f52a-4253-97e3-4da72d74d32a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:18.808956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd44ca1-f52a-4253-97e3-4da72d74d32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:18.865764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-4bd44ca1-f52a-4253-97e3-4da72d74d32a None None] MFA Rules not processed for user `0926d1e73af84cd99e7a8f2e2a1c454b`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:18.867102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4bd44ca1-f52a-4253-97e3-4da72d74d32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:18.898075 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1132/2275] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:41:18.903361 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d0c47-afbb-4c35-8d23-bc534cbd1223 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:19.039475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d0c47-afbb-4c35-8d23-bc534cbd1223 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:19.054725 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1144/2276] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:19.068022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd44ca1-f52a-4253-97e3-4da72d74d32a None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:19.070344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4bd44ca1-f52a-4253-97e3-4da72d74d32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:19.179253 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac5e13-4be5-4d0d-b38a-584890fc9c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:19.180040 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac5e13-4be5-4d0d-b38a-584890fc9c80 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:19.180350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac5e13-4be5-4d0d-b38a-584890fc9c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:19.180628 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac5e13-4be5-4d0d-b38a-584890fc9c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:19.181339 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac5e13-4be5-4d0d-b38a-584890fc9c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:19.183255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac5e13-4be5-4d0d-b38a-584890fc9c80 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:19.241253 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd44ca1-f52a-4253-97e3-4da72d74d32a None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:19.255238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700bc2b-4ccf-4806-9f49-0be488e6ad8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f9935443bcc4d34aeb56e5b77a96720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:19.257671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700bc2b-4ccf-4806-9f49-0be488e6ad8f service glance] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:19.258138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700bc2b-4ccf-4806-9f49-0be488e6ad8f service glance] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:19.274529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700bc2b-4ccf-4806-9f49-0be488e6ad8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:19.313333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700bc2b-4ccf-4806-9f49-0be488e6ad8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:19.320317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700bc2b-4ccf-4806-9f49-0be488e6ad8f service glance] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:19.323330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1133/2277] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:41:18 2022] POST /identity/v3/projects => generated 381 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:19.324797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac5e13-4be5-4d0d-b38a-584890fc9c80 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:19.342290 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1145/2278] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:41:19.473063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac5e13-4be5-4d0d-b38a-584890fc9c80 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:19.502181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bdca6-4916-4f5c-82a5-ec71749dcea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:19.502876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bdca6-4916-4f5c-82a5-ec71749dcea6 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:19.503161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bdca6-4916-4f5c-82a5-ec71749dcea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:19.503438 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1bdca6-4916-4f5c-82a5-ec71749dcea6 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:19.504164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bdca6-4916-4f5c-82a5-ec71749dcea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:19.506117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1bdca6-4916-4f5c-82a5-ec71749dcea6 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:19.670572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1134/2279] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:41:19 2022] POST /identity/v3/users => generated 297 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:19.674754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700bc2b-4ccf-4806-9f49-0be488e6ad8f service glance] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:19.691592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700bc2b-4ccf-4806-9f49-0be488e6ad8f service glance] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:19.701762 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3b3d9-4d32-4089-a997-71a0a409d2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:19.703340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3b3d9-4d32-4089-a997-71a0a409d2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:19.705379 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3b3d9-4d32-4089-a997-71a0a409d2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:19.705878 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3b3d9-4d32-4089-a997-71a0a409d2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:19.706769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3b3d9-4d32-4089-a997-71a0a409d2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:19.712919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3b3d9-4d32-4089-a997-71a0a409d2b6 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:19.757609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1146/2280] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:19.761923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bdca6-4916-4f5c-82a5-ec71749dcea6 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:19.775438 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1bdca6-4916-4f5c-82a5-ec71749dcea6 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:19.797375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d568e-dad7-45d2-a988-f058aff971ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:19.798478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d568e-dad7-45d2-a988-f058aff971ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:19.799485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d568e-dad7-45d2-a988-f058aff971ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:19.800140 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d568e-dad7-45d2-a988-f058aff971ab admin admin] PATH_INFO: `/v3/projects/9eaebcb99bef42b8879b7ce90ed83f6a/users/486181f3007246399e7d827bfde8f311/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:19.844436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d568e-dad7-45d2-a988-f058aff971ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eaebcb99bef42b8879b7ce90ed83f6a, user_id=486181f3007246399e7d827bfde8f311, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:19.847468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d568e-dad7-45d2-a988-f058aff971ab admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:19.957978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1135/2281] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:41:19 2022] PUT /identity/v3/projects/9eaebcb99bef42b8879b7ce90ed83f6a/users/486181f3007246399e7d827bfde8f311/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:19.962233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3b3d9-4d32-4089-a997-71a0a409d2b6 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:19.982294 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3b3d9-4d32-4089-a997-71a0a409d2b6 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:20.230665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b2f0a-4b57-4a15-b3c3-49342f3c9c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:20.246155 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b2f0a-4b57-4a15-b3c3-49342f3c9c5a admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:20.247168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b2f0a-4b57-4a15-b3c3-49342f3c9c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:20.247605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b2f0a-4b57-4a15-b3c3-49342f3c9c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:20.249364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b2f0a-4b57-4a15-b3c3-49342f3c9c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:20.253648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b2f0a-4b57-4a15-b3c3-49342f3c9c5a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:20.283821 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d568e-dad7-45d2-a988-f058aff971ab admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:20.284074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1147/2282] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:41:20.299679 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d568e-dad7-45d2-a988-f058aff971ab admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:20.324898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c333af1-6807-4cf0-ac41-c0a9f7ac5a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:20.325950 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c333af1-6807-4cf0-ac41-c0a9f7ac5a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:20.326305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c333af1-6807-4cf0-ac41-c0a9f7ac5a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:20.326651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c333af1-6807-4cf0-ac41-c0a9f7ac5a6a admin admin] PATH_INFO: `/v3/projects/9eaebcb99bef42b8879b7ce90ed83f6a/users/486181f3007246399e7d827bfde8f311/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:20.332856 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c333af1-6807-4cf0-ac41-c0a9f7ac5a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eaebcb99bef42b8879b7ce90ed83f6a, user_id=486181f3007246399e7d827bfde8f311, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:20.346673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c333af1-6807-4cf0-ac41-c0a9f7ac5a6a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:20.387613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1136/2283] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:41:20 2022] PUT /identity/v3/projects/9eaebcb99bef42b8879b7ce90ed83f6a/users/486181f3007246399e7d827bfde8f311/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:41:20.402810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34da541-6bec-4ddd-ac21-52d882c1e3da None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:20.403373 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34da541-6bec-4ddd-ac21-52d882c1e3da None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:20.404364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34da541-6bec-4ddd-ac21-52d882c1e3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:20.456479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c34da541-6bec-4ddd-ac21-52d882c1e3da None None] MFA Rules not processed for user `486181f3007246399e7d827bfde8f311`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:20.465069 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c34da541-6bec-4ddd-ac21-52d882c1e3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:20.648435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1148/2284] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:20.661446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c333af1-6807-4cf0-ac41-c0a9f7ac5a6a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:20.663213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7c333af1-6807-4cf0-ac41-c0a9f7ac5a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:20.763347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c333af1-6807-4cf0-ac41-c0a9f7ac5a6a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:20.767818 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50556ba0-365d-42f4-b24d-483894f19c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:20.768448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50556ba0-365d-42f4-b24d-483894f19c43 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:20.768653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50556ba0-365d-42f4-b24d-483894f19c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:20.768992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50556ba0-365d-42f4-b24d-483894f19c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:20.790798 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50556ba0-365d-42f4-b24d-483894f19c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:20.792393 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50556ba0-365d-42f4-b24d-483894f19c43 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:20.823355 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1137/2285] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:41:20.978949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34da541-6bec-4ddd-ac21-52d882c1e3da None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:20.995672 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34da541-6bec-4ddd-ac21-52d882c1e3da None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:20.999511 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6037b-5268-475a-991a-4203909eeb36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:21.000387 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6037b-5268-475a-991a-4203909eeb36 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:21.000677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6037b-5268-475a-991a-4203909eeb36 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:21.000972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6037b-5268-475a-991a-4203909eeb36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:21.072017 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6037b-5268-475a-991a-4203909eeb36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:21.074039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6037b-5268-475a-991a-4203909eeb36 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:21.086036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1149/2286] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:41:23.256706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075caf9b-73ea-4489-8a41-642b0d165952 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:23.257770 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075caf9b-73ea-4489-8a41-642b0d165952 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:23.258247 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075caf9b-73ea-4489-8a41-642b0d165952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:23.328782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-075caf9b-73ea-4489-8a41-642b0d165952 None None] MFA Rules not processed for user `7fe44104ac9f4b9bb50b18d3f12f477d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:23.334728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-075caf9b-73ea-4489-8a41-642b0d165952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:23.472330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1138/2287] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:25.032570 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6037b-5268-475a-991a-4203909eeb36 service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:25.131451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6037b-5268-475a-991a-4203909eeb36 service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:25.136397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:25.137266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:25.143502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:25.143782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] PATH_INFO: `/v3/users/0bb4358924634dbaa68c900f6a3023e1` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:25.146052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb4358924634dbaa68c900f6a3023e1)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:25.149162 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:25.356711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb4358924634dbaa68c900f6a3023e1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:25.357778 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb4358924634dbaa68c900f6a3023e1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:25.453149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb4358924634dbaa68c900f6a3023e1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:25.454880 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb4358924634dbaa68c900f6a3023e1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:25.469107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb4358924634dbaa68c900f6a3023e1'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:25.488790 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1150/2288] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:41:25 2022] DELETE /identity/v3/users/0bb4358924634dbaa68c900f6a3023e1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:25.490995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c85fe-072f-4f66-9c59-1f74e5c1241b None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:25.491888 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c85fe-072f-4f66-9c59-1f74e5c1241b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:25.492377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c85fe-072f-4f66-9c59-1f74e5c1241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:25.512594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-fc6c85fe-072f-4f66-9c59-1f74e5c1241b None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:25.514368 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-fc6c85fe-072f-4f66-9c59-1f74e5c1241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:25.620623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1139/2289] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:25.627133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:25.640797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:25.755267 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b230830-35c8-4665-b585-593b7abfdf91 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:25.760012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d194fd-dc0d-476b-b957-9bb693d98cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:25.760744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d194fd-dc0d-476b-b957-9bb693d98cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:25.761021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d194fd-dc0d-476b-b957-9bb693d98cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:25.761300 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d194fd-dc0d-476b-b957-9bb693d98cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:25.781758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d194fd-dc0d-476b-b957-9bb693d98cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:25.782898 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d194fd-dc0d-476b-b957-9bb693d98cb4 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:25.798179 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1151/2290] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:41:26.944853 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c85fe-072f-4f66-9c59-1f74e5c1241b None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:26.946883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-fc6c85fe-072f-4f66-9c59-1f74e5c1241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:26.979768 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c85fe-072f-4f66-9c59-1f74e5c1241b None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:26.991082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:26.991980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:26.992304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:26.992662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] PATH_INFO: `/v3/projects/46819bc1cbc34aeaaf5bd9144106c36e` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:26.993952 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=46819bc1cbc34aeaaf5bd9144106c36e)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:26.995881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:27.195252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46819bc1cbc34aeaaf5bd9144106c36e', 'request_id': 'req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:27.201210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46819bc1cbc34aeaaf5bd9144106c36e', 'request_id': 'req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:27.212414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46819bc1cbc34aeaaf5bd9144106c36e', 'request_id': 'req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:27.295606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] The token cache is being invalidate because project 46819bc1cbc34aeaaf5bd9144106c36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:41:27.295963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:27.297006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:27.303894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1140/2291] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:41:26 2022] DELETE /identity/v3/projects/46819bc1cbc34aeaaf5bd9144106c36e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:27.304039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d194fd-dc0d-476b-b957-9bb693d98cb4 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:27.316377 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d194fd-dc0d-476b-b957-9bb693d98cb4 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:27.402363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:27.403436 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:27.403736 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:27.404019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] PATH_INFO: `/v3/users/486181f3007246399e7d827bfde8f311` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:27.405899 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=486181f3007246399e7d827bfde8f311)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:27.409977 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:27.817752 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486181f3007246399e7d827bfde8f311'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:27.818411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486181f3007246399e7d827bfde8f311'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:27.930238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486181f3007246399e7d827bfde8f311'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:27.930238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486181f3007246399e7d827bfde8f311'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:27.943054 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486181f3007246399e7d827bfde8f311'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:27.955770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1152/2292] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:41:27 2022] DELETE /identity/v3/users/486181f3007246399e7d827bfde8f311 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:28.139265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:28.140739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:28.199632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c3b1-e7bb-4256-8f4e-220ef81cbf3f admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:28.249458 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfce58-88ac-42df-8697-8a9252e17bba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f9935443bcc4d34aeb56e5b77a96720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:28.250028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfce58-88ac-42df-8697-8a9252e17bba service glance] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:28.250317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfce58-88ac-42df-8697-8a9252e17bba service glance] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:28.250598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfce58-88ac-42df-8697-8a9252e17bba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:28.252707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-e4dfce58-88ac-42df-8697-8a9252e17bba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:28.317911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfce58-88ac-42df-8697-8a9252e17bba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:28.319408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfce58-88ac-42df-8697-8a9252e17bba service glance] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:28.332851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1141/2293] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:41:28.394954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:28.396891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:28.492443 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f234d8-1e2f-4074-a80d-005bc552acc9 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:28.501115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229245b8-820c-42ef-b4b0-16123f0243e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:28.501995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229245b8-820c-42ef-b4b0-16123f0243e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:28.502277 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229245b8-820c-42ef-b4b0-16123f0243e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:28.502553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229245b8-820c-42ef-b4b0-16123f0243e5 admin admin] PATH_INFO: `/v3/projects/9eaebcb99bef42b8879b7ce90ed83f6a` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:28.503743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229245b8-820c-42ef-b4b0-16123f0243e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eaebcb99bef42b8879b7ce90ed83f6a)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:28.506775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229245b8-820c-42ef-b4b0-16123f0243e5 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:28.607105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-229245b8-820c-42ef-b4b0-16123f0243e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eaebcb99bef42b8879b7ce90ed83f6a', 'request_id': 'req-229245b8-820c-42ef-b4b0-16123f0243e5'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:28.613058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-229245b8-820c-42ef-b4b0-16123f0243e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eaebcb99bef42b8879b7ce90ed83f6a', 'request_id': 'req-229245b8-820c-42ef-b4b0-16123f0243e5'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:28.630990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1f19-8878-4da0-88aa-59d31cc49175 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:28.631287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1f19-8878-4da0-88aa-59d31cc49175 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:28.631570 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac1f19-8878-4da0-88aa-59d31cc49175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:28.659468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-efac1f19-8878-4da0-88aa-59d31cc49175 None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:28.660775 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-efac1f19-8878-4da0-88aa-59d31cc49175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:28.666319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-229245b8-820c-42ef-b4b0-16123f0243e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eaebcb99bef42b8879b7ce90ed83f6a', 'request_id': 'req-229245b8-820c-42ef-b4b0-16123f0243e5'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:28.678606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-229245b8-820c-42ef-b4b0-16123f0243e5 admin admin] The token cache is being invalidate because project 9eaebcb99bef42b8879b7ce90ed83f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:41:28.678904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-229245b8-820c-42ef-b4b0-16123f0243e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:28.679630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-229245b8-820c-42ef-b4b0-16123f0243e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:28.681276 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1153/2294] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:41:28 2022] DELETE /identity/v3/projects/9eaebcb99bef42b8879b7ce90ed83f6a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:41:28.686796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43a72b-1693-4b7b-b774-51e0f6a4c8d2 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:28.687171 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43a72b-1693-4b7b-b774-51e0f6a4c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:28.687519 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43a72b-1693-4b7b-b774-51e0f6a4c8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:28.708838 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-8b43a72b-1693-4b7b-b774-51e0f6a4c8d2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:28.710058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8b43a72b-1693-4b7b-b774-51e0f6a4c8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:28.726724 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1142/2295] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:41:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:28.739433 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac1f19-8878-4da0-88aa-59d31cc49175 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:28.741108 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-efac1f19-8878-4da0-88aa-59d31cc49175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:28.772214 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1154/2296] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:41:28.780028 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96170-356e-47b8-a504-5e5fe975a0f1 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:28.780620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96170-356e-47b8-a504-5e5fe975a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:28.781039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a96170-356e-47b8-a504-5e5fe975a0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:28.800386 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-22a96170-356e-47b8-a504-5e5fe975a0f1 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:28.801770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-22a96170-356e-47b8-a504-5e5fe975a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:28.811182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1155/2297] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:41:28.821594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac1f19-8878-4da0-88aa-59d31cc49175 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:28.825367 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96170-356e-47b8-a504-5e5fe975a0f1 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:28.828195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e841612-4171-466e-9c45-190895a0b713 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:28.831712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e841612-4171-466e-9c45-190895a0b713 service swift] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:28.831712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e841612-4171-466e-9c45-190895a0b713 service swift] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:28.831712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e841612-4171-466e-9c45-190895a0b713 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:28.838680 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a96170-356e-47b8-a504-5e5fe975a0f1 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:28.839990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e841612-4171-466e-9c45-190895a0b713 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:28.841696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e841612-4171-466e-9c45-190895a0b713 service swift] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:28.843917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39b29d-42f8-4c12-a9a0-fe7fb987a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:28.844627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39b29d-42f8-4c12-a9a0-fe7fb987a97f admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:28.844906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39b29d-42f8-4c12-a9a0-fe7fb987a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:28.845192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39b29d-42f8-4c12-a9a0-fe7fb987a97f admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:28.845927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39b29d-42f8-4c12-a9a0-fe7fb987a97f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:41:28.846232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39b29d-42f8-4c12-a9a0-fe7fb987a97f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:28.847942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39b29d-42f8-4c12-a9a0-fe7fb987a97f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:28.850565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1143/2298] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:41:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 15:41:28.860360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1156/2299] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:41:28.877029 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e841612-4171-466e-9c45-190895a0b713 service swift] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:28.893557 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e841612-4171-466e-9c45-190895a0b713 service swift] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:28.898757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b16a6b-3e70-40c2-9f75-7d371387d9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:28.899136 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b16a6b-3e70-40c2-9f75-7d371387d9ad admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:28.899378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b16a6b-3e70-40c2-9f75-7d371387d9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:28.899661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b16a6b-3e70-40c2-9f75-7d371387d9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:28.900497 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b16a6b-3e70-40c2-9f75-7d371387d9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:28.902411 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b16a6b-3e70-40c2-9f75-7d371387d9ad admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:29.027615 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1144/2300] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:41:28 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:29.032518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39b29d-42f8-4c12-a9a0-fe7fb987a97f admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:29.042417 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39b29d-42f8-4c12-a9a0-fe7fb987a97f admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:29.138730 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d98b7-b730-4f3e-aea0-20b1e3bf1bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:29.139423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d98b7-b730-4f3e-aea0-20b1e3bf1bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:29.139711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d98b7-b730-4f3e-aea0-20b1e3bf1bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:29.140044 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d98b7-b730-4f3e-aea0-20b1e3bf1bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:29.140802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d98b7-b730-4f3e-aea0-20b1e3bf1bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:29.142727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d98b7-b730-4f3e-aea0-20b1e3bf1bc8 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:29.236117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1157/2301] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:41:29 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:41:29.237689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b16a6b-3e70-40c2-9f75-7d371387d9ad admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:29.257743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b16a6b-3e70-40c2-9f75-7d371387d9ad admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:29.263201 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c14c1-15af-456f-a9f4-44c832051fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:29.263983 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c14c1-15af-456f-a9f4-44c832051fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:29.264370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c14c1-15af-456f-a9f4-44c832051fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:29.264827 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c14c1-15af-456f-a9f4-44c832051fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:29.267403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c14c1-15af-456f-a9f4-44c832051fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:29.267741 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c14c1-15af-456f-a9f4-44c832051fcd admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:29.281850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1145/2302] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:29.284780 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d98b7-b730-4f3e-aea0-20b1e3bf1bc8 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:29.302445 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d98b7-b730-4f3e-aea0-20b1e3bf1bc8 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:29.309407 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b96a1-2c0d-4d1b-9427-d44d71f016d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:29.310093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b96a1-2c0d-4d1b-9427-d44d71f016d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:29.310375 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b96a1-2c0d-4d1b-9427-d44d71f016d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:29.310651 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b96a1-2c0d-4d1b-9427-d44d71f016d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:29.311388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b96a1-2c0d-4d1b-9427-d44d71f016d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:29.313035 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b96a1-2c0d-4d1b-9427-d44d71f016d6 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:29.327531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1158/2303] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:41:29.328820 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c14c1-15af-456f-a9f4-44c832051fcd admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:29.340458 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c14c1-15af-456f-a9f4-44c832051fcd admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:29.346047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f97fbf-2bcd-4bcf-b5f8-e265f79ddb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:29.346954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f97fbf-2bcd-4bcf-b5f8-e265f79ddb59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:29.347245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f97fbf-2bcd-4bcf-b5f8-e265f79ddb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:29.347524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f97fbf-2bcd-4bcf-b5f8-e265f79ddb59 admin admin] PATH_INFO: `/v3/projects/1895365d6bd54cd4a1f6b42954076ec3/users/11a7f76f2da54d4cabcd67f768028b9a/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:29.369249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f97fbf-2bcd-4bcf-b5f8-e265f79ddb59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1895365d6bd54cd4a1f6b42954076ec3, user_id=11a7f76f2da54d4cabcd67f768028b9a, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:29.372051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f97fbf-2bcd-4bcf-b5f8-e265f79ddb59 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:29.461540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1146/2304] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:41:29 2022] PUT /identity/v3/projects/1895365d6bd54cd4a1f6b42954076ec3/users/11a7f76f2da54d4cabcd67f768028b9a/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:29.473676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93e6f7-292c-46f9-b14a-955d304910f5 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:29.475942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93e6f7-292c-46f9-b14a-955d304910f5 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:29.475942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93e6f7-292c-46f9-b14a-955d304910f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:29.503591 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-8e93e6f7-292c-46f9-b14a-955d304910f5 None None] MFA Rules not processed for user `11a7f76f2da54d4cabcd67f768028b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:29.504833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-8e93e6f7-292c-46f9-b14a-955d304910f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:29.590291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1159/2305] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:41:29.595170 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f97fbf-2bcd-4bcf-b5f8-e265f79ddb59 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:29.682622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f97fbf-2bcd-4bcf-b5f8-e265f79ddb59 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:29.691502 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd88d5-fd4f-408d-9015-393bc87af81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:29.695575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd88d5-fd4f-408d-9015-393bc87af81a admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:29.695575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd88d5-fd4f-408d-9015-393bc87af81a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:29.695575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd88d5-fd4f-408d-9015-393bc87af81a admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:29.695575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd88d5-fd4f-408d-9015-393bc87af81a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:29.696892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd88d5-fd4f-408d-9015-393bc87af81a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:29.813310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1147/2306] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:41:29 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:41:29.825672 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93e6f7-292c-46f9-b14a-955d304910f5 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:29.849326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93e6f7-292c-46f9-b14a-955d304910f5 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:29.914380 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3d9be-a814-431d-95b8-6728890e7cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:29.915054 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3d9be-a814-431d-95b8-6728890e7cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:29.915339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3d9be-a814-431d-95b8-6728890e7cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:29.915612 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3d9be-a814-431d-95b8-6728890e7cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:29.916340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3d9be-a814-431d-95b8-6728890e7cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:29.918265 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3d9be-a814-431d-95b8-6728890e7cb2 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:30.022046 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1160/2307] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:41:29 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:30.025806 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd88d5-fd4f-408d-9015-393bc87af81a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:30.039845 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd88d5-fd4f-408d-9015-393bc87af81a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:30.044760 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d579e01-0287-4b05-9d0d-dc6b0d27fd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:30.047191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d579e01-0287-4b05-9d0d-dc6b0d27fd79 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:30.047362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d579e01-0287-4b05-9d0d-dc6b0d27fd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:30.047578 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d579e01-0287-4b05-9d0d-dc6b0d27fd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:30.048364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d579e01-0287-4b05-9d0d-dc6b0d27fd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:30.050059 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d579e01-0287-4b05-9d0d-dc6b0d27fd79 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:30.062735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1148/2308] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:30.066597 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3d9be-a814-431d-95b8-6728890e7cb2 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:30.080713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3d9be-a814-431d-95b8-6728890e7cb2 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:30.093929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baade372-8591-4a23-9b52-2337f7ef655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:30.094688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baade372-8591-4a23-9b52-2337f7ef655d admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:30.094981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baade372-8591-4a23-9b52-2337f7ef655d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:30.095261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baade372-8591-4a23-9b52-2337f7ef655d admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:30.096013 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baade372-8591-4a23-9b52-2337f7ef655d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:30.097674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baade372-8591-4a23-9b52-2337f7ef655d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:30.114736 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1161/2309] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:30.121104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d579e01-0287-4b05-9d0d-dc6b0d27fd79 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:30.136262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d579e01-0287-4b05-9d0d-dc6b0d27fd79 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:30.142262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e75c39-bf67-4bd9-9c8c-e093cf9deebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:30.143291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e75c39-bf67-4bd9-9c8c-e093cf9deebf admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:30.143680 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e75c39-bf67-4bd9-9c8c-e093cf9deebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:30.144062 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e75c39-bf67-4bd9-9c8c-e093cf9deebf admin admin] PATH_INFO: `/v3/projects/39cbaccddca64732aafd99f15715b0c3/users/52aafc100cf94459996cd0e561250fe0/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:30.161269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e75c39-bf67-4bd9-9c8c-e093cf9deebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=39cbaccddca64732aafd99f15715b0c3, user_id=52aafc100cf94459996cd0e561250fe0, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:30.175522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e75c39-bf67-4bd9-9c8c-e093cf9deebf admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:30.277539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72f4c8-b30d-4db4-a015-6c6fdb96fe44 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:30.278321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72f4c8-b30d-4db4-a015-6c6fdb96fe44 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:30.278672 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72f4c8-b30d-4db4-a015-6c6fdb96fe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:30.280267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1149/2310] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:41:30 2022] PUT /identity/v3/projects/39cbaccddca64732aafd99f15715b0c3/users/52aafc100cf94459996cd0e561250fe0/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:30.316825 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-7f72f4c8-b30d-4db4-a015-6c6fdb96fe44 None None] MFA Rules not processed for user `52aafc100cf94459996cd0e561250fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:30.318354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7f72f4c8-b30d-4db4-a015-6c6fdb96fe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:30.394333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1162/2311] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:30.398913 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e75c39-bf67-4bd9-9c8c-e093cf9deebf admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:30.479127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e75c39-bf67-4bd9-9c8c-e093cf9deebf admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:30.484673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e191b-b673-41bb-8b7b-80e07ff85106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:30.487764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e191b-b673-41bb-8b7b-80e07ff85106 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:30.487764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e191b-b673-41bb-8b7b-80e07ff85106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:30.487764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e191b-b673-41bb-8b7b-80e07ff85106 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:30.487764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e191b-b673-41bb-8b7b-80e07ff85106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:30.489064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e191b-b673-41bb-8b7b-80e07ff85106 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:30.573868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1150/2312] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:41:30 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:41:30.576346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72f4c8-b30d-4db4-a015-6c6fdb96fe44 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:30.587705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72f4c8-b30d-4db4-a015-6c6fdb96fe44 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:30.661949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bcf9e-fb94-41ae-93c1-afc65a84478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:30.662706 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bcf9e-fb94-41ae-93c1-afc65a84478e admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:30.663097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bcf9e-fb94-41ae-93c1-afc65a84478e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:30.663475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bcf9e-fb94-41ae-93c1-afc65a84478e admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:30.664330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bcf9e-fb94-41ae-93c1-afc65a84478e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:30.666951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bcf9e-fb94-41ae-93c1-afc65a84478e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:30.746137 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1163/2313] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:41:30 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:30.748549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e191b-b673-41bb-8b7b-80e07ff85106 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:30.764385 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e191b-b673-41bb-8b7b-80e07ff85106 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:30.769660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88385c18-6f9b-4fca-8d56-93f6f3ba3470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:30.770806 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88385c18-6f9b-4fca-8d56-93f6f3ba3470 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:30.771524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88385c18-6f9b-4fca-8d56-93f6f3ba3470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:30.771524 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88385c18-6f9b-4fca-8d56-93f6f3ba3470 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:30.772451 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88385c18-6f9b-4fca-8d56-93f6f3ba3470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:30.774225 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88385c18-6f9b-4fca-8d56-93f6f3ba3470 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:30.789795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1151/2314] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:41:30.795289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bcf9e-fb94-41ae-93c1-afc65a84478e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:30.810236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bcf9e-fb94-41ae-93c1-afc65a84478e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:30.819986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8434d-d540-40ff-a501-71883b69a8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:30.820941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8434d-d540-40ff-a501-71883b69a8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:30.821222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8434d-d540-40ff-a501-71883b69a8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:30.822093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8434d-d540-40ff-a501-71883b69a8d3 admin admin] PATH_INFO: `/v3/projects/da9edfd0be7040c0995c0211be7e7a23/users/95407d5902f841d49efe3352d2d96106/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:30.842054 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8434d-d540-40ff-a501-71883b69a8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9edfd0be7040c0995c0211be7e7a23, user_id=95407d5902f841d49efe3352d2d96106, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:30.847961 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8434d-d540-40ff-a501-71883b69a8d3 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:30.916953 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1164/2315] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:41:30 2022] PUT /identity/v3/projects/da9edfd0be7040c0995c0211be7e7a23/users/95407d5902f841d49efe3352d2d96106/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:41:30.918312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88385c18-6f9b-4fca-8d56-93f6f3ba3470 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:30.930447 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88385c18-6f9b-4fca-8d56-93f6f3ba3470 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:31.032837 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd9bb7-e268-42d7-8616-ffb910c991b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:31.033658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd9bb7-e268-42d7-8616-ffb910c991b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:31.034044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd9bb7-e268-42d7-8616-ffb910c991b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:31.034425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd9bb7-e268-42d7-8616-ffb910c991b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:31.035258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd9bb7-e268-42d7-8616-ffb910c991b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:31.037255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd9bb7-e268-42d7-8616-ffb910c991b4 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:31.056574 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1152/2316] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:31.057815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8434d-d540-40ff-a501-71883b69a8d3 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:31.069720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8434d-d540-40ff-a501-71883b69a8d3 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:31.074494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23002da-670b-42d8-b0f9-c5714a63dd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:31.075509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23002da-670b-42d8-b0f9-c5714a63dd83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:31.075855 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23002da-670b-42d8-b0f9-c5714a63dd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:31.076247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23002da-670b-42d8-b0f9-c5714a63dd83 admin admin] PATH_INFO: `/v3/projects/da9edfd0be7040c0995c0211be7e7a23/users/95407d5902f841d49efe3352d2d96106/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:31.078445 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23002da-670b-42d8-b0f9-c5714a63dd83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9edfd0be7040c0995c0211be7e7a23, user_id=95407d5902f841d49efe3352d2d96106, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:31.081385 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23002da-670b-42d8-b0f9-c5714a63dd83 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:31.104019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1165/2317] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:41:31 2022] PUT /identity/v3/projects/da9edfd0be7040c0995c0211be7e7a23/users/95407d5902f841d49efe3352d2d96106/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:31.114813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86589747-c1ff-4f16-84d8-dd9c3f485b3f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:31.115106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86589747-c1ff-4f16-84d8-dd9c3f485b3f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:31.115389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86589747-c1ff-4f16-84d8-dd9c3f485b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:31.153780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-86589747-c1ff-4f16-84d8-dd9c3f485b3f None None] MFA Rules not processed for user `95407d5902f841d49efe3352d2d96106`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:31.155227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-86589747-c1ff-4f16-84d8-dd9c3f485b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:31.261485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1153/2318] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:31.275423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23002da-670b-42d8-b0f9-c5714a63dd83 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:31.277513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f23002da-670b-42d8-b0f9-c5714a63dd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:31.381455 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23002da-670b-42d8-b0f9-c5714a63dd83 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:31.386454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94036439-6589-4f51-900a-11d675be1bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:31.387633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036439-6589-4f51-900a-11d675be1bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:31.388130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036439-6589-4f51-900a-11d675be1bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:31.388903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94036439-6589-4f51-900a-11d675be1bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:31.464258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94036439-6589-4f51-900a-11d675be1bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:31.466200 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94036439-6589-4f51-900a-11d675be1bb9 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:31.477780 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1166/2319] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:41:34.429602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86589747-c1ff-4f16-84d8-dd9c3f485b3f None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:34.442476 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86589747-c1ff-4f16-84d8-dd9c3f485b3f None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:34.448887 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad816ce-ce4c-44a8-99d0-d138f0a89feb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:34.450229 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad816ce-ce4c-44a8-99d0-d138f0a89feb service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:34.450779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad816ce-ce4c-44a8-99d0-d138f0a89feb service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:34.451103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad816ce-ce4c-44a8-99d0-d138f0a89feb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:34.511513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad816ce-ce4c-44a8-99d0-d138f0a89feb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:34.513213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad816ce-ce4c-44a8-99d0-d138f0a89feb service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:34.535220 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1154/2320] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:41:36.819104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94036439-6589-4f51-900a-11d675be1bb9 service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:36.828390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94036439-6589-4f51-900a-11d675be1bb9 service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:36.833193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667c153-5661-4e51-8440-77e94efe126a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:36.833917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667c153-5661-4e51-8440-77e94efe126a service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:36.834266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667c153-5661-4e51-8440-77e94efe126a service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:36.834618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667c153-5661-4e51-8440-77e94efe126a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:36.846653 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667c153-5661-4e51-8440-77e94efe126a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:36.848304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667c153-5661-4e51-8440-77e94efe126a service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:36.860631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1167/2321] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:41:40.315828 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b17625-6cc5-4456-9471-27d52ce1fe4a None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:40.322249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b17625-6cc5-4456-9471-27d52ce1fe4a None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:40.322249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b17625-6cc5-4456-9471-27d52ce1fe4a None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:40.322249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1155/2322] 10.222.0.25 () {54 vars in 921 bytes} [Tue Mar 8 15:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:41:40.323988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609bd3-ecb3-4f0c-94ed-816e1fa30d62 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:40.324479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609bd3-ecb3-4f0c-94ed-816e1fa30d62 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:40.324577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609bd3-ecb3-4f0c-94ed-816e1fa30d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:40.374440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-50609bd3-ecb3-4f0c-94ed-816e1fa30d62 None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:40.375325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-50609bd3-ecb3-4f0c-94ed-816e1fa30d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:40.450069 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1168/2323] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Mar 8 15:41:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:40.462491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b17625-6cc5-4456-9471-27d52ce1fe4a None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:40.464126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-66b17625-6cc5-4456-9471-27d52ce1fe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:40.522004 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b17625-6cc5-4456-9471-27d52ce1fe4a None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:40.525800 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2552c-31d6-468e-bb44-b714079b7b1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f9935443bcc4d34aeb56e5b77a96720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:40.526469 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2552c-31d6-468e-bb44-b714079b7b1b service glance] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:40.526749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2552c-31d6-468e-bb44-b714079b7b1b service glance] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:40.527022 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2552c-31d6-468e-bb44-b714079b7b1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:40.541260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2552c-31d6-468e-bb44-b714079b7b1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:40.542710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2552c-31d6-468e-bb44-b714079b7b1b service glance] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:40.554582 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1156/2324] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:41:40.839350 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e5f90-807d-4a7c-8ec9-c99fb286ca9f None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:40.839645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e5f90-807d-4a7c-8ec9-c99fb286ca9f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:40.845952 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e5f90-807d-4a7c-8ec9-c99fb286ca9f None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:40.845952 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1169/2325] 10.222.0.25 () {54 vars in 921 bytes} [Tue Mar 8 15:41:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:41:40.848254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414009c-9814-4f7f-8376-3a406bea9dae None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:40.848546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414009c-9814-4f7f-8376-3a406bea9dae None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:40.848829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414009c-9814-4f7f-8376-3a406bea9dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:40.866883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-d414009c-9814-4f7f-8376-3a406bea9dae None None] MFA Rules not processed for user `028d499ea279442d822c6723c367f459`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:40.868109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d414009c-9814-4f7f-8376-3a406bea9dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:40.916897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1157/2326] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Mar 8 15:41:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:40.931072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e5f90-807d-4a7c-8ec9-c99fb286ca9f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:40.931977 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-185e5f90-807d-4a7c-8ec9-c99fb286ca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:40.945179 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e5f90-807d-4a7c-8ec9-c99fb286ca9f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:40.948837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d8ffe-3e8a-4c1b-a9a4-0577472d8785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:40.949540 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d8ffe-3e8a-4c1b-a9a4-0577472d8785 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:40.949907 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d8ffe-3e8a-4c1b-a9a4-0577472d8785 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:40.950437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d8ffe-3e8a-4c1b-a9a4-0577472d8785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:40.966873 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d8ffe-3e8a-4c1b-a9a4-0577472d8785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:40.966873 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d8ffe-3e8a-4c1b-a9a4-0577472d8785 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:40.967793 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1170/2327] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:41:41.037669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67963b5-968f-46f9-8e2a-cde28e68c0be None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:41.038927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67963b5-968f-46f9-8e2a-cde28e68c0be None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:41.038927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67963b5-968f-46f9-8e2a-cde28e68c0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:41.062133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-f67963b5-968f-46f9-8e2a-cde28e68c0be None None] MFA Rules not processed for user `8c2c1098e3254bc492cf24761a664a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:41.062133 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f67963b5-968f-46f9-8e2a-cde28e68c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:41.067720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7e9c0-7616-4cdd-b739-be08b8f1d609 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:41.068019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7e9c0-7616-4cdd-b739-be08b8f1d609 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:41.068328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7e9c0-7616-4cdd-b739-be08b8f1d609 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:41.070086 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1171/2328] 10.222.0.25 () {54 vars in 921 bytes} [Tue Mar 8 15:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:41:41.075060 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935b79b-e515-428f-b7d7-c54d6124ea11 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:41.075353 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935b79b-e515-428f-b7d7-c54d6124ea11 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:41.076208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935b79b-e515-428f-b7d7-c54d6124ea11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:41.104337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f935b79b-e515-428f-b7d7-c54d6124ea11 None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:41.105823 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f935b79b-e515-428f-b7d7-c54d6124ea11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:41.120962 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1172/2329] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Mar 8 15:41:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:41:41.132616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935b79b-e515-428f-b7d7-c54d6124ea11 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:41.134989 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1158/2330] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:41.142874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935b79b-e515-428f-b7d7-c54d6124ea11 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:41.147617 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc7241-0a3d-43ad-8b7a-739781ecc262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:41.148328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc7241-0a3d-43ad-8b7a-739781ecc262 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:41.148616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc7241-0a3d-43ad-8b7a-739781ecc262 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:41.148898 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc7241-0a3d-43ad-8b7a-739781ecc262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:41.160798 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc7241-0a3d-43ad-8b7a-739781ecc262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:41.165407 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc7241-0a3d-43ad-8b7a-739781ecc262 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:41.174275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1173/2331] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:41:42.928087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67963b5-968f-46f9-8e2a-cde28e68c0be None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:42.988810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67963b5-968f-46f9-8e2a-cde28e68c0be None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:42.993279 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:42.994131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:42.994415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:42.994689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] PATH_INFO: `/v3/users/11a7f76f2da54d4cabcd67f768028b9a` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:42.995870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a7f76f2da54d4cabcd67f768028b9a)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:42.997859 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:43.245058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a7f76f2da54d4cabcd67f768028b9a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:43.341062 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a7f76f2da54d4cabcd67f768028b9a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:43.355087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a7f76f2da54d4cabcd67f768028b9a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:43.356103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a7f76f2da54d4cabcd67f768028b9a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:43.363244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a7f76f2da54d4cabcd67f768028b9a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:43.369340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1159/2332] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:41:42 2022] DELETE /identity/v3/users/11a7f76f2da54d4cabcd67f768028b9a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:43.374306 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d20e7-ce75-4469-b94e-5edeb61cef50 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:43.374786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d20e7-ce75-4469-b94e-5edeb61cef50 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:43.377018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d20e7-ce75-4469-b94e-5edeb61cef50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:43.393022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-360d20e7-ce75-4469-b94e-5edeb61cef50 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:43.394231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-360d20e7-ce75-4469-b94e-5edeb61cef50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:43.454609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1174/2333] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:41:43.463868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:43.465372 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:43.522393 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e2774-a731-406a-ab6a-fc3d0f382a99 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:43.526167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218ec7-f2f7-4392-a579-8caf7023b98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:43.526813 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218ec7-f2f7-4392-a579-8caf7023b98c service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:43.527100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218ec7-f2f7-4392-a579-8caf7023b98c service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:43.527378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218ec7-f2f7-4392-a579-8caf7023b98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:43.536663 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0218ec7-f2f7-4392-a579-8caf7023b98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:43.538100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0218ec7-f2f7-4392-a579-8caf7023b98c service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:43.547734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1160/2334] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:41:44.267744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d20e7-ce75-4469-b94e-5edeb61cef50 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:44.269402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-360d20e7-ce75-4469-b94e-5edeb61cef50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:44.284644 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d20e7-ce75-4469-b94e-5edeb61cef50 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:44.292057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:44.292057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:44.292057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:44.292057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] PATH_INFO: `/v3/projects/1895365d6bd54cd4a1f6b42954076ec3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:44.293030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1895365d6bd54cd4a1f6b42954076ec3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:44.295189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:44.414301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1895365d6bd54cd4a1f6b42954076ec3', 'request_id': 'req-b5c1b259-9454-411c-9b63-7176ef22a0bf'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:44.419559 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1895365d6bd54cd4a1f6b42954076ec3', 'request_id': 'req-b5c1b259-9454-411c-9b63-7176ef22a0bf'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:44.523276 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1895365d6bd54cd4a1f6b42954076ec3', 'request_id': 'req-b5c1b259-9454-411c-9b63-7176ef22a0bf'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:44.535499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] The token cache is being invalidate because project 1895365d6bd54cd4a1f6b42954076ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:41:44.545678 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:44.545678 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:44.545678 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1175/2335] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:41:44 2022] DELETE /identity/v3/projects/1895365d6bd54cd4a1f6b42954076ec3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:44.546183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218ec7-f2f7-4392-a579-8caf7023b98c service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:44.551769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218ec7-f2f7-4392-a579-8caf7023b98c service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:44.615364 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:44.616261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:44.616548 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:44.616826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] PATH_INFO: `/v3/users/52aafc100cf94459996cd0e561250fe0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:44.618010 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52aafc100cf94459996cd0e561250fe0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:44.619979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:44.867587 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52aafc100cf94459996cd0e561250fe0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:44.980273 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52aafc100cf94459996cd0e561250fe0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:44.992796 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52aafc100cf94459996cd0e561250fe0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:44.993434 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52aafc100cf94459996cd0e561250fe0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:45.000475 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52aafc100cf94459996cd0e561250fe0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:45.006144 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1161/2336] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:41:44 2022] DELETE /identity/v3/users/52aafc100cf94459996cd0e561250fe0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:45.512707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:45.514241 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:45.526837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1b259-9454-411c-9b63-7176ef22a0bf admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:45.581483 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:45.582332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:45.582607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:45.582928 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] PATH_INFO: `/v3/projects/39cbaccddca64732aafd99f15715b0c3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:45.584096 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] RBAC: Authorizing `identity:delete_project(project_id=39cbaccddca64732aafd99f15715b0c3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:45.586030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:45.694666 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39cbaccddca64732aafd99f15715b0c3', 'request_id': 'req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:45.700160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39cbaccddca64732aafd99f15715b0c3', 'request_id': 'req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:45.797622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39cbaccddca64732aafd99f15715b0c3', 'request_id': 'req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:45.809332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] The token cache is being invalidate because project 39cbaccddca64732aafd99f15715b0c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:41:45.809620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:45.810244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:45.811859 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1176/2337] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:41:45 2022] DELETE /identity/v3/projects/39cbaccddca64732aafd99f15715b0c3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:45.815830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:45.817302 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:45.830184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113dffc-d238-445f-9cef-db829ed6b727 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:45.883412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4c4ee-d149-4ddc-ad2b-51e364c8335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:45.884290 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4c4ee-d149-4ddc-ad2b-51e364c8335a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:45.884574 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4c4ee-d149-4ddc-ad2b-51e364c8335a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:45.884848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4c4ee-d149-4ddc-ad2b-51e364c8335a admin admin] PATH_INFO: `/v3/users/95407d5902f841d49efe3352d2d96106` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:45.886014 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4c4ee-d149-4ddc-ad2b-51e364c8335a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95407d5902f841d49efe3352d2d96106)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:45.887922 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4c4ee-d149-4ddc-ad2b-51e364c8335a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:46.156230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-bae4c4ee-d149-4ddc-ad2b-51e364c8335a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95407d5902f841d49efe3352d2d96106'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:46.237446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-bae4c4ee-d149-4ddc-ad2b-51e364c8335a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95407d5902f841d49efe3352d2d96106'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:46.251362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-bae4c4ee-d149-4ddc-ad2b-51e364c8335a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95407d5902f841d49efe3352d2d96106'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:46.252044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-bae4c4ee-d149-4ddc-ad2b-51e364c8335a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95407d5902f841d49efe3352d2d96106'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:46.258758 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-bae4c4ee-d149-4ddc-ad2b-51e364c8335a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95407d5902f841d49efe3352d2d96106'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:46.265116 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1162/2338] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:41:45 2022] DELETE /identity/v3/users/95407d5902f841d49efe3352d2d96106 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:46.957111 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:46.959707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:46.973833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fbfb0-35aa-4f4a-9b00-fad6a78b009a admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:47.040435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:47.041560 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:47.042040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:47.042534 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c admin admin] PATH_INFO: `/v3/projects/da9edfd0be7040c0995c0211be7e7a23` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:47.044260 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9edfd0be7040c0995c0211be7e7a23)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:47.048072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:47.189278 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9edfd0be7040c0995c0211be7e7a23', 'request_id': 'req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:47.195529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9edfd0be7040c0995c0211be7e7a23', 'request_id': 'req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:47.317462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9edfd0be7040c0995c0211be7e7a23', 'request_id': 'req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:47.331938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c admin admin] The token cache is being invalidate because project da9edfd0be7040c0995c0211be7e7a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:41:47.332259 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:47.332917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0acac1d1-e0ad-4860-a46b-8f288f7bc41c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:47.334486 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1177/2339] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:41:46 2022] DELETE /identity/v3/projects/da9edfd0be7040c0995c0211be7e7a23 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:47.339567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66e1d-9061-4ec9-81d1-b83e8ab5d8e2 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:47.340093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66e1d-9061-4ec9-81d1-b83e8ab5d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:47.340227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66e1d-9061-4ec9-81d1-b83e8ab5d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:47.359447 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-5af66e1d-9061-4ec9-81d1-b83e8ab5d8e2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:47.362472 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-5af66e1d-9061-4ec9-81d1-b83e8ab5d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:47.424202 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1163/2340] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:47.429980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93e68-401b-43ba-a50e-476096601552 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:47.430357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93e68-401b-43ba-a50e-476096601552 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:47.430582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93e68-401b-43ba-a50e-476096601552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:47.450904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-61e93e68-401b-43ba-a50e-476096601552 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:47.452739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-61e93e68-401b-43ba-a50e-476096601552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:47.470052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1178/2341] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:41:47.470487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af66e1d-9061-4ec9-81d1-b83e8ab5d8e2 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:47.482027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af66e1d-9061-4ec9-81d1-b83e8ab5d8e2 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:47.498348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e156263-28b3-4548-8ea4-2f785076c674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:47.498348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e156263-28b3-4548-8ea4-2f785076c674 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:47.498348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e156263-28b3-4548-8ea4-2f785076c674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:47.498348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e156263-28b3-4548-8ea4-2f785076c674 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:47.499125 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e156263-28b3-4548-8ea4-2f785076c674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:41:47.499436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e156263-28b3-4548-8ea4-2f785076c674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:47.501086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e156263-28b3-4548-8ea4-2f785076c674 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:47.513552 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1164/2342] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:41:47.526366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e93e68-401b-43ba-a50e-476096601552 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:47.528087 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e93e68-401b-43ba-a50e-476096601552 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:47.535421 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a2b27-e5d1-4cee-9eee-baf03962d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:47.536541 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a2b27-e5d1-4cee-9eee-baf03962d1ab admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:47.537019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a2b27-e5d1-4cee-9eee-baf03962d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:47.537390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a2b27-e5d1-4cee-9eee-baf03962d1ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:47.538180 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a2b27-e5d1-4cee-9eee-baf03962d1ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:47.540380 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a2b27-e5d1-4cee-9eee-baf03962d1ab admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:47.614333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac6b04-ca54-4fee-b4ab-119a2c49ba1b None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:47.614699 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac6b04-ca54-4fee-b4ab-119a2c49ba1b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:47.615044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac6b04-ca54-4fee-b4ab-119a2c49ba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:47.636619 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-dbac6b04-ca54-4fee-b4ab-119a2c49ba1b None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:47.638065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-dbac6b04-ca54-4fee-b4ab-119a2c49ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:47.659065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1179/2343] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:41:47 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:41:47.663185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a2b27-e5d1-4cee-9eee-baf03962d1ab admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:47.701926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1165/2344] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:41:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:41:47.718216 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac6b04-ca54-4fee-b4ab-119a2c49ba1b None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:47.720777 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-dbac6b04-ca54-4fee-b4ab-119a2c49ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:47.744652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a2b27-e5d1-4cee-9eee-baf03962d1ab admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:47.749893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3c26e-3d66-484d-b3bb-d978f913cbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:47.751030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3c26e-3d66-484d-b3bb-d978f913cbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:47.751030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3c26e-3d66-484d-b3bb-d978f913cbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:47.751230 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3c26e-3d66-484d-b3bb-d978f913cbf2 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:47.751807 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3c26e-3d66-484d-b3bb-d978f913cbf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:47.754647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3c26e-3d66-484d-b3bb-d978f913cbf2 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:47.795063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac6b04-ca54-4fee-b4ab-119a2c49ba1b None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:47.859202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1180/2345] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:41:47 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:41:47.859451 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1e785-03a7-42f1-b966-1d65865b4dbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:47.860116 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1e785-03a7-42f1-b966-1d65865b4dbb service swift] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:47.860426 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1e785-03a7-42f1-b966-1d65865b4dbb service swift] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:47.860715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1e785-03a7-42f1-b966-1d65865b4dbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:47.861504 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecb70c-860d-4b9e-8eba-4155dcbd3920 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:47.862039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecb70c-860d-4b9e-8eba-4155dcbd3920 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:47.862467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecb70c-860d-4b9e-8eba-4155dcbd3920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:47.881754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-68ecb70c-860d-4b9e-8eba-4155dcbd3920 None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:47.883011 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-68ecb70c-860d-4b9e-8eba-4155dcbd3920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:47.926200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1e785-03a7-42f1-b966-1d65865b4dbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:47.928682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1e785-03a7-42f1-b966-1d65865b4dbb service swift] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:47.940588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1166/2346] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:41:47.945756 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1e785-03a7-42f1-b966-1d65865b4dbb service swift] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:47.966784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1181/2347] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:41:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:47.967409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1e785-03a7-42f1-b966-1d65865b4dbb service swift] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:47.972615 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa5dcc-8aed-4d4a-a035-24422a7986c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:47.972993 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa5dcc-8aed-4d4a-a035-24422a7986c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:47.973262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa5dcc-8aed-4d4a-a035-24422a7986c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:47.974277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa5dcc-8aed-4d4a-a035-24422a7986c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:47.974407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa5dcc-8aed-4d4a-a035-24422a7986c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:47.975919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa5dcc-8aed-4d4a-a035-24422a7986c2 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:47.990440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecb70c-860d-4b9e-8eba-4155dcbd3920 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:48.002673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1167/2348] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:48.003839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa5dcc-8aed-4d4a-a035-24422a7986c2 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:48.007234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecb70c-860d-4b9e-8eba-4155dcbd3920 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:48.016232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd4071-d9a7-4a89-a28b-006efcaabcb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:48.016912 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd4071-d9a7-4a89-a28b-006efcaabcb0 service swift] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:48.017026 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa5dcc-8aed-4d4a-a035-24422a7986c2 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:48.017197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd4071-d9a7-4a89-a28b-006efcaabcb0 service swift] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:48.017676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd4071-d9a7-4a89-a28b-006efcaabcb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:48.034343 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc59da-71ab-4893-9b64-dfe61433265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:48.036090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc59da-71ab-4893-9b64-dfe61433265e admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:48.036597 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc59da-71ab-4893-9b64-dfe61433265e admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:48.036883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc59da-71ab-4893-9b64-dfe61433265e admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:48.037640 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc59da-71ab-4893-9b64-dfe61433265e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:48.039333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc59da-71ab-4893-9b64-dfe61433265e admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:48.044305 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd4071-d9a7-4a89-a28b-006efcaabcb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:48.045951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd4071-d9a7-4a89-a28b-006efcaabcb0 service swift] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:48.053689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1168/2349] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:41:48.058086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc59da-71ab-4893-9b64-dfe61433265e admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:48.063269 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1182/2350] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 15:41:48.083330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc59da-71ab-4893-9b64-dfe61433265e admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:48.090726 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e34b01-4543-495c-b8bf-08f248ec67a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:48.093561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e34b01-4543-495c-b8bf-08f248ec67a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:48.094827 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e34b01-4543-495c-b8bf-08f248ec67a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:48.094827 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e34b01-4543-495c-b8bf-08f248ec67a8 admin admin] PATH_INFO: `/v3/projects/717041695c614e95a3c317126f56fdd5/users/c49394ec65c44a8bbd5727141710e510/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:48.149898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e34b01-4543-495c-b8bf-08f248ec67a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717041695c614e95a3c317126f56fdd5, user_id=c49394ec65c44a8bbd5727141710e510, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:48.152701 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e34b01-4543-495c-b8bf-08f248ec67a8 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:48.323620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1169/2351] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:41:48 2022] PUT /identity/v3/projects/717041695c614e95a3c317126f56fdd5/users/c49394ec65c44a8bbd5727141710e510/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:48.325235 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cc0fd-d604-4d5b-b4bc-95f603e7637c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:48.325532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cc0fd-d604-4d5b-b4bc-95f603e7637c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:48.325818 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cc0fd-d604-4d5b-b4bc-95f603e7637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:48.388658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-d47cc0fd-d604-4d5b-b4bc-95f603e7637c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:48.393601 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d47cc0fd-d604-4d5b-b4bc-95f603e7637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:48.512026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1183/2352] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:48.536961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e34b01-4543-495c-b8bf-08f248ec67a8 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:48.539395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-16e34b01-4543-495c-b8bf-08f248ec67a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:48.729331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e34b01-4543-495c-b8bf-08f248ec67a8 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:48.743805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704c407-327e-4bd4-9379-e6765f088044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:48.744598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704c407-327e-4bd4-9379-e6765f088044 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:48.744894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704c407-327e-4bd4-9379-e6765f088044 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:48.745173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704c407-327e-4bd4-9379-e6765f088044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:48.768569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704c407-327e-4bd4-9379-e6765f088044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:48.774979 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704c407-327e-4bd4-9379-e6765f088044 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:48.810132 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1170/2353] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:41:52.027735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb9e4-a7f2-4cdd-825b-13fafd5bdf05 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:52.028383 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb9e4-a7f2-4cdd-825b-13fafd5bdf05 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:52.028475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb9e4-a7f2-4cdd-825b-13fafd5bdf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:52.087408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-541bb9e4-a7f2-4cdd-825b-13fafd5bdf05 None None] MFA Rules not processed for user `c49394ec65c44a8bbd5727141710e510`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:52.089602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-541bb9e4-a7f2-4cdd-825b-13fafd5bdf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:52.180674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1184/2354] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:41:52.197988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704c407-327e-4bd4-9379-e6765f088044 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:52.199513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c704c407-327e-4bd4-9379-e6765f088044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:52.284097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704c407-327e-4bd4-9379-e6765f088044 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:52.287961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d5ba2-da6c-47a9-aaaf-fa5456dd5676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:52.288961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d5ba2-da6c-47a9-aaaf-fa5456dd5676 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:52.289330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d5ba2-da6c-47a9-aaaf-fa5456dd5676 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:52.289901 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d5ba2-da6c-47a9-aaaf-fa5456dd5676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:52.299562 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d5ba2-da6c-47a9-aaaf-fa5456dd5676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:52.305251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d5ba2-da6c-47a9-aaaf-fa5456dd5676 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:52.310663 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1171/2355] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:41:53.327724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bb9e4-a7f2-4cdd-825b-13fafd5bdf05 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:53.329209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-541bb9e4-a7f2-4cdd-825b-13fafd5bdf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:53.342400 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bb9e4-a7f2-4cdd-825b-13fafd5bdf05 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:53.347232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:53.353040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:53.353040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:53.353040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] PATH_INFO: `/v3/users/0926d1e73af84cd99e7a8f2e2a1c454b` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:53.353040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0926d1e73af84cd99e7a8f2e2a1c454b)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:53.353040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:54.188416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0926d1e73af84cd99e7a8f2e2a1c454b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:54.189079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0926d1e73af84cd99e7a8f2e2a1c454b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:54.282885 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0926d1e73af84cd99e7a8f2e2a1c454b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:54.283429 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0926d1e73af84cd99e7a8f2e2a1c454b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:54.296494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0926d1e73af84cd99e7a8f2e2a1c454b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:54.309474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1185/2356] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:41:53 2022] DELETE /identity/v3/users/0926d1e73af84cd99e7a8f2e2a1c454b => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:41:54.314381 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b5dfb-cb14-41dd-abd7-898cd5a1d61a None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:54.315294 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b5dfb-cb14-41dd-abd7-898cd5a1d61a None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:54.315759 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b5dfb-cb14-41dd-abd7-898cd5a1d61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:54.335016 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-d80b5dfb-cb14-41dd-abd7-898cd5a1d61a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:54.336297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d80b5dfb-cb14-41dd-abd7-898cd5a1d61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:54.412360 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1172/2357] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:54.421125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:54.422660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:54.497590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c91eeb-f5ff-4fd1-a792-7a49a395a0c1 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:54.503290 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be486fc-2638-4a48-9e7f-42015d71e2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:54.504339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be486fc-2638-4a48-9e7f-42015d71e2bb service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:54.508629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be486fc-2638-4a48-9e7f-42015d71e2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:54.509236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be486fc-2638-4a48-9e7f-42015d71e2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:54.521539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be486fc-2638-4a48-9e7f-42015d71e2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:54.533782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be486fc-2638-4a48-9e7f-42015d71e2bb service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:54.546071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1186/2358] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:41:55.183465 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad646d55-e705-4a54-b79e-be4d5ee66d94 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:55.183761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad646d55-e705-4a54-b79e-be4d5ee66d94 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:55.184044 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad646d55-e705-4a54-b79e-be4d5ee66d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:55.211273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be486fc-2638-4a48-9e7f-42015d71e2bb service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:41:55.212820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5be486fc-2638-4a48-9e7f-42015d71e2bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:55.236635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ad646d55-e705-4a54-b79e-be4d5ee66d94 None None] MFA Rules not processed for user `c49394ec65c44a8bbd5727141710e510`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:41:55.238210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ad646d55-e705-4a54-b79e-be4d5ee66d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:41:55.249094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be486fc-2638-4a48-9e7f-42015d71e2bb service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:41:55.265337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:41:55.266333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:41:55.266687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:41:55.267052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] PATH_INFO: `/v3/projects/7884dfbd2d0342c7bb160bf352044b87` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:41:55.268394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7884dfbd2d0342c7bb160bf352044b87)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:41:55.270472 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:41:55.318496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1173/2359] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:41:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:41:55.398575 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7884dfbd2d0342c7bb160bf352044b87', 'request_id': 'req-d093a720-6736-4473-868a-edf4cd216d71'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:55.405045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7884dfbd2d0342c7bb160bf352044b87', 'request_id': 'req-d093a720-6736-4473-868a-edf4cd216d71'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:55.506150 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7884dfbd2d0342c7bb160bf352044b87', 'request_id': 'req-d093a720-6736-4473-868a-edf4cd216d71'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:55.518696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] The token cache is being invalidate because project 7884dfbd2d0342c7bb160bf352044b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:41:55.518989 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:55.519637 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:41:55.521247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1187/2360] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:41:55 2022] DELETE /identity/v3/projects/7884dfbd2d0342c7bb160bf352044b87 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:42:07.649897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad646d55-e705-4a54-b79e-be4d5ee66d94 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:42:07.651857 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ad646d55-e705-4a54-b79e-be4d5ee66d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:42:07.751710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad646d55-e705-4a54-b79e-be4d5ee66d94 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:42:07.811900 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1d2e3-e227-46c1-b0b0-dc4567915230 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13471dce9430484ab46b355d1303f504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:42:07.812614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d2e3-e227-46c1-b0b0-dc4567915230 service placement] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:42:07.812900 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d2e3-e227-46c1-b0b0-dc4567915230 service placement] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:42:07.813179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d2e3-e227-46c1-b0b0-dc4567915230 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:42:07.815105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-bba1d2e3-e227-46c1-b0b0-dc4567915230 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:42:07.826144 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:42:07.827259 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1d2e3-e227-46c1-b0b0-dc4567915230 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:42:07.827729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:42:07.829453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1d2e3-e227-46c1-b0b0-dc4567915230 service placement] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:42:07.840400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1174/2361] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:42:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:42:07.843139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093a720-6736-4473-868a-edf4cd216d71 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:42:07.849869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941f96-ec3c-47a3-a3a7-628011538351 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13471dce9430484ab46b355d1303f504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:42:07.850529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941f96-ec3c-47a3-a3a7-628011538351 service placement] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:42:07.850818 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941f96-ec3c-47a3-a3a7-628011538351 service placement] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:42:07.851101 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941f96-ec3c-47a3-a3a7-628011538351 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:42:07.861303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941f96-ec3c-47a3-a3a7-628011538351 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:42:07.862940 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941f96-ec3c-47a3-a3a7-628011538351 service placement] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:42:07.873547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1188/2362] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:42:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:42:26.215683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bff08-2e8e-470f-8a0d-199b49c2c387 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:42:26.216196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bff08-2e8e-470f-8a0d-199b49c2c387 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:42:26.216297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bff08-2e8e-470f-8a0d-199b49c2c387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:42:26.272346 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-128bff08-2e8e-470f-8a0d-199b49c2c387 None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:42:26.273667 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-128bff08-2e8e-470f-8a0d-199b49c2c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:42:26.342947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1175/2363] 10.222.0.25 () {58 vars in 967 bytes} [Tue Mar 8 15:42:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:42:26.375885 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941f96-ec3c-47a3-a3a7-628011538351 service placement] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:42:26.375885 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4f941f96-ec3c-47a3-a3a7-628011538351 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:42:26.454616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941f96-ec3c-47a3-a3a7-628011538351 service placement] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:42:26.459634 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb8f7f-52c4-48dc-8c6a-a3480a275a69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:42:26.460340 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb8f7f-52c4-48dc-8c6a-a3480a275a69 service swift] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:42:26.460627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb8f7f-52c4-48dc-8c6a-a3480a275a69 service swift] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:42:26.460902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb8f7f-52c4-48dc-8c6a-a3480a275a69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:42:26.469508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb8f7f-52c4-48dc-8c6a-a3480a275a69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:42:26.471124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb8f7f-52c4-48dc-8c6a-a3480a275a69 service swift] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:42:26.478954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1189/2364] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:42:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:42:27.277488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a06ac-c99f-46b0-b32b-5cbff0e93b66 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:42:27.277959 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a06ac-c99f-46b0-b32b-5cbff0e93b66 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:42:27.278069 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a06ac-c99f-46b0-b32b-5cbff0e93b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:42:27.295528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-6a9a06ac-c99f-46b0-b32b-5cbff0e93b66 None None] MFA Rules not processed for user `c49394ec65c44a8bbd5727141710e510`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:42:27.296776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6a9a06ac-c99f-46b0-b32b-5cbff0e93b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:42:27.355928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1176/2365] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:42:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:42:28.477485 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb8f7f-52c4-48dc-8c6a-a3480a275a69 service swift] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:42:28.483233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-42cb8f7f-52c4-48dc-8c6a-a3480a275a69 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:42:28.540568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb8f7f-52c4-48dc-8c6a-a3480a275a69 service swift] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:42:28.552312 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd968fa-31b0-46cc-91cc-8488244cf993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:42:28.553182 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd968fa-31b0-46cc-91cc-8488244cf993 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:42:28.553660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd968fa-31b0-46cc-91cc-8488244cf993 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:42:28.554021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd968fa-31b0-46cc-91cc-8488244cf993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:42:28.556074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-afd968fa-31b0-46cc-91cc-8488244cf993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:42:28.632371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd968fa-31b0-46cc-91cc-8488244cf993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:42:28.634056 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd968fa-31b0-46cc-91cc-8488244cf993 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:42:28.645565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1190/2366] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:42:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:42:32.247142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1263-7f12-407a-a285-87de34d0d709 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:42:32.247664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1263-7f12-407a-a285-87de34d0d709 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:42:32.247982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1263-7f12-407a-a285-87de34d0d709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:42:32.268360 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-eeca1263-7f12-407a-a285-87de34d0d709 None None] MFA Rules not processed for user `fb710b14dbb44ea3b8d8942e89088b17`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:42:32.269866 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-eeca1263-7f12-407a-a285-87de34d0d709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:42:32.327922 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1177/2367] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:42:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:42:53.836001 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9f53-ee8a-4660-b705-10b81fa75811 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:42:53.836568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9f53-ee8a-4660-b705-10b81fa75811 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:42:53.836568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9f53-ee8a-4660-b705-10b81fa75811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:42:53.854308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a50e9f53-ee8a-4660-b705-10b81fa75811 None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:42:53.855505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a50e9f53-ee8a-4660-b705-10b81fa75811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:42:53.863514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1191/2368] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:42:53.875709 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1263-7f12-407a-a285-87de34d0d709 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:42:53.887669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1263-7f12-407a-a285-87de34d0d709 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:42:53.892610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cca6ef-cfbf-43ba-a64e-eb789db1ffd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:42:53.893240 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cca6ef-cfbf-43ba-a64e-eb789db1ffd0 service swift] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:42:53.893522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cca6ef-cfbf-43ba-a64e-eb789db1ffd0 service swift] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:42:53.893796 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cca6ef-cfbf-43ba-a64e-eb789db1ffd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:42:53.901994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cca6ef-cfbf-43ba-a64e-eb789db1ffd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:42:53.903632 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cca6ef-cfbf-43ba-a64e-eb789db1ffd0 service swift] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:42:53.911976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1178/2369] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:42:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:43:09.110093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9f53-ee8a-4660-b705-10b81fa75811 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:09.111519 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a50e9f53-ee8a-4660-b705-10b81fa75811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:09.183354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9f53-ee8a-4660-b705-10b81fa75811 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:09.192471 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7773b-5169-4cd4-ab45-e491c2dcfdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:09.193711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7773b-5169-4cd4-ab45-e491c2dcfdf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:09.194170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7773b-5169-4cd4-ab45-e491c2dcfdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:09.194680 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7773b-5169-4cd4-ab45-e491c2dcfdf7 admin admin] PATH_INFO: `/v3/users/7e92df732abc406e8e49f270fac56e91` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:09.195913 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7773b-5169-4cd4-ab45-e491c2dcfdf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e92df732abc406e8e49f270fac56e91)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:09.198362 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7773b-5169-4cd4-ab45-e491c2dcfdf7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:09.391146 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-47c7773b-5169-4cd4-ab45-e491c2dcfdf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e92df732abc406e8e49f270fac56e91'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:09.391826 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-47c7773b-5169-4cd4-ab45-e491c2dcfdf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e92df732abc406e8e49f270fac56e91'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:09.488311 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-47c7773b-5169-4cd4-ab45-e491c2dcfdf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e92df732abc406e8e49f270fac56e91'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:09.489086 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-47c7773b-5169-4cd4-ab45-e491c2dcfdf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e92df732abc406e8e49f270fac56e91'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:09.505556 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-47c7773b-5169-4cd4-ab45-e491c2dcfdf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e92df732abc406e8e49f270fac56e91'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:09.524910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1192/2370] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:43:09 2022] DELETE /identity/v3/users/7e92df732abc406e8e49f270fac56e91 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:43:09.913162 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cca6ef-cfbf-43ba-a64e-eb789db1ffd0 service swift] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:09.925204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cca6ef-cfbf-43ba-a64e-eb789db1ffd0 service swift] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:09.984071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3b5a8-0319-4f59-aac5-206b18d6285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:09.984955 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b5a8-0319-4f59-aac5-206b18d6285d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:09.985237 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b5a8-0319-4f59-aac5-206b18d6285d admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:09.985527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3b5a8-0319-4f59-aac5-206b18d6285d admin admin] PATH_INFO: `/v3/projects/e004d80679784783a1f13d99e7bc0b1d` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:09.986683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3b5a8-0319-4f59-aac5-206b18d6285d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e004d80679784783a1f13d99e7bc0b1d)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:09.988629 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3b5a8-0319-4f59-aac5-206b18d6285d admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:10.144968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-2fa3b5a8-0319-4f59-aac5-206b18d6285d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e004d80679784783a1f13d99e7bc0b1d', 'request_id': 'req-2fa3b5a8-0319-4f59-aac5-206b18d6285d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:10.150219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-2fa3b5a8-0319-4f59-aac5-206b18d6285d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e004d80679784783a1f13d99e7bc0b1d', 'request_id': 'req-2fa3b5a8-0319-4f59-aac5-206b18d6285d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:10.156208 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-2fa3b5a8-0319-4f59-aac5-206b18d6285d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e004d80679784783a1f13d99e7bc0b1d', 'request_id': 'req-2fa3b5a8-0319-4f59-aac5-206b18d6285d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:10.256769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-2fa3b5a8-0319-4f59-aac5-206b18d6285d admin admin] The token cache is being invalidate because project e004d80679784783a1f13d99e7bc0b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:43:10.256769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-2fa3b5a8-0319-4f59-aac5-206b18d6285d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:10.256769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-2fa3b5a8-0319-4f59-aac5-206b18d6285d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:10.256769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1179/2371] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:43:09 2022] DELETE /identity/v3/projects/e004d80679784783a1f13d99e7bc0b1d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:43:10.260223 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f45942-5f7d-4524-8020-a193af0238c4 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:10.260645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f45942-5f7d-4524-8020-a193af0238c4 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:10.260788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f45942-5f7d-4524-8020-a193af0238c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:10.280054 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b3f45942-5f7d-4524-8020-a193af0238c4 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:10.281410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b3f45942-5f7d-4524-8020-a193af0238c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:10.343536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1193/2372] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:10.351208 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f555f2-9c0c-476a-8e57-f80a663ef869 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:10.351528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f555f2-9c0c-476a-8e57-f80a663ef869 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:10.351829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f555f2-9c0c-476a-8e57-f80a663ef869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:10.369731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-65f555f2-9c0c-476a-8e57-f80a663ef869 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:10.370918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-65f555f2-9c0c-476a-8e57-f80a663ef869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:10.379204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1180/2373] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:10.383237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f45942-5f7d-4524-8020-a193af0238c4 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:10.393345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f45942-5f7d-4524-8020-a193af0238c4 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:10.397870 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f202e-16ea-4e9d-a794-208e04cbbc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:10.398510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f202e-16ea-4e9d-a794-208e04cbbc17 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:10.398792 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f202e-16ea-4e9d-a794-208e04cbbc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:10.399067 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f202e-16ea-4e9d-a794-208e04cbbc17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:10.399788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f202e-16ea-4e9d-a794-208e04cbbc17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:43:10.400097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f202e-16ea-4e9d-a794-208e04cbbc17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:10.401726 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f202e-16ea-4e9d-a794-208e04cbbc17 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:10.412713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1194/2374] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:43:10.416639 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f555f2-9c0c-476a-8e57-f80a663ef869 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:10.425516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f555f2-9c0c-476a-8e57-f80a663ef869 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:10.430098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1b969-cf63-4219-b0a2-be257b2fb6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:10.430985 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1b969-cf63-4219-b0a2-be257b2fb6fd admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:10.431274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1b969-cf63-4219-b0a2-be257b2fb6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:10.431549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1b969-cf63-4219-b0a2-be257b2fb6fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:10.432260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1b969-cf63-4219-b0a2-be257b2fb6fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:10.434151 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1b969-cf63-4219-b0a2-be257b2fb6fd admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:10.517998 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1181/2375] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:43:10 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:43:10.521917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f202e-16ea-4e9d-a794-208e04cbbc17 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:10.532179 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f202e-16ea-4e9d-a794-208e04cbbc17 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:10.585355 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e61a69-b0c3-4c8f-b24c-f6bac9bb575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:10.586007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e61a69-b0c3-4c8f-b24c-f6bac9bb575f admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:10.586289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e61a69-b0c3-4c8f-b24c-f6bac9bb575f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:10.586566 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e61a69-b0c3-4c8f-b24c-f6bac9bb575f admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:10.587274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e61a69-b0c3-4c8f-b24c-f6bac9bb575f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:10.589194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e61a69-b0c3-4c8f-b24c-f6bac9bb575f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:10.704050 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1195/2376] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:43:10 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:43:10.708042 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1b969-cf63-4219-b0a2-be257b2fb6fd admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:10.718818 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1b969-cf63-4219-b0a2-be257b2fb6fd admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:10.723984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3af17-9036-4f51-ba6e-ebaa21e42f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:10.724792 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3af17-9036-4f51-ba6e-ebaa21e42f24 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:10.725082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3af17-9036-4f51-ba6e-ebaa21e42f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:10.725360 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3af17-9036-4f51-ba6e-ebaa21e42f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:10.726084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3af17-9036-4f51-ba6e-ebaa21e42f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:10.727673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3af17-9036-4f51-ba6e-ebaa21e42f24 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:10.738694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1182/2377] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:43:10.742257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e61a69-b0c3-4c8f-b24c-f6bac9bb575f admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:10.752346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e61a69-b0c3-4c8f-b24c-f6bac9bb575f admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:10.757094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636993bc-02a2-47f2-9081-db5d15270365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:10.757753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636993bc-02a2-47f2-9081-db5d15270365 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:10.758039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636993bc-02a2-47f2-9081-db5d15270365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:10.758321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636993bc-02a2-47f2-9081-db5d15270365 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:10.759082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636993bc-02a2-47f2-9081-db5d15270365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:10.760796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636993bc-02a2-47f2-9081-db5d15270365 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:10.772558 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1196/2378] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:43:10.776302 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3af17-9036-4f51-ba6e-ebaa21e42f24 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:10.786660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3af17-9036-4f51-ba6e-ebaa21e42f24 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:10.791190 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948606e-873a-43ef-ae16-a1c88e828fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:10.792714 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948606e-873a-43ef-ae16-a1c88e828fda admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:10.793000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948606e-873a-43ef-ae16-a1c88e828fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:10.793301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948606e-873a-43ef-ae16-a1c88e828fda admin admin] PATH_INFO: `/v3/projects/818cef031a334947986b5359839285d7/users/c09f638d00cb4ae5b4959cf2c5c2ae71/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:10.807735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948606e-873a-43ef-ae16-a1c88e828fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=818cef031a334947986b5359839285d7, user_id=c09f638d00cb4ae5b4959cf2c5c2ae71, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:10.810415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948606e-873a-43ef-ae16-a1c88e828fda admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:10.899121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1183/2379] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:43:10 2022] PUT /identity/v3/projects/818cef031a334947986b5359839285d7/users/c09f638d00cb4ae5b4959cf2c5c2ae71/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:43:10.904132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c11af-65b9-456e-888c-3d8316992f26 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:10.904466 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c11af-65b9-456e-888c-3d8316992f26 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:10.904754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c11af-65b9-456e-888c-3d8316992f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:10.922198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-653c11af-65b9-456e-888c-3d8316992f26 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:10.923393 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-653c11af-65b9-456e-888c-3d8316992f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:10.988162 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1197/2380] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:10.997731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948606e-873a-43ef-ae16-a1c88e828fda admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:10.999452 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4948606e-873a-43ef-ae16-a1c88e828fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:11.054104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948606e-873a-43ef-ae16-a1c88e828fda admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:11.057964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20551079-f989-4df2-be13-68059311e15c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:11.058598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20551079-f989-4df2-be13-68059311e15c service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:11.058885 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20551079-f989-4df2-be13-68059311e15c service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:11.059166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20551079-f989-4df2-be13-68059311e15c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:11.068530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20551079-f989-4df2-be13-68059311e15c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:11.069968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20551079-f989-4df2-be13-68059311e15c service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:11.079715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1184/2381] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:43:11.441097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce4785-e8ad-41a0-b32b-15da4fe2a02a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:11.441567 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce4785-e8ad-41a0-b32b-15da4fe2a02a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:11.441693 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce4785-e8ad-41a0-b32b-15da4fe2a02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:11.458803 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-46ce4785-e8ad-41a0-b32b-15da4fe2a02a None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:11.459990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-46ce4785-e8ad-41a0-b32b-15da4fe2a02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:11.513042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1198/2382] 10.222.0.25 () {58 vars in 967 bytes} [Tue Mar 8 15:43:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:11.525592 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20551079-f989-4df2-be13-68059311e15c service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:11.527009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-20551079-f989-4df2-be13-68059311e15c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:11.599273 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20551079-f989-4df2-be13-68059311e15c service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:11.604643 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9b289-bac2-43d8-8c31-ef10f6f6feb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:11.605293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9b289-bac2-43d8-8c31-ef10f6f6feb5 service swift] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:11.605850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9b289-bac2-43d8-8c31-ef10f6f6feb5 service swift] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:11.605850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9b289-bac2-43d8-8c31-ef10f6f6feb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:11.615457 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9b289-bac2-43d8-8c31-ef10f6f6feb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:11.617101 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9b289-bac2-43d8-8c31-ef10f6f6feb5 service swift] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:11.626026 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1185/2383] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:43:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 15:43:15.093378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce4785-e8ad-41a0-b32b-15da4fe2a02a None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:15.095569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-46ce4785-e8ad-41a0-b32b-15da4fe2a02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:15.113436 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce4785-e8ad-41a0-b32b-15da4fe2a02a None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:15.121487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309aaa40-c9cf-42ca-8585-2cbb16969bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:15.124906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309aaa40-c9cf-42ca-8585-2cbb16969bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:15.124906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309aaa40-c9cf-42ca-8585-2cbb16969bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:15.124906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309aaa40-c9cf-42ca-8585-2cbb16969bb3 admin admin] PATH_INFO: `/v3/users/c49394ec65c44a8bbd5727141710e510` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:15.124906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309aaa40-c9cf-42ca-8585-2cbb16969bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49394ec65c44a8bbd5727141710e510)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:15.128035 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309aaa40-c9cf-42ca-8585-2cbb16969bb3 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:15.369102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-309aaa40-c9cf-42ca-8585-2cbb16969bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49394ec65c44a8bbd5727141710e510'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:15.369775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-309aaa40-c9cf-42ca-8585-2cbb16969bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49394ec65c44a8bbd5727141710e510'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:15.480613 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-309aaa40-c9cf-42ca-8585-2cbb16969bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49394ec65c44a8bbd5727141710e510'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:15.481551 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-309aaa40-c9cf-42ca-8585-2cbb16969bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49394ec65c44a8bbd5727141710e510'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:15.496574 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-309aaa40-c9cf-42ca-8585-2cbb16969bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49394ec65c44a8bbd5727141710e510'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:15.511122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1199/2384] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:43:15 2022] DELETE /identity/v3/users/c49394ec65c44a8bbd5727141710e510 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:43:15.924126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9b289-bac2-43d8-8c31-ef10f6f6feb5 service swift] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:15.937549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9b289-bac2-43d8-8c31-ef10f6f6feb5 service swift] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:16.008703 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d00cbb-feae-4a99-8b73-969d72722cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:16.009690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d00cbb-feae-4a99-8b73-969d72722cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:16.010084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d00cbb-feae-4a99-8b73-969d72722cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:16.010574 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d00cbb-feae-4a99-8b73-969d72722cfa admin admin] PATH_INFO: `/v3/projects/717041695c614e95a3c317126f56fdd5` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:16.012093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d00cbb-feae-4a99-8b73-969d72722cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=717041695c614e95a3c317126f56fdd5)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:16.015063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d00cbb-feae-4a99-8b73-969d72722cfa admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:16.160750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e1d00cbb-feae-4a99-8b73-969d72722cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717041695c614e95a3c317126f56fdd5', 'request_id': 'req-e1d00cbb-feae-4a99-8b73-969d72722cfa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:16.166713 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e1d00cbb-feae-4a99-8b73-969d72722cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717041695c614e95a3c317126f56fdd5', 'request_id': 'req-e1d00cbb-feae-4a99-8b73-969d72722cfa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:16.173439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e1d00cbb-feae-4a99-8b73-969d72722cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717041695c614e95a3c317126f56fdd5', 'request_id': 'req-e1d00cbb-feae-4a99-8b73-969d72722cfa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:16.292211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e1d00cbb-feae-4a99-8b73-969d72722cfa admin admin] The token cache is being invalidate because project 717041695c614e95a3c317126f56fdd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:43:16.292508 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e1d00cbb-feae-4a99-8b73-969d72722cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:16.293333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e1d00cbb-feae-4a99-8b73-969d72722cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:16.295022 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1186/2385] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:43:15 2022] DELETE /identity/v3/projects/717041695c614e95a3c317126f56fdd5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:43:16.303309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55298c97-0f7c-4a6f-80bf-92dcaea8bacd None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:16.303832 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55298c97-0f7c-4a6f-80bf-92dcaea8bacd None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:16.303995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55298c97-0f7c-4a6f-80bf-92dcaea8bacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:16.327968 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-55298c97-0f7c-4a6f-80bf-92dcaea8bacd None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:16.330034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-55298c97-0f7c-4a6f-80bf-92dcaea8bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:16.415595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1200/2386] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:16.417862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91965862-7408-446b-a013-98ffe39c0cd1 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:16.418146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91965862-7408-446b-a013-98ffe39c0cd1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:16.418420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91965862-7408-446b-a013-98ffe39c0cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:16.438793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-91965862-7408-446b-a013-98ffe39c0cd1 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:16.440129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-91965862-7408-446b-a013-98ffe39c0cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:16.450114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1187/2387] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:16.454821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55298c97-0f7c-4a6f-80bf-92dcaea8bacd None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:16.466648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55298c97-0f7c-4a6f-80bf-92dcaea8bacd None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:16.473704 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256af84-3254-46c3-b135-6e1b836db0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:16.474593 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256af84-3254-46c3-b135-6e1b836db0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:16.475041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256af84-3254-46c3-b135-6e1b836db0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:16.475469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256af84-3254-46c3-b135-6e1b836db0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:16.476634 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256af84-3254-46c3-b135-6e1b836db0a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:43:16.477114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256af84-3254-46c3-b135-6e1b836db0a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:16.479203 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256af84-3254-46c3-b135-6e1b836db0a9 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:16.498226 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1201/2388] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:43:16.499456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91965862-7408-446b-a013-98ffe39c0cd1 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:16.510123 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91965862-7408-446b-a013-98ffe39c0cd1 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:16.515048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bee79-80b2-496a-af4f-80a12f6beb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:16.516399 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bee79-80b2-496a-af4f-80a12f6beb5b admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:16.516750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bee79-80b2-496a-af4f-80a12f6beb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:16.517096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bee79-80b2-496a-af4f-80a12f6beb5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:16.517861 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bee79-80b2-496a-af4f-80a12f6beb5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:16.519907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bee79-80b2-496a-af4f-80a12f6beb5b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:16.635403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1188/2389] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:43:16 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:43:16.639430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256af84-3254-46c3-b135-6e1b836db0a9 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:16.655302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256af84-3254-46c3-b135-6e1b836db0a9 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:16.793213 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd97310-09c9-4189-8aba-3fddcd18735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:16.794339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd97310-09c9-4189-8aba-3fddcd18735c admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:16.794787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd97310-09c9-4189-8aba-3fddcd18735c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:16.795218 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd97310-09c9-4189-8aba-3fddcd18735c admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:16.796073 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd97310-09c9-4189-8aba-3fddcd18735c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:16.800742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd97310-09c9-4189-8aba-3fddcd18735c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:16.823624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477bb10-74e7-4c58-9708-88c7d2bf9ae3 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:16.823624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477bb10-74e7-4c58-9708-88c7d2bf9ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:16.823624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477bb10-74e7-4c58-9708-88c7d2bf9ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:16.854982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-2477bb10-74e7-4c58-9708-88c7d2bf9ae3 None None] MFA Rules not processed for user `c09f638d00cb4ae5b4959cf2c5c2ae71`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:16.856408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2477bb10-74e7-4c58-9708-88c7d2bf9ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:16.893191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1202/2390] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:43:16 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:43:16.898565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd97310-09c9-4189-8aba-3fddcd18735c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:16.911448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd97310-09c9-4189-8aba-3fddcd18735c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:16.915542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24430f9-73b3-4640-94e5-4ce1748a3de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:16.916592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24430f9-73b3-4640-94e5-4ce1748a3de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:16.917281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24430f9-73b3-4640-94e5-4ce1748a3de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:16.918491 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24430f9-73b3-4640-94e5-4ce1748a3de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:16.919475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24430f9-73b3-4640-94e5-4ce1748a3de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:16.923517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24430f9-73b3-4640-94e5-4ce1748a3de4 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:16.941699 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1203/2391] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:43:16.946262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24430f9-73b3-4640-94e5-4ce1748a3de4 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:16.959464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24430f9-73b3-4640-94e5-4ce1748a3de4 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:16.976777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cee3fe-dd39-4931-8c5c-dbe3bcf7257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:16.977237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cee3fe-dd39-4931-8c5c-dbe3bcf7257a admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:16.977868 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cee3fe-dd39-4931-8c5c-dbe3bcf7257a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:16.978154 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cee3fe-dd39-4931-8c5c-dbe3bcf7257a admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:16.979081 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cee3fe-dd39-4931-8c5c-dbe3bcf7257a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:16.980897 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cee3fe-dd39-4931-8c5c-dbe3bcf7257a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:16.985080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1189/2392] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:43:16.998740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477bb10-74e7-4c58-9708-88c7d2bf9ae3 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:17.001555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1204/2393] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:43:17.010627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477bb10-74e7-4c58-9708-88c7d2bf9ae3 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:17.016197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084f7ac-e887-49c9-8bc6-7662411f519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:17.017110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084f7ac-e887-49c9-8bc6-7662411f519a admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:17.017394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084f7ac-e887-49c9-8bc6-7662411f519a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:17.017670 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084f7ac-e887-49c9-8bc6-7662411f519a admin admin] PATH_INFO: `/v3/projects/5c67f296ec534012aa6e40e11226c9e9/users/0e8aa26730224f1da47e9aed5fc7c8da/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:17.045944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cee3fe-dd39-4931-8c5c-dbe3bcf7257a admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:17.047728 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-14cee3fe-dd39-4931-8c5c-dbe3bcf7257a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:17.050210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084f7ac-e887-49c9-8bc6-7662411f519a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c67f296ec534012aa6e40e11226c9e9, user_id=0e8aa26730224f1da47e9aed5fc7c8da, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:17.053218 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084f7ac-e887-49c9-8bc6-7662411f519a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:17.134576 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1190/2394] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:43:16 2022] PUT /identity/v3/projects/5c67f296ec534012aa6e40e11226c9e9/users/0e8aa26730224f1da47e9aed5fc7c8da/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:43:17.137484 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cee3fe-dd39-4931-8c5c-dbe3bcf7257a admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:17.145684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331899b4-02bc-44b2-ba60-f86cb9adc973 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:17.145842 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331899b4-02bc-44b2-ba60-f86cb9adc973 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:17.146122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331899b4-02bc-44b2-ba60-f86cb9adc973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:17.176332 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-331899b4-02bc-44b2-ba60-f86cb9adc973 None None] MFA Rules not processed for user `0e8aa26730224f1da47e9aed5fc7c8da`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:17.177910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-331899b4-02bc-44b2-ba60-f86cb9adc973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:17.215882 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc04e6-72c7-4eca-9ef8-21ec3e83077f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:17.221397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc04e6-72c7-4eca-9ef8-21ec3e83077f service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:17.221397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc04e6-72c7-4eca-9ef8-21ec3e83077f service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:17.221397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc04e6-72c7-4eca-9ef8-21ec3e83077f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:17.252288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1191/2395] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:43:17.260928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331899b4-02bc-44b2-ba60-f86cb9adc973 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:17.262753 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-331899b4-02bc-44b2-ba60-f86cb9adc973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:17.282580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc04e6-72c7-4eca-9ef8-21ec3e83077f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:17.284318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc04e6-72c7-4eca-9ef8-21ec3e83077f service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:17.294040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1205/2396] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:43:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:43:17.349802 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331899b4-02bc-44b2-ba60-f86cb9adc973 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:17.355732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc0386-6a53-4af6-b944-18a383e851cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:17.356606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0386-6a53-4af6-b944-18a383e851cc service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:17.356853 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0386-6a53-4af6-b944-18a383e851cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:17.357128 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc0386-6a53-4af6-b944-18a383e851cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:17.368067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc0386-6a53-4af6-b944-18a383e851cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:17.369770 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc0386-6a53-4af6-b944-18a383e851cc service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:17.379155 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1192/2397] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:43:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:43:20.917350 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786b878-1119-48f2-a534-fcc14e3627f8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:20.917900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786b878-1119-48f2-a534-fcc14e3627f8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:20.917900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786b878-1119-48f2-a534-fcc14e3627f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:20.936416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-4786b878-1119-48f2-a534-fcc14e3627f8 None None] MFA Rules not processed for user `c09f638d00cb4ae5b4959cf2c5c2ae71`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:20.938234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4786b878-1119-48f2-a534-fcc14e3627f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:20.945322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1206/2398] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:28.746403 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3fbaa-560d-4162-9ad3-d1179666410f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:28.746980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3fbaa-560d-4162-9ad3-d1179666410f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:28.746980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3fbaa-560d-4162-9ad3-d1179666410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:28.763893 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-49d3fbaa-560d-4162-9ad3-d1179666410f None None] MFA Rules not processed for user `af4907a2aa8b48b0a0810f23d75f9eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:28.765737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-49d3fbaa-560d-4162-9ad3-d1179666410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:28.824495 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1193/2399] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:29.354381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786b878-1119-48f2-a534-fcc14e3627f8 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:29.414186 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786b878-1119-48f2-a534-fcc14e3627f8 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:29.418690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:29.427034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:29.427034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:29.427034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] PATH_INFO: `/v3/users/0e8aa26730224f1da47e9aed5fc7c8da` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:29.427034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8aa26730224f1da47e9aed5fc7c8da)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:29.427034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:29.631939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8aa26730224f1da47e9aed5fc7c8da'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:29.632741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8aa26730224f1da47e9aed5fc7c8da'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:29.716237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8aa26730224f1da47e9aed5fc7c8da'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:29.716789 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8aa26730224f1da47e9aed5fc7c8da'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:29.729127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8aa26730224f1da47e9aed5fc7c8da'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:29.741094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1207/2400] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:43:29 2022] DELETE /identity/v3/users/0e8aa26730224f1da47e9aed5fc7c8da => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:43:29.745548 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928da75-8c27-483f-a630-e9d38f07ccbd None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:29.745844 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928da75-8c27-483f-a630-e9d38f07ccbd None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:29.746123 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928da75-8c27-483f-a630-e9d38f07ccbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:29.763742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-9928da75-8c27-483f-a630-e9d38f07ccbd None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:29.764951 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9928da75-8c27-483f-a630-e9d38f07ccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:29.823347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1194/2401] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:29.833713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:29.835115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:29.889938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139a555-8a66-424b-a7a8-089381932fa7 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:29.894151 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c97707-a2b7-4481-ad46-8b26b3fe0b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:29.894788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c97707-a2b7-4481-ad46-8b26b3fe0b52 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:29.896476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c97707-a2b7-4481-ad46-8b26b3fe0b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:29.896476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c97707-a2b7-4481-ad46-8b26b3fe0b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:29.909507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c97707-a2b7-4481-ad46-8b26b3fe0b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:29.911012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c97707-a2b7-4481-ad46-8b26b3fe0b52 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:29.934083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1208/2402] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:43:30.377567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928da75-8c27-483f-a630-e9d38f07ccbd None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:30.380376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9928da75-8c27-483f-a630-e9d38f07ccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:30.394726 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928da75-8c27-483f-a630-e9d38f07ccbd None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:30.407824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d0032-455c-4146-84d7-45874625e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:30.408742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d0032-455c-4146-84d7-45874625e44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:30.409028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d0032-455c-4146-84d7-45874625e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:30.409345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d0032-455c-4146-84d7-45874625e44b admin admin] PATH_INFO: `/v3/projects/5c67f296ec534012aa6e40e11226c9e9` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:30.410808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d0032-455c-4146-84d7-45874625e44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c67f296ec534012aa6e40e11226c9e9)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:30.412744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d0032-455c-4146-84d7-45874625e44b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:30.540201 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d71d0032-455c-4146-84d7-45874625e44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c67f296ec534012aa6e40e11226c9e9', 'request_id': 'req-d71d0032-455c-4146-84d7-45874625e44b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:30.545644 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d71d0032-455c-4146-84d7-45874625e44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c67f296ec534012aa6e40e11226c9e9', 'request_id': 'req-d71d0032-455c-4146-84d7-45874625e44b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:30.552794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d71d0032-455c-4146-84d7-45874625e44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c67f296ec534012aa6e40e11226c9e9', 'request_id': 'req-d71d0032-455c-4146-84d7-45874625e44b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:30.686881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d71d0032-455c-4146-84d7-45874625e44b admin admin] The token cache is being invalidate because project 5c67f296ec534012aa6e40e11226c9e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:43:30.687310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d71d0032-455c-4146-84d7-45874625e44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:30.687930 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d71d0032-455c-4146-84d7-45874625e44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:43:30.689481 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1195/2403] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:43:30 2022] DELETE /identity/v3/projects/5c67f296ec534012aa6e40e11226c9e9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:43:30.696225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31349f23-585f-4669-91fa-2a9af41357a2 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:30.696696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31349f23-585f-4669-91fa-2a9af41357a2 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:30.696788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31349f23-585f-4669-91fa-2a9af41357a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:30.715028 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-31349f23-585f-4669-91fa-2a9af41357a2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:30.716401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-31349f23-585f-4669-91fa-2a9af41357a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:30.775349 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1209/2404] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:30.783838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ccc33-871f-4745-a37a-93864ce2d585 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:30.784363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ccc33-871f-4745-a37a-93864ce2d585 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:30.784516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ccc33-871f-4745-a37a-93864ce2d585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:30.802653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-d01ccc33-871f-4745-a37a-93864ce2d585 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:30.803844 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d01ccc33-871f-4745-a37a-93864ce2d585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:30.812171 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1196/2405] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:43:30.816202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31349f23-585f-4669-91fa-2a9af41357a2 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:30.825586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31349f23-585f-4669-91fa-2a9af41357a2 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:30.830638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bd680-19e9-4ecd-9707-cdc17ecc0aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:30.831282 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bd680-19e9-4ecd-9707-cdc17ecc0aef admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:30.831567 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bd680-19e9-4ecd-9707-cdc17ecc0aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:30.831847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bd680-19e9-4ecd-9707-cdc17ecc0aef admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:30.832613 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bd680-19e9-4ecd-9707-cdc17ecc0aef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:43:30.832921 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bd680-19e9-4ecd-9707-cdc17ecc0aef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:30.834515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bd680-19e9-4ecd-9707-cdc17ecc0aef admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:30.846369 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1210/2406] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:43:30.855235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ccc33-871f-4745-a37a-93864ce2d585 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:30.864468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ccc33-871f-4745-a37a-93864ce2d585 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:30.869429 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8af36-678b-4f53-b77e-c1d52b400b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:30.870068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8af36-678b-4f53-b77e-c1d52b400b59 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:30.870353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8af36-678b-4f53-b77e-c1d52b400b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:30.870630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8af36-678b-4f53-b77e-c1d52b400b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:30.871330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8af36-678b-4f53-b77e-c1d52b400b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:30.873274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8af36-678b-4f53-b77e-c1d52b400b59 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:30.973119 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1197/2407] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:43:30 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:43:30.977314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bd680-19e9-4ecd-9707-cdc17ecc0aef admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:30.987649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bd680-19e9-4ecd-9707-cdc17ecc0aef admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:31.045662 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa2691-3229-4468-ac24-b34bc7fdb309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:31.047596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa2691-3229-4468-ac24-b34bc7fdb309 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:31.048193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa2691-3229-4468-ac24-b34bc7fdb309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:31.048193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa2691-3229-4468-ac24-b34bc7fdb309 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:31.049344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa2691-3229-4468-ac24-b34bc7fdb309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:31.051307 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa2691-3229-4468-ac24-b34bc7fdb309 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:31.125933 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1211/2408] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:43:30 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:43:31.127077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8af36-678b-4f53-b77e-c1d52b400b59 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:31.137545 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8af36-678b-4f53-b77e-c1d52b400b59 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:31.145935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bf599-daec-40f7-af51-45fc7661b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:31.146611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bf599-daec-40f7-af51-45fc7661b620 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:31.147084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bf599-daec-40f7-af51-45fc7661b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:31.147368 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bf599-daec-40f7-af51-45fc7661b620 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:31.148267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bf599-daec-40f7-af51-45fc7661b620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:31.149909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bf599-daec-40f7-af51-45fc7661b620 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:31.160880 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1198/2409] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:43:31.172458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa2691-3229-4468-ac24-b34bc7fdb309 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:31.183410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa2691-3229-4468-ac24-b34bc7fdb309 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:31.188967 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844a712-a9d5-40ff-b1fc-1476927a2f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:31.189633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844a712-a9d5-40ff-b1fc-1476927a2f5b admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:31.190061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844a712-a9d5-40ff-b1fc-1476927a2f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:31.190360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844a712-a9d5-40ff-b1fc-1476927a2f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:31.191157 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844a712-a9d5-40ff-b1fc-1476927a2f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:31.192871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844a712-a9d5-40ff-b1fc-1476927a2f5b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:31.203853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1212/2410] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:43:31.208091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bf599-daec-40f7-af51-45fc7661b620 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:31.219503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bf599-daec-40f7-af51-45fc7661b620 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:31.224326 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0667f-b657-4ff6-91ea-58bc35d04006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:31.225277 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0667f-b657-4ff6-91ea-58bc35d04006 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:31.225630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0667f-b657-4ff6-91ea-58bc35d04006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:31.225978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0667f-b657-4ff6-91ea-58bc35d04006 admin admin] PATH_INFO: `/v3/projects/2f89d9e4dc2940379c095e284e789ec4/users/191b52bd64c947fea11740672fc1eda6/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:31.241202 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0667f-b657-4ff6-91ea-58bc35d04006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f89d9e4dc2940379c095e284e789ec4, user_id=191b52bd64c947fea11740672fc1eda6, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:31.243966 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0667f-b657-4ff6-91ea-58bc35d04006 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:31.342810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1199/2411] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:43:31 2022] PUT /identity/v3/projects/2f89d9e4dc2940379c095e284e789ec4/users/191b52bd64c947fea11740672fc1eda6/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:43:31.347875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99f47-1215-478a-91e7-f1d60c073c2e None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:31.348197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99f47-1215-478a-91e7-f1d60c073c2e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:31.348512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99f47-1215-478a-91e7-f1d60c073c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:31.366211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-3cc99f47-1215-478a-91e7-f1d60c073c2e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:31.367347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3cc99f47-1215-478a-91e7-f1d60c073c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:31.424500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1213/2412] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:43:31.434289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0667f-b657-4ff6-91ea-58bc35d04006 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:31.435986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-08c0667f-b657-4ff6-91ea-58bc35d04006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:31.491909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0667f-b657-4ff6-91ea-58bc35d04006 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:31.495644 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8834209-364c-4738-838e-6fd05a84955d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:31.496317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8834209-364c-4738-838e-6fd05a84955d service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:31.496631 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8834209-364c-4738-838e-6fd05a84955d service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:31.496907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8834209-364c-4738-838e-6fd05a84955d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:31.506600 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8834209-364c-4738-838e-6fd05a84955d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:31.508085 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8834209-364c-4738-838e-6fd05a84955d service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:31.517662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1200/2413] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:43:33.032448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4393b78-c06b-4a13-a9e3-69a031941195 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:33.032964 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4393b78-c06b-4a13-a9e3-69a031941195 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:33.033094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4393b78-c06b-4a13-a9e3-69a031941195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:33.074433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b4393b78-c06b-4a13-a9e3-69a031941195 None None] MFA Rules not processed for user `191b52bd64c947fea11740672fc1eda6`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:33.076004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b4393b78-c06b-4a13-a9e3-69a031941195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:33.158508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1214/2414] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:33.169705 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8834209-364c-4738-838e-6fd05a84955d service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:33.173640 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d8834209-364c-4738-838e-6fd05a84955d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:33.238498 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8834209-364c-4738-838e-6fd05a84955d service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:33.242494 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5c340-3463-49c0-8891-c8c21eafe66b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:33.243149 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5c340-3463-49c0-8891-c8c21eafe66b service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:33.243436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5c340-3463-49c0-8891-c8c21eafe66b service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:33.243712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5c340-3463-49c0-8891-c8c21eafe66b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:33.253847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5c340-3463-49c0-8891-c8c21eafe66b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:33.255341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5c340-3463-49c0-8891-c8c21eafe66b service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:33.265199 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1201/2415] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:43:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:43:35.339246 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116043dd-5b94-4ec7-a5c4-f60e58ac2585 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:35.339801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116043dd-5b94-4ec7-a5c4-f60e58ac2585 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:35.339908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116043dd-5b94-4ec7-a5c4-f60e58ac2585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:35.357720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-116043dd-5b94-4ec7-a5c4-f60e58ac2585 None None] MFA Rules not processed for user `191b52bd64c947fea11740672fc1eda6`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:35.358938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-116043dd-5b94-4ec7-a5c4-f60e58ac2585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:35.370779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1215/2416] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:50.340867 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84c191-f51d-41dc-913c-b97059175114 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:50.341386 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84c191-f51d-41dc-913c-b97059175114 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:50.341486 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84c191-f51d-41dc-913c-b97059175114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:50.360249 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-fe84c191-f51d-41dc-913c-b97059175114 None None] MFA Rules not processed for user `fb710b14dbb44ea3b8d8942e89088b17`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:43:50.361495 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-fe84c191-f51d-41dc-913c-b97059175114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:50.417394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1202/2417] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:43:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:43:50.453036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116043dd-5b94-4ec7-a5c4-f60e58ac2585 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:50.454904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-116043dd-5b94-4ec7-a5c4-f60e58ac2585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:50.537594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116043dd-5b94-4ec7-a5c4-f60e58ac2585 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:50.541160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973594e-6cd7-4803-90bd-1e769bdb407e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f9935443bcc4d34aeb56e5b77a96720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:50.541800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973594e-6cd7-4803-90bd-1e769bdb407e service glance] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:50.542078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973594e-6cd7-4803-90bd-1e769bdb407e service glance] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:50.542349 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973594e-6cd7-4803-90bd-1e769bdb407e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:50.544209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5973594e-6cd7-4803-90bd-1e769bdb407e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:50.614461 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973594e-6cd7-4803-90bd-1e769bdb407e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:50.616098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973594e-6cd7-4803-90bd-1e769bdb407e service glance] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:50.628477 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1216/2418] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:43:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:43:51.336517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84c191-f51d-41dc-913c-b97059175114 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:51.346689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84c191-f51d-41dc-913c-b97059175114 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:51.350464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11b8df-cc99-4775-839f-c8fa55590376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:51.351122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11b8df-cc99-4775-839f-c8fa55590376 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:51.351593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11b8df-cc99-4775-839f-c8fa55590376 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:51.351889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11b8df-cc99-4775-839f-c8fa55590376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:51.353723 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8d11b8df-cc99-4775-839f-c8fa55590376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:51.368551 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11b8df-cc99-4775-839f-c8fa55590376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:51.370030 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11b8df-cc99-4775-839f-c8fa55590376 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:51.381398 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1203/2419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:43:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:43:57.015970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973594e-6cd7-4803-90bd-1e769bdb407e service glance] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:43:57.017101 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5973594e-6cd7-4803-90bd-1e769bdb407e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:57.035061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973594e-6cd7-4803-90bd-1e769bdb407e service glance] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:43:57.041509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95085747-2456-40e7-bd08-055b3b23cef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:43:57.042270 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95085747-2456-40e7-bd08-055b3b23cef0 service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:43:57.042561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95085747-2456-40e7-bd08-055b3b23cef0 service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:43:57.042840 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95085747-2456-40e7-bd08-055b3b23cef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:43:57.044637 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-95085747-2456-40e7-bd08-055b3b23cef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:43:57.056581 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95085747-2456-40e7-bd08-055b3b23cef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:43:57.058173 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95085747-2456-40e7-bd08-055b3b23cef0 service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:43:57.067735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1217/2420] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:43:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:44:02.532260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11b8df-cc99-4775-839f-c8fa55590376 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:02.533624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8d11b8df-cc99-4775-839f-c8fa55590376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:02.544048 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11b8df-cc99-4775-839f-c8fa55590376 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:02.547725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760628d-9ad0-4558-a680-77b9384affb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:02.548398 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760628d-9ad0-4558-a680-77b9384affb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:02.549184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760628d-9ad0-4558-a680-77b9384affb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:02.549464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760628d-9ad0-4558-a680-77b9384affb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:02.551204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3760628d-9ad0-4558-a680-77b9384affb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:02.560962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760628d-9ad0-4558-a680-77b9384affb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:02.562409 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760628d-9ad0-4558-a680-77b9384affb5 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:02.571137 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1204/2421] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:44:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:44:13.176955 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689a4e6-4635-4de2-b770-b2fef1a1bc8b None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:13.177434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689a4e6-4635-4de2-b770-b2fef1a1bc8b None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:13.177532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689a4e6-4635-4de2-b770-b2fef1a1bc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:13.194577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-d689a4e6-4635-4de2-b770-b2fef1a1bc8b None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:44:13.195792 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d689a4e6-4635-4de2-b770-b2fef1a1bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:13.248345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1218/2422] 10.222.0.25 () {58 vars in 967 bytes} [Tue Mar 8 15:44:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:44:13.387278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760628d-9ad0-4558-a680-77b9384affb5 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:13.388721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3760628d-9ad0-4558-a680-77b9384affb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:13.454907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760628d-9ad0-4558-a680-77b9384affb5 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:13.460377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f830ef-b1db-4e94-b844-7a3b71225d5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:13.461037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f830ef-b1db-4e94-b844-7a3b71225d5f service swift] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:13.461320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f830ef-b1db-4e94-b844-7a3b71225d5f service swift] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:13.461596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f830ef-b1db-4e94-b844-7a3b71225d5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:13.469341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f830ef-b1db-4e94-b844-7a3b71225d5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:13.470924 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f830ef-b1db-4e94-b844-7a3b71225d5f service swift] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:13.479378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1205/2423] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:44:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:44:22.061861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689a4e6-4635-4de2-b770-b2fef1a1bc8b None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:22.067712 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d689a4e6-4635-4de2-b770-b2fef1a1bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:22.088791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689a4e6-4635-4de2-b770-b2fef1a1bc8b None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:22.093746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:22.094612 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:22.094893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:22.095166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] PATH_INFO: `/v3/users/8c2c1098e3254bc492cf24761a664a1b` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:22.096892 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c2c1098e3254bc492cf24761a664a1b)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:22.098806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:22.301978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c2c1098e3254bc492cf24761a664a1b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:22.302549 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c2c1098e3254bc492cf24761a664a1b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:22.363356 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c2c1098e3254bc492cf24761a664a1b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:22.364093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c2c1098e3254bc492cf24761a664a1b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:22.379285 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c2c1098e3254bc492cf24761a664a1b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:22.391285 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1219/2424] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:44:22 2022] DELETE /identity/v3/users/8c2c1098e3254bc492cf24761a664a1b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:44:22.619412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f830ef-b1db-4e94-b844-7a3b71225d5f service swift] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:22.631447 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f830ef-b1db-4e94-b844-7a3b71225d5f service swift] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:22.687267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:22.688114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:22.688431 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:22.688712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] PATH_INFO: `/v3/projects/a501642d06b54b94b85256a66c6be5fb` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:22.689926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a501642d06b54b94b85256a66c6be5fb)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:22.691820 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:22.802708 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a501642d06b54b94b85256a66c6be5fb', 'request_id': 'req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:22.808356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a501642d06b54b94b85256a66c6be5fb', 'request_id': 'req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:22.814969 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a501642d06b54b94b85256a66c6be5fb', 'request_id': 'req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:22.885814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] The token cache is being invalidate because project a501642d06b54b94b85256a66c6be5fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:44:22.886110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:22.886725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:22.891088 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1206/2425] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:44:22 2022] DELETE /identity/v3/projects/a501642d06b54b94b85256a66c6be5fb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:44:22.892225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:22.894225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:22.908299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c4a26-c82c-4d17-9bba-33d1d4d861dc admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:22.962582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cd96b-86f6-428c-afef-b5a7b9fc2367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:22.963450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd96b-86f6-428c-afef-b5a7b9fc2367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:22.963733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd96b-86f6-428c-afef-b5a7b9fc2367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:22.964009 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cd96b-86f6-428c-afef-b5a7b9fc2367 admin admin] PATH_INFO: `/v3/users/7fe44104ac9f4b9bb50b18d3f12f477d` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:22.965234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cd96b-86f6-428c-afef-b5a7b9fc2367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe44104ac9f4b9bb50b18d3f12f477d)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:22.967197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cd96b-86f6-428c-afef-b5a7b9fc2367 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:23.192116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-aa7cd96b-86f6-428c-afef-b5a7b9fc2367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe44104ac9f4b9bb50b18d3f12f477d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:23.192820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-aa7cd96b-86f6-428c-afef-b5a7b9fc2367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe44104ac9f4b9bb50b18d3f12f477d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:23.403792 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-aa7cd96b-86f6-428c-afef-b5a7b9fc2367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe44104ac9f4b9bb50b18d3f12f477d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:23.403792 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-aa7cd96b-86f6-428c-afef-b5a7b9fc2367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe44104ac9f4b9bb50b18d3f12f477d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:23.414240 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-aa7cd96b-86f6-428c-afef-b5a7b9fc2367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe44104ac9f4b9bb50b18d3f12f477d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:23.426572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1220/2426] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:44:22 2022] DELETE /identity/v3/users/7fe44104ac9f4b9bb50b18d3f12f477d => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:44:23.684784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:23.686310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:23.699771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a81ddc-48e4-4dbf-a392-8c3034ee1c44 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:23.757305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51520077-5958-4f7a-87d0-4a60d284d734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:23.758200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51520077-5958-4f7a-87d0-4a60d284d734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:23.758542 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51520077-5958-4f7a-87d0-4a60d284d734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:23.758821 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51520077-5958-4f7a-87d0-4a60d284d734 admin admin] PATH_INFO: `/v3/projects/c6756c1e2e044897b12a0201794685d1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:23.760460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51520077-5958-4f7a-87d0-4a60d284d734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6756c1e2e044897b12a0201794685d1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:23.765958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51520077-5958-4f7a-87d0-4a60d284d734 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:23.912219 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-51520077-5958-4f7a-87d0-4a60d284d734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6756c1e2e044897b12a0201794685d1', 'request_id': 'req-51520077-5958-4f7a-87d0-4a60d284d734'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:23.917356 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-51520077-5958-4f7a-87d0-4a60d284d734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6756c1e2e044897b12a0201794685d1', 'request_id': 'req-51520077-5958-4f7a-87d0-4a60d284d734'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:23.923396 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-51520077-5958-4f7a-87d0-4a60d284d734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6756c1e2e044897b12a0201794685d1', 'request_id': 'req-51520077-5958-4f7a-87d0-4a60d284d734'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:24.002274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-51520077-5958-4f7a-87d0-4a60d284d734 admin admin] The token cache is being invalidate because project c6756c1e2e044897b12a0201794685d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:44:24.002564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-51520077-5958-4f7a-87d0-4a60d284d734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:24.003209 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-51520077-5958-4f7a-87d0-4a60d284d734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:44:24.004807 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1207/2427] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:44:23 2022] DELETE /identity/v3/projects/c6756c1e2e044897b12a0201794685d1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:44:24.009941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa570e5-1434-4df9-9357-9c3cf32c79f7 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:24.013564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa570e5-1434-4df9-9357-9c3cf32c79f7 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:24.013564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa570e5-1434-4df9-9357-9c3cf32c79f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:24.029715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-afa570e5-1434-4df9-9357-9c3cf32c79f7 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:44:24.031324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-afa570e5-1434-4df9-9357-9c3cf32c79f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:24.094088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1221/2428] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:44:24.102503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663902b-1648-4570-8baf-a40d1b8530d6 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:24.102791 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663902b-1648-4570-8baf-a40d1b8530d6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:24.103065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663902b-1648-4570-8baf-a40d1b8530d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:24.121880 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-e663902b-1648-4570-8baf-a40d1b8530d6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:44:24.123060 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-e663902b-1648-4570-8baf-a40d1b8530d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:24.130922 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1208/2429] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:44:24.135188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa570e5-1434-4df9-9357-9c3cf32c79f7 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:24.145916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa570e5-1434-4df9-9357-9c3cf32c79f7 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:24.150511 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017defa-2d19-40f6-a7a3-533cd610e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:24.151161 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017defa-2d19-40f6-a7a3-533cd610e776 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:24.151445 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017defa-2d19-40f6-a7a3-533cd610e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:24.151755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017defa-2d19-40f6-a7a3-533cd610e776 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:24.152510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017defa-2d19-40f6-a7a3-533cd610e776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:44:24.152817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017defa-2d19-40f6-a7a3-533cd610e776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:24.154450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017defa-2d19-40f6-a7a3-533cd610e776 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:24.166608 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1222/2430] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:44:24.171081 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663902b-1648-4570-8baf-a40d1b8530d6 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:24.181141 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663902b-1648-4570-8baf-a40d1b8530d6 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:24.185684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98bb37-c8b2-406d-a709-a4293fa26573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:24.186326 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98bb37-c8b2-406d-a709-a4293fa26573 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:24.186607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98bb37-c8b2-406d-a709-a4293fa26573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:24.186882 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98bb37-c8b2-406d-a709-a4293fa26573 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:24.187601 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98bb37-c8b2-406d-a709-a4293fa26573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:24.189518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98bb37-c8b2-406d-a709-a4293fa26573 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:24.296128 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1209/2431] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:44:24 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:44:24.300966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017defa-2d19-40f6-a7a3-533cd610e776 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:24.311194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017defa-2d19-40f6-a7a3-533cd610e776 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:24.366360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d9622-ed5d-44b5-a4ce-05f1996e7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:24.367035 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d9622-ed5d-44b5-a4ce-05f1996e7d37 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:24.367315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d9622-ed5d-44b5-a4ce-05f1996e7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:24.367633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d9622-ed5d-44b5-a4ce-05f1996e7d37 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:24.368376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d9622-ed5d-44b5-a4ce-05f1996e7d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:24.370295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d9622-ed5d-44b5-a4ce-05f1996e7d37 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:24.472537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1223/2432] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:44:24 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:44:24.476708 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98bb37-c8b2-406d-a709-a4293fa26573 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:24.489609 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98bb37-c8b2-406d-a709-a4293fa26573 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:24.496049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c3c88-79df-4bd8-ab00-015dc86b2fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:24.497547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c3c88-79df-4bd8-ab00-015dc86b2fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:24.497547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c3c88-79df-4bd8-ab00-015dc86b2fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:24.497547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c3c88-79df-4bd8-ab00-015dc86b2fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:24.498065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c3c88-79df-4bd8-ab00-015dc86b2fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:24.499760 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c3c88-79df-4bd8-ab00-015dc86b2fa9 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:24.510763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1210/2433] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:44:24.514460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d9622-ed5d-44b5-a4ce-05f1996e7d37 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:24.524865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d9622-ed5d-44b5-a4ce-05f1996e7d37 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:24.529382 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81257f-1290-42bc-b7f5-42ff3998540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:24.530021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81257f-1290-42bc-b7f5-42ff3998540e admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:24.530303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81257f-1290-42bc-b7f5-42ff3998540e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:24.530577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81257f-1290-42bc-b7f5-42ff3998540e admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:24.531293 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81257f-1290-42bc-b7f5-42ff3998540e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:24.532944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81257f-1290-42bc-b7f5-42ff3998540e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:24.543115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1224/2434] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:44:24.547149 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c3c88-79df-4bd8-ab00-015dc86b2fa9 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:24.557047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c3c88-79df-4bd8-ab00-015dc86b2fa9 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:24.561578 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5a1ae-2984-4021-891b-8ee325381e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:24.562447 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5a1ae-2984-4021-891b-8ee325381e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:24.562731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5a1ae-2984-4021-891b-8ee325381e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:24.563008 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5a1ae-2984-4021-891b-8ee325381e5a admin admin] PATH_INFO: `/v3/projects/446fa0e6566c4e8abfe18b45a5e42110/users/6c3f1618f68f4920aa71db3751b8f96c/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:24.577177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5a1ae-2984-4021-891b-8ee325381e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=446fa0e6566c4e8abfe18b45a5e42110, user_id=6c3f1618f68f4920aa71db3751b8f96c, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:24.579829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5a1ae-2984-4021-891b-8ee325381e5a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:24.670252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1211/2435] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:44:24 2022] PUT /identity/v3/projects/446fa0e6566c4e8abfe18b45a5e42110/users/6c3f1618f68f4920aa71db3751b8f96c/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:44:24.675641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204de7c-35dc-417f-aaa9-379a37b5bfdf None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:24.675995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204de7c-35dc-417f-aaa9-379a37b5bfdf None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:24.676290 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204de7c-35dc-417f-aaa9-379a37b5bfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:24.699830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-2204de7c-35dc-417f-aaa9-379a37b5bfdf None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:44:24.701130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2204de7c-35dc-417f-aaa9-379a37b5bfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:24.759053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1225/2436] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:44:24.769254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5a1ae-2984-4021-891b-8ee325381e5a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:24.770928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-51c5a1ae-2984-4021-891b-8ee325381e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:24.827142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5a1ae-2984-4021-891b-8ee325381e5a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:24.831394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f09ee8-a0f1-412f-987e-2004027cf315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:24.832175 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f09ee8-a0f1-412f-987e-2004027cf315 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:24.832558 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f09ee8-a0f1-412f-987e-2004027cf315 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:24.832841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f09ee8-a0f1-412f-987e-2004027cf315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:24.842012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f09ee8-a0f1-412f-987e-2004027cf315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:24.843470 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f09ee8-a0f1-412f-987e-2004027cf315 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:24.852994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1212/2437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:44:30.323267 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9447d-7775-4de0-b01c-a28d3c42daae None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:30.323739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9447d-7775-4de0-b01c-a28d3c42daae None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:30.323845 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9447d-7775-4de0-b01c-a28d3c42daae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:30.353610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b0f9447d-7775-4de0-b01c-a28d3c42daae None None] MFA Rules not processed for user `6c3f1618f68f4920aa71db3751b8f96c`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:44:30.355188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b0f9447d-7775-4de0-b01c-a28d3c42daae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:30.432106 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1226/2438] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:44:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:44:30.439039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f09ee8-a0f1-412f-987e-2004027cf315 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:30.449261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f09ee8-a0f1-412f-987e-2004027cf315 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:30.454146 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4d8e1-43d9-4358-85de-a5dbdb6e255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:30.454805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4d8e1-43d9-4358-85de-a5dbdb6e255b admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:30.455114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4d8e1-43d9-4358-85de-a5dbdb6e255b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:30.455396 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4d8e1-43d9-4358-85de-a5dbdb6e255b admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:30.456129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4d8e1-43d9-4358-85de-a5dbdb6e255b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:30.458112 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4d8e1-43d9-4358-85de-a5dbdb6e255b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:30.574358 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1213/2439] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:44:30 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:44:30.582209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9447d-7775-4de0-b01c-a28d3c42daae None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:30.589591 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9447d-7775-4de0-b01c-a28d3c42daae None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:30.652690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705f0b8-f6ff-43b3-bf2b-538f34c5d02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:30.653364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705f0b8-f6ff-43b3-bf2b-538f34c5d02d admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:30.653651 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705f0b8-f6ff-43b3-bf2b-538f34c5d02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:30.653936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705f0b8-f6ff-43b3-bf2b-538f34c5d02d admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:30.654658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705f0b8-f6ff-43b3-bf2b-538f34c5d02d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:30.656646 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705f0b8-f6ff-43b3-bf2b-538f34c5d02d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:30.761270 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1227/2440] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:44:30 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:44:30.765359 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4d8e1-43d9-4358-85de-a5dbdb6e255b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:30.776206 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4d8e1-43d9-4358-85de-a5dbdb6e255b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:30.780739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed0ea8-c627-4218-8f20-f970573cec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:30.781394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed0ea8-c627-4218-8f20-f970573cec26 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:30.781678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed0ea8-c627-4218-8f20-f970573cec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:30.781958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed0ea8-c627-4218-8f20-f970573cec26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:30.782735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed0ea8-c627-4218-8f20-f970573cec26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:30.784995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed0ea8-c627-4218-8f20-f970573cec26 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:30.796728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1214/2441] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:44:30.800799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705f0b8-f6ff-43b3-bf2b-538f34c5d02d admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:30.811291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705f0b8-f6ff-43b3-bf2b-538f34c5d02d admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:30.816000 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6849dca-5f15-4cd9-8c81-6f4bac7b5ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:30.816922 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6849dca-5f15-4cd9-8c81-6f4bac7b5ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:30.817201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6849dca-5f15-4cd9-8c81-6f4bac7b5ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:30.817476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6849dca-5f15-4cd9-8c81-6f4bac7b5ca0 admin admin] PATH_INFO: `/v3/projects/48e98a3b49c44e2ca1c25c78ca0c5a47/users/0734ed93182344c98bb1426f91d8c6aa/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:30.832362 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6849dca-5f15-4cd9-8c81-6f4bac7b5ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e98a3b49c44e2ca1c25c78ca0c5a47, user_id=0734ed93182344c98bb1426f91d8c6aa, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:30.834940 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6849dca-5f15-4cd9-8c81-6f4bac7b5ca0 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:30.915684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1228/2442] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:44:30 2022] PUT /identity/v3/projects/48e98a3b49c44e2ca1c25c78ca0c5a47/users/0734ed93182344c98bb1426f91d8c6aa/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:44:30.919612 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed0ea8-c627-4218-8f20-f970573cec26 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:30.929984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed0ea8-c627-4218-8f20-f970573cec26 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:30.983117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934562c0-391d-4807-b9ba-6a3955c0f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:30.983765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934562c0-391d-4807-b9ba-6a3955c0f015 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:30.984045 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934562c0-391d-4807-b9ba-6a3955c0f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:30.984350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934562c0-391d-4807-b9ba-6a3955c0f015 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:30.985059 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934562c0-391d-4807-b9ba-6a3955c0f015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:30.986674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934562c0-391d-4807-b9ba-6a3955c0f015 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:30.996313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1215/2443] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:44:31.000339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6849dca-5f15-4cd9-8c81-6f4bac7b5ca0 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:31.010450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6849dca-5f15-4cd9-8c81-6f4bac7b5ca0 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:31.015242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb58793-ae5e-4b84-9e3f-7080ef5772e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:31.016125 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb58793-ae5e-4b84-9e3f-7080ef5772e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:31.016456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb58793-ae5e-4b84-9e3f-7080ef5772e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:31.016761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb58793-ae5e-4b84-9e3f-7080ef5772e6 admin admin] PATH_INFO: `/v3/projects/48e98a3b49c44e2ca1c25c78ca0c5a47/users/0734ed93182344c98bb1426f91d8c6aa/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:31.019374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb58793-ae5e-4b84-9e3f-7080ef5772e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e98a3b49c44e2ca1c25c78ca0c5a47, user_id=0734ed93182344c98bb1426f91d8c6aa, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:31.022080 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb58793-ae5e-4b84-9e3f-7080ef5772e6 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:31.032659 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1229/2444] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:44:30 2022] PUT /identity/v3/projects/48e98a3b49c44e2ca1c25c78ca0c5a47/users/0734ed93182344c98bb1426f91d8c6aa/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:44:36.822728 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e9ed-02ed-4e29-8311-7bd83d70c30e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:36.823318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e9ed-02ed-4e29-8311-7bd83d70c30e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:36.823318 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e9ed-02ed-4e29-8311-7bd83d70c30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:36.853097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-b479e9ed-02ed-4e29-8311-7bd83d70c30e None None] MFA Rules not processed for user `0734ed93182344c98bb1426f91d8c6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:44:36.854391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b479e9ed-02ed-4e29-8311-7bd83d70c30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:36.934987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1216/2445] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:44:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:44:36.947994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb58793-ae5e-4b84-9e3f-7080ef5772e6 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:36.950316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9eb58793-ae5e-4b84-9e3f-7080ef5772e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:37.027643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb58793-ae5e-4b84-9e3f-7080ef5772e6 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:37.035312 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8fe9-034b-4084-86d2-4aaeebafd7cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:37.036135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8fe9-034b-4084-86d2-4aaeebafd7cd service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:37.036436 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8fe9-034b-4084-86d2-4aaeebafd7cd service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:37.036705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8fe9-034b-4084-86d2-4aaeebafd7cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:37.098991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba8fe9-034b-4084-86d2-4aaeebafd7cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:37.100654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba8fe9-034b-4084-86d2-4aaeebafd7cd service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:37.110728 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1230/2446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:44:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:44:39.695316 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479e9ed-02ed-4e29-8311-7bd83d70c30e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:39.696765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b479e9ed-02ed-4e29-8311-7bd83d70c30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:39.714924 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479e9ed-02ed-4e29-8311-7bd83d70c30e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:39.721313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fd91e-e231-4913-9dfb-5a1b7fbe6a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:39.722392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fd91e-e231-4913-9dfb-5a1b7fbe6a4b service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:39.722715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fd91e-e231-4913-9dfb-5a1b7fbe6a4b service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:39.723074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fd91e-e231-4913-9dfb-5a1b7fbe6a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:39.725096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-552fd91e-e231-4913-9dfb-5a1b7fbe6a4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:39.798370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fd91e-e231-4913-9dfb-5a1b7fbe6a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:39.800704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fd91e-e231-4913-9dfb-5a1b7fbe6a4b service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:39.812187 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1217/2447] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:44:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:44:40.784097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b815e-3cda-4279-95b9-a53270073cef None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:40.785036 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b815e-3cda-4279-95b9-a53270073cef None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:40.785561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b815e-3cda-4279-95b9-a53270073cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:40.805416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-541b815e-3cda-4279-95b9-a53270073cef None None] MFA Rules not processed for user `6c3f1618f68f4920aa71db3751b8f96c`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:44:40.806814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-541b815e-3cda-4279-95b9-a53270073cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:40.819323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1231/2448] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:44:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:44:41.039106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fd91e-e231-4913-9dfb-5a1b7fbe6a4b service nova] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:41.055035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fd91e-e231-4913-9dfb-5a1b7fbe6a4b service nova] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:41.070764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c5a7c-3e01-43c2-b3da-ffd2ae041ecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:41.071428 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c5a7c-3e01-43c2-b3da-ffd2ae041ecc service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:41.071712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c5a7c-3e01-43c2-b3da-ffd2ae041ecc service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:41.071989 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c5a7c-3e01-43c2-b3da-ffd2ae041ecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:41.073919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-123c5a7c-3e01-43c2-b3da-ffd2ae041ecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:41.087836 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c5a7c-3e01-43c2-b3da-ffd2ae041ecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:41.089503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c5a7c-3e01-43c2-b3da-ffd2ae041ecc service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:41.105195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1218/2449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:44:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:44:53.682811 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13c073-1090-4eaa-b7dd-e759eb46352e None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:53.683269 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13c073-1090-4eaa-b7dd-e759eb46352e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:53.683360 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13c073-1090-4eaa-b7dd-e759eb46352e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:53.701622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-ee13c073-1090-4eaa-b7dd-e759eb46352e None None] MFA Rules not processed for user `191b52bd64c947fea11740672fc1eda6`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:44:53.702820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ee13c073-1090-4eaa-b7dd-e759eb46352e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:53.757651 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1232/2450] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:44:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:44:53.982636 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c5a7c-3e01-43c2-b3da-ffd2ae041ecc service nova] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:53.984026 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-123c5a7c-3e01-43c2-b3da-ffd2ae041ecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:54.046851 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c5a7c-3e01-43c2-b3da-ffd2ae041ecc service nova] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:54.050404 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6ec9a-6ee9-4947-b6e2-70b7d2be2d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:54.051047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6ec9a-6ee9-4947-b6e2-70b7d2be2d77 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:54.051331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6ec9a-6ee9-4947-b6e2-70b7d2be2d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:54.052160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6ec9a-6ee9-4947-b6e2-70b7d2be2d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:54.054184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a5e6ec9a-6ee9-4947-b6e2-70b7d2be2d77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:54.063393 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6ec9a-6ee9-4947-b6e2-70b7d2be2d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:54.064850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6ec9a-6ee9-4947-b6e2-70b7d2be2d77 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:54.073115 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1219/2451] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:44:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:44:54.710055 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13c073-1090-4eaa-b7dd-e759eb46352e None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:44:54.711525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ee13c073-1090-4eaa-b7dd-e759eb46352e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:54.792328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13c073-1090-4eaa-b7dd-e759eb46352e None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:44:54.797317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf8d5-0ecd-4010-8b20-62352714fa8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13471dce9430484ab46b355d1303f504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:44:54.797996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf8d5-0ecd-4010-8b20-62352714fa8e service placement] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:44:54.798279 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf8d5-0ecd-4010-8b20-62352714fa8e service placement] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:44:54.798553 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bf8d5-0ecd-4010-8b20-62352714fa8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:44:54.800450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-463bf8d5-0ecd-4010-8b20-62352714fa8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:44:54.818048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bf8d5-0ecd-4010-8b20-62352714fa8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:44:54.818048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463bf8d5-0ecd-4010-8b20-62352714fa8e service placement] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:44:54.826021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1233/2452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:44:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:00.047073 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6ec9a-6ee9-4947-b6e2-70b7d2be2d77 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:00.055659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6ec9a-6ee9-4947-b6e2-70b7d2be2d77 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:00.059199 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570df5ae-d4d9-4d9b-b1b9-2714acf890e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:00.059867 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df5ae-d4d9-4d9b-b1b9-2714acf890e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:00.060166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df5ae-d4d9-4d9b-b1b9-2714acf890e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:00.060456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df5ae-d4d9-4d9b-b1b9-2714acf890e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:00.062167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-570df5ae-d4d9-4d9b-b1b9-2714acf890e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:00.071184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570df5ae-d4d9-4d9b-b1b9-2714acf890e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:00.072764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570df5ae-d4d9-4d9b-b1b9-2714acf890e1 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:00.080281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1220/2453] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:05.647431 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf8d5-0ecd-4010-8b20-62352714fa8e service placement] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:05.665274 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bf8d5-0ecd-4010-8b20-62352714fa8e service placement] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:05.678497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d59e-56e2-416c-ad40-4e9016cf78ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:05.679585 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d59e-56e2-416c-ad40-4e9016cf78ad service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:05.680024 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d59e-56e2-416c-ad40-4e9016cf78ad service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:05.680528 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d59e-56e2-416c-ad40-4e9016cf78ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:05.683638 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0135d59e-56e2-416c-ad40-4e9016cf78ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:05.699109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d59e-56e2-416c-ad40-4e9016cf78ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:05.701604 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d59e-56e2-416c-ad40-4e9016cf78ad service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:05.716291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1234/2454] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:06.655892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc443aa-efb7-4819-a1e3-eec8dc32f40f None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:06.656407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc443aa-efb7-4819-a1e3-eec8dc32f40f None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:06.656407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc443aa-efb7-4819-a1e3-eec8dc32f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:06.675196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-8cc443aa-efb7-4819-a1e3-eec8dc32f40f None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:06.676541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8cc443aa-efb7-4819-a1e3-eec8dc32f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:06.748108 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1221/2455] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:45:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:06.762046 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d59e-56e2-416c-ad40-4e9016cf78ad service nova] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:06.768345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0135d59e-56e2-416c-ad40-4e9016cf78ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:06.833834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d59e-56e2-416c-ad40-4e9016cf78ad service nova] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:06.838974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd205d42-1f59-4752-95f3-bdf73aa06059 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:06.839622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd205d42-1f59-4752-95f3-bdf73aa06059 service swift] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:06.839905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd205d42-1f59-4752-95f3-bdf73aa06059 service swift] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:06.840287 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd205d42-1f59-4752-95f3-bdf73aa06059 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:06.848970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd205d42-1f59-4752-95f3-bdf73aa06059 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:06.851300 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd205d42-1f59-4752-95f3-bdf73aa06059 service swift] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:06.863212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1235/2456] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:45:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:45:07.757471 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc443aa-efb7-4819-a1e3-eec8dc32f40f None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:07.774980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc443aa-efb7-4819-a1e3-eec8dc32f40f None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:07.791698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d840da-b433-4762-974f-2bee3f42735c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:07.794487 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d840da-b433-4762-974f-2bee3f42735c service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:07.794838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d840da-b433-4762-974f-2bee3f42735c service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:07.795125 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d840da-b433-4762-974f-2bee3f42735c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:07.800179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-91d840da-b433-4762-974f-2bee3f42735c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:07.831814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d840da-b433-4762-974f-2bee3f42735c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:07.834145 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d840da-b433-4762-974f-2bee3f42735c service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:07.867638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1222/2457] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:14.226026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd205d42-1f59-4752-95f3-bdf73aa06059 service swift] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:14.235321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd205d42-1f59-4752-95f3-bdf73aa06059 service swift] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:14.238890 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd51bd4-8e1c-488c-9578-eebdeb96c879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:14.239552 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd51bd4-8e1c-488c-9578-eebdeb96c879 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:14.239834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd51bd4-8e1c-488c-9578-eebdeb96c879 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:14.240110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd51bd4-8e1c-488c-9578-eebdeb96c879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:14.241869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-bcd51bd4-8e1c-488c-9578-eebdeb96c879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:14.305781 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd51bd4-8e1c-488c-9578-eebdeb96c879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:14.307212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd51bd4-8e1c-488c-9578-eebdeb96c879 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:14.318489 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1236/2458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:45:19.649622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d840da-b433-4762-974f-2bee3f42735c service nova] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:19.651084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-91d840da-b433-4762-974f-2bee3f42735c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:19.667181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d840da-b433-4762-974f-2bee3f42735c service nova] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:19.671950 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0ec47-d7b4-46c1-85c1-7e858674f799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:19.676131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0ec47-d7b4-46c1-85c1-7e858674f799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:19.676131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0ec47-d7b4-46c1-85c1-7e858674f799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:19.676131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0ec47-d7b4-46c1-85c1-7e858674f799 admin admin] PATH_INFO: `/v3/users/fb710b14dbb44ea3b8d8942e89088b17` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:19.676131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0ec47-d7b4-46c1-85c1-7e858674f799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb710b14dbb44ea3b8d8942e89088b17)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:19.676574 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0ec47-d7b4-46c1-85c1-7e858674f799 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:19.856966 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-82a0ec47-d7b4-46c1-85c1-7e858674f799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb710b14dbb44ea3b8d8942e89088b17'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:19.955546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-82a0ec47-d7b4-46c1-85c1-7e858674f799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb710b14dbb44ea3b8d8942e89088b17'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:19.971567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-82a0ec47-d7b4-46c1-85c1-7e858674f799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb710b14dbb44ea3b8d8942e89088b17'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:19.972354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-82a0ec47-d7b4-46c1-85c1-7e858674f799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb710b14dbb44ea3b8d8942e89088b17'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:19.979015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-82a0ec47-d7b4-46c1-85c1-7e858674f799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb710b14dbb44ea3b8d8942e89088b17'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:19.986844 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1223/2459] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:45:19 2022] DELETE /identity/v3/users/fb710b14dbb44ea3b8d8942e89088b17 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:20.386725 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd51bd4-8e1c-488c-9578-eebdeb96c879 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:20.397103 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd51bd4-8e1c-488c-9578-eebdeb96c879 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:20.451854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1d713-0fdc-45b2-aef6-378479fb6fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:20.452754 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d713-0fdc-45b2-aef6-378479fb6fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:20.453029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d713-0fdc-45b2-aef6-378479fb6fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:20.453304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1d713-0fdc-45b2-aef6-378479fb6fe4 admin admin] PATH_INFO: `/v3/projects/59ab38d879c841aeb11a9c18728a251e` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:20.454456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1d713-0fdc-45b2-aef6-378479fb6fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ab38d879c841aeb11a9c18728a251e)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:20.456451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1d713-0fdc-45b2-aef6-378479fb6fe4 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:20.558043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-75b1d713-0fdc-45b2-aef6-378479fb6fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ab38d879c841aeb11a9c18728a251e', 'request_id': 'req-75b1d713-0fdc-45b2-aef6-378479fb6fe4'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:20.563460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-75b1d713-0fdc-45b2-aef6-378479fb6fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ab38d879c841aeb11a9c18728a251e', 'request_id': 'req-75b1d713-0fdc-45b2-aef6-378479fb6fe4'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:20.652332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-75b1d713-0fdc-45b2-aef6-378479fb6fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ab38d879c841aeb11a9c18728a251e', 'request_id': 'req-75b1d713-0fdc-45b2-aef6-378479fb6fe4'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:20.663911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-75b1d713-0fdc-45b2-aef6-378479fb6fe4 admin admin] The token cache is being invalidate because project 59ab38d879c841aeb11a9c18728a251e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:45:20.666102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-75b1d713-0fdc-45b2-aef6-378479fb6fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:20.666753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-75b1d713-0fdc-45b2-aef6-378479fb6fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:20.668431 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1237/2460] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:45:20 2022] DELETE /identity/v3/projects/59ab38d879c841aeb11a9c18728a251e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:20.673510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de626b-db82-4db8-834f-d5ddc17251f2 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:20.674132 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de626b-db82-4db8-834f-d5ddc17251f2 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:20.674132 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de626b-db82-4db8-834f-d5ddc17251f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:20.691910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-14de626b-db82-4db8-834f-d5ddc17251f2 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:20.693182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-14de626b-db82-4db8-834f-d5ddc17251f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:20.750358 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1224/2461] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:20.758495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cf960-5536-4bb2-b01c-ba8805c2ca72 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:20.758833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cf960-5536-4bb2-b01c-ba8805c2ca72 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:20.759113 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cf960-5536-4bb2-b01c-ba8805c2ca72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:20.777462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-491cf960-5536-4bb2-b01c-ba8805c2ca72 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:20.778665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-491cf960-5536-4bb2-b01c-ba8805c2ca72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:20.787204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1238/2462] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:20.791363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de626b-db82-4db8-834f-d5ddc17251f2 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:20.800857 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de626b-db82-4db8-834f-d5ddc17251f2 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:20.805926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1bae1-baf7-4631-b4b1-936ec091e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:20.806564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1bae1-baf7-4631-b4b1-936ec091e3ad admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:20.806864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1bae1-baf7-4631-b4b1-936ec091e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:20.807120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1bae1-baf7-4631-b4b1-936ec091e3ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:20.807831 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1bae1-baf7-4631-b4b1-936ec091e3ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:45:20.808135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1bae1-baf7-4631-b4b1-936ec091e3ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:20.809756 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1bae1-baf7-4631-b4b1-936ec091e3ad admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:20.821350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1225/2463] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:45:20.825440 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cf960-5536-4bb2-b01c-ba8805c2ca72 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:20.834548 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cf960-5536-4bb2-b01c-ba8805c2ca72 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:20.839272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242d8c0-b06a-4913-894e-3395dd9f7122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:20.839969 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242d8c0-b06a-4913-894e-3395dd9f7122 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:20.840289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242d8c0-b06a-4913-894e-3395dd9f7122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:20.840568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242d8c0-b06a-4913-894e-3395dd9f7122 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:20.841265 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242d8c0-b06a-4913-894e-3395dd9f7122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:20.843179 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9242d8c0-b06a-4913-894e-3395dd9f7122 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:20.960188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1239/2464] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:45:20 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:45:20.963825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1bae1-baf7-4631-b4b1-936ec091e3ad admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:20.978978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1bae1-baf7-4631-b4b1-936ec091e3ad admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:21.049616 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282184c1-a19b-45ed-b28a-e8d25ed27688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:21.050288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282184c1-a19b-45ed-b28a-e8d25ed27688 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:21.050573 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282184c1-a19b-45ed-b28a-e8d25ed27688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:21.050847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282184c1-a19b-45ed-b28a-e8d25ed27688 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:21.051590 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282184c1-a19b-45ed-b28a-e8d25ed27688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:21.053820 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282184c1-a19b-45ed-b28a-e8d25ed27688 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:21.188649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1226/2465] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:45:20 2022] POST /identity/v3/users => generated 284 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:45:21.192700 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242d8c0-b06a-4913-894e-3395dd9f7122 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:21.202631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242d8c0-b06a-4913-894e-3395dd9f7122 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:21.207089 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdccf08-d878-4620-a937-0521c1385a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:21.208317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdccf08-d878-4620-a937-0521c1385a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:21.208595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdccf08-d878-4620-a937-0521c1385a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:21.208865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdccf08-d878-4620-a937-0521c1385a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:21.209586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdccf08-d878-4620-a937-0521c1385a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:21.211210 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdccf08-d878-4620-a937-0521c1385a45 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:21.220579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1240/2466] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:45:21.224932 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282184c1-a19b-45ed-b28a-e8d25ed27688 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:21.235082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282184c1-a19b-45ed-b28a-e8d25ed27688 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:21.239875 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d288e5-286e-4a0c-8091-30e42742662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:21.240549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d288e5-286e-4a0c-8091-30e42742662f admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:21.241104 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d288e5-286e-4a0c-8091-30e42742662f admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:21.241387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d288e5-286e-4a0c-8091-30e42742662f admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:21.242140 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d288e5-286e-4a0c-8091-30e42742662f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:21.243827 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d288e5-286e-4a0c-8091-30e42742662f admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:21.253530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1227/2467] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:45:21.257586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdccf08-d878-4620-a937-0521c1385a45 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:21.267656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdccf08-d878-4620-a937-0521c1385a45 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:21.273079 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caba2a6-200c-4990-aa80-3b6bb5bb227e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:21.273958 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caba2a6-200c-4990-aa80-3b6bb5bb227e admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:21.274241 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caba2a6-200c-4990-aa80-3b6bb5bb227e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:21.274521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caba2a6-200c-4990-aa80-3b6bb5bb227e admin admin] PATH_INFO: `/v3/projects/5ed9318b2a124214b065535c7be988bc/users/66cea89878954b97a447a91c9dceb3bc/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:21.289894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caba2a6-200c-4990-aa80-3b6bb5bb227e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed9318b2a124214b065535c7be988bc, user_id=66cea89878954b97a447a91c9dceb3bc, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:21.292601 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caba2a6-200c-4990-aa80-3b6bb5bb227e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:21.355099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1241/2468] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:45:21 2022] PUT /identity/v3/projects/5ed9318b2a124214b065535c7be988bc/users/66cea89878954b97a447a91c9dceb3bc/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:21.366793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f9da7-9cac-43ea-a7c0-64d159624727 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:21.367186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f9da7-9cac-43ea-a7c0-64d159624727 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:21.367526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f9da7-9cac-43ea-a7c0-64d159624727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:21.396704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-456f9da7-9cac-43ea-a7c0-64d159624727 None None] MFA Rules not processed for user `66cea89878954b97a447a91c9dceb3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:21.397995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-456f9da7-9cac-43ea-a7c0-64d159624727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:21.467710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1228/2469] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:21.479576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caba2a6-200c-4990-aa80-3b6bb5bb227e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:21.481696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0caba2a6-200c-4990-aa80-3b6bb5bb227e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:21.543375 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caba2a6-200c-4990-aa80-3b6bb5bb227e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:21.547568 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00cbb4-a2ac-40ff-8d5f-32fe09e4beb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:21.548324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00cbb4-a2ac-40ff-8d5f-32fe09e4beb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:21.548675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00cbb4-a2ac-40ff-8d5f-32fe09e4beb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:21.549019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00cbb4-a2ac-40ff-8d5f-32fe09e4beb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:21.558022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00cbb4-a2ac-40ff-8d5f-32fe09e4beb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:21.559451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00cbb4-a2ac-40ff-8d5f-32fe09e4beb5 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:21.568802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1242/2470] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:25.587135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f9da7-9cac-43ea-a7c0-64d159624727 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:25.588575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-456f9da7-9cac-43ea-a7c0-64d159624727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:25.648503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f9da7-9cac-43ea-a7c0-64d159624727 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:25.651999 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e699d2c-278d-4a46-8b93-e28b6b363079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:25.652678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e699d2c-278d-4a46-8b93-e28b6b363079 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:25.652963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e699d2c-278d-4a46-8b93-e28b6b363079 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:25.653246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e699d2c-278d-4a46-8b93-e28b6b363079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:25.655012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-4e699d2c-278d-4a46-8b93-e28b6b363079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:25.719875 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e699d2c-278d-4a46-8b93-e28b6b363079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:25.721423 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e699d2c-278d-4a46-8b93-e28b6b363079 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:25.731788 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1229/2471] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:30.334799 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793eea6-b659-4353-9319-2cd66e8c22dc None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:30.335286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793eea6-b659-4353-9319-2cd66e8c22dc None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:30.335396 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793eea6-b659-4353-9319-2cd66e8c22dc None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:30.337332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1243/2472] 10.222.0.25 () {54 vars in 921 bytes} [Tue Mar 8 15:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 15:45:30.343147 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7cbc4-3190-4fd7-ad41-f63a86e6e35d None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:30.343672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7cbc4-3190-4fd7-ad41-f63a86e6e35d None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:30.343672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7cbc4-3190-4fd7-ad41-f63a86e6e35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:30.364908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-52f7cbc4-3190-4fd7-ad41-f63a86e6e35d None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:30.364908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-52f7cbc4-3190-4fd7-ad41-f63a86e6e35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:30.437492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1230/2473] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Mar 8 15:45:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:30.449480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793eea6-b659-4353-9319-2cd66e8c22dc None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:30.451234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7793eea6-b659-4353-9319-2cd66e8c22dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:30.508074 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793eea6-b659-4353-9319-2cd66e8c22dc None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:30.512091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04510b1d-d495-4048-a6ce-25461835afd2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f9935443bcc4d34aeb56e5b77a96720', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:30.512750 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04510b1d-d495-4048-a6ce-25461835afd2 service glance] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:30.513030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04510b1d-d495-4048-a6ce-25461835afd2 service glance] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:30.513302 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04510b1d-d495-4048-a6ce-25461835afd2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:30.523227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04510b1d-d495-4048-a6ce-25461835afd2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:30.524736 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04510b1d-d495-4048-a6ce-25461835afd2 service glance] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:30.535133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1244/2474] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:30.802784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5cb49-8124-44f3-b1d1-65257d7953f1 None None] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:30.803088 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5cb49-8124-44f3-b1d1-65257d7953f1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:30.810906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5cb49-8124-44f3-b1d1-65257d7953f1 None None] PATH_INFO: `/` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:30.810906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1231/2475] 10.222.0.25 () {54 vars in 921 bytes} [Tue Mar 8 15:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:45:30.811130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0ac2-ed32-41d2-adb5-7b227c12bba1 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:30.811130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0ac2-ed32-41d2-adb5-7b227c12bba1 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:30.811130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0ac2-ed32-41d2-adb5-7b227c12bba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:30.828817 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-80da0ac2-ed32-41d2-adb5-7b227c12bba1 None None] MFA Rules not processed for user `028d499ea279442d822c6723c367f459`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:30.830019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-80da0ac2-ed32-41d2-adb5-7b227c12bba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:30.837038 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1245/2476] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Mar 8 15:45:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:30.848660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5cb49-8124-44f3-b1d1-65257d7953f1 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:30.859416 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5cb49-8124-44f3-b1d1-65257d7953f1 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:30.863143 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f66a69-f835-41bd-b610-55b629455d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:30.863837 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f66a69-f835-41bd-b610-55b629455d10 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:30.868278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f66a69-f835-41bd-b610-55b629455d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:30.868278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f66a69-f835-41bd-b610-55b629455d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:30.871649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f66a69-f835-41bd-b610-55b629455d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:30.873119 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f66a69-f835-41bd-b610-55b629455d10 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:30.880717 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1232/2477] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:45:30.967981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d080-9a09-4b7f-a8d2-7744f48d1770 None None] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:30.968968 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d080-9a09-4b7f-a8d2-7744f48d1770 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:30.969383 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d080-9a09-4b7f-a8d2-7744f48d1770 None None] PATH_INFO: `/` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:30.973704 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1246/2478] 10.222.0.25 () {54 vars in 921 bytes} [Tue Mar 8 15:45:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 15:45:30.977420 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f8374-9d20-4d12-a68f-142134c412a8 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:30.977757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f8374-9d20-4d12-a68f-142134c412a8 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:30.984189 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f8374-9d20-4d12-a68f-142134c412a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:30.997548 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-bb3f8374-9d20-4d12-a68f-142134c412a8 None None] MFA Rules not processed for user `c4fb404cc61d49d3aaec429f4f9f4f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:30.998734 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-bb3f8374-9d20-4d12-a68f-142134c412a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:31.009181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1233/2479] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Mar 8 15:45:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:31.020303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d080-9a09-4b7f-a8d2-7744f48d1770 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:31.031188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d080-9a09-4b7f-a8d2-7744f48d1770 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:31.035040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288c485-8b1f-46d6-b159-249699004028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:31.039711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288c485-8b1f-46d6-b159-249699004028 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:31.039711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288c485-8b1f-46d6-b159-249699004028 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:31.039711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288c485-8b1f-46d6-b159-249699004028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:31.047791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288c485-8b1f-46d6-b159-249699004028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:31.049270 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288c485-8b1f-46d6-b159-249699004028 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:31.062371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1247/2480] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:33.572932 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d942be-114e-4b85-8bc6-7c67800783c6 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:33.573681 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d942be-114e-4b85-8bc6-7c67800783c6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:33.573681 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d942be-114e-4b85-8bc6-7c67800783c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:33.591808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-31d942be-114e-4b85-8bc6-7c67800783c6 None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:33.594382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-31d942be-114e-4b85-8bc6-7c67800783c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:33.647823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1234/2481] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:45:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:33.661194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288c485-8b1f-46d6-b159-249699004028 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:33.662664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e288c485-8b1f-46d6-b159-249699004028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:33.730264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288c485-8b1f-46d6-b159-249699004028 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:33.735483 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130395b2-1418-44d8-b811-a2ece308834f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:33.736127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130395b2-1418-44d8-b811-a2ece308834f service swift] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:33.736506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130395b2-1418-44d8-b811-a2ece308834f service swift] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:33.736798 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130395b2-1418-44d8-b811-a2ece308834f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:33.745232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130395b2-1418-44d8-b811-a2ece308834f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:33.746908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130395b2-1418-44d8-b811-a2ece308834f service swift] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:33.755209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1248/2482] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:45:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:45:34.572877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d942be-114e-4b85-8bc6-7c67800783c6 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:34.648933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d942be-114e-4b85-8bc6-7c67800783c6 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:34.655522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:34.657457 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:34.658041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:34.658613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] PATH_INFO: `/v3/users/66cea89878954b97a447a91c9dceb3bc` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:34.660178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] RBAC: Authorizing `identity:delete_user(user_id=66cea89878954b97a447a91c9dceb3bc)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:34.662290 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:34.895689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66cea89878954b97a447a91c9dceb3bc'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:34.961235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66cea89878954b97a447a91c9dceb3bc'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:34.976875 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66cea89878954b97a447a91c9dceb3bc'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:34.977785 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66cea89878954b97a447a91c9dceb3bc'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:34.984781 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66cea89878954b97a447a91c9dceb3bc'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:34.990731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1235/2483] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:45:34 2022] DELETE /identity/v3/users/66cea89878954b97a447a91c9dceb3bc => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:34.996367 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afffb7-5442-4bdb-8eb1-07e02ec54e25 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:34.996884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afffb7-5442-4bdb-8eb1-07e02ec54e25 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:34.996994 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afffb7-5442-4bdb-8eb1-07e02ec54e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:35.017573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-e2afffb7-5442-4bdb-8eb1-07e02ec54e25 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:35.018828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e2afffb7-5442-4bdb-8eb1-07e02ec54e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:35.078936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1249/2484] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:35.089057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:35.090495 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:35.158105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0d49d-7ee7-4b92-8a6b-3834b62a429a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:35.162057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9cc64-5b09-4e0a-9c42-b17bde4f2773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:35.162705 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9cc64-5b09-4e0a-9c42-b17bde4f2773 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:35.162989 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9cc64-5b09-4e0a-9c42-b17bde4f2773 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:35.163266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9cc64-5b09-4e0a-9c42-b17bde4f2773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:35.173527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9cc64-5b09-4e0a-9c42-b17bde4f2773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:35.174972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9cc64-5b09-4e0a-9c42-b17bde4f2773 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:35.189841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1236/2485] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:35.665217 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afffb7-5442-4bdb-8eb1-07e02ec54e25 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:35.669338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e2afffb7-5442-4bdb-8eb1-07e02ec54e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:35.679513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afffb7-5442-4bdb-8eb1-07e02ec54e25 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:35.684380 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:35.685237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:35.685580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:35.685874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5 admin admin] PATH_INFO: `/v3/projects/5ed9318b2a124214b065535c7be988bc` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:35.687052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed9318b2a124214b065535c7be988bc)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:35.689495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:35.812338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed9318b2a124214b065535c7be988bc', 'request_id': 'req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:35.818507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed9318b2a124214b065535c7be988bc', 'request_id': 'req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:35.886946 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed9318b2a124214b065535c7be988bc', 'request_id': 'req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:35.898772 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5 admin admin] The token cache is being invalidate because project 5ed9318b2a124214b065535c7be988bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:45:35.899061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:35.904794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bb863bc3-0a61-4b3f-80da-a8379ff7c0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:35.904794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1250/2486] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:45:35 2022] DELETE /identity/v3/projects/5ed9318b2a124214b065535c7be988bc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:35.906952 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e070-7bca-478e-9190-8018d4f55a69 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:35.907425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e070-7bca-478e-9190-8018d4f55a69 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:35.907520 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e070-7bca-478e-9190-8018d4f55a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:35.925275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-8cd8e070-7bca-478e-9190-8018d4f55a69 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:35.926664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8cd8e070-7bca-478e-9190-8018d4f55a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:35.994996 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1237/2487] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:36.002829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654796b-ef4d-4d58-9c46-6a33eb09aa2f None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:36.003321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654796b-ef4d-4d58-9c46-6a33eb09aa2f None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:36.003445 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654796b-ef4d-4d58-9c46-6a33eb09aa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:36.022531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-4654796b-ef4d-4d58-9c46-6a33eb09aa2f None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:36.024109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4654796b-ef4d-4d58-9c46-6a33eb09aa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:36.033889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1251/2488] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:45:36.038139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8e070-7bca-478e-9190-8018d4f55a69 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:36.048917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8e070-7bca-478e-9190-8018d4f55a69 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:36.054732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf77497-7466-464c-a5a6-4329b01567e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:36.055634 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf77497-7466-464c-a5a6-4329b01567e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:36.055921 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf77497-7466-464c-a5a6-4329b01567e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:36.056311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf77497-7466-464c-a5a6-4329b01567e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:36.057172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf77497-7466-464c-a5a6-4329b01567e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:45:36.057482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf77497-7466-464c-a5a6-4329b01567e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:36.059353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf77497-7466-464c-a5a6-4329b01567e4 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:36.071846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1238/2489] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:45:36.076866 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654796b-ef4d-4d58-9c46-6a33eb09aa2f None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:36.086024 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654796b-ef4d-4d58-9c46-6a33eb09aa2f None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:36.090758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75cac6-0100-42ba-b099-76213b955171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:36.091390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75cac6-0100-42ba-b099-76213b955171 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:36.091703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75cac6-0100-42ba-b099-76213b955171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:36.091982 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75cac6-0100-42ba-b099-76213b955171 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:36.092722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75cac6-0100-42ba-b099-76213b955171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:36.094630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75cac6-0100-42ba-b099-76213b955171 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:36.189956 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1252/2490] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:45:36 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:45:36.194098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf77497-7466-464c-a5a6-4329b01567e4 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:36.204532 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf77497-7466-464c-a5a6-4329b01567e4 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:36.265046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e70d7-7309-4c38-b75b-119aae47382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:36.265715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e70d7-7309-4c38-b75b-119aae47382d admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:36.265998 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e70d7-7309-4c38-b75b-119aae47382d admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:36.266274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e70d7-7309-4c38-b75b-119aae47382d admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:36.266959 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e70d7-7309-4c38-b75b-119aae47382d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:36.268936 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e70d7-7309-4c38-b75b-119aae47382d admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:36.386023 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1239/2491] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:45:36 2022] POST /identity/v3/users => generated 282 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:45:36.390479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75cac6-0100-42ba-b099-76213b955171 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:36.404097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75cac6-0100-42ba-b099-76213b955171 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:36.413029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b3192-49f9-4001-a319-0908191f683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:36.414162 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b3192-49f9-4001-a319-0908191f683d admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:36.414779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b3192-49f9-4001-a319-0908191f683d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:36.415304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b3192-49f9-4001-a319-0908191f683d admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:36.416676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b3192-49f9-4001-a319-0908191f683d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:36.419184 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b3192-49f9-4001-a319-0908191f683d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:36.440467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1253/2492] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:45:36.443450 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e70d7-7309-4c38-b75b-119aae47382d admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:36.459438 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e70d7-7309-4c38-b75b-119aae47382d admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:36.464481 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038590b8-7bb3-4366-bfd2-c623d3aa945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:36.465211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038590b8-7bb3-4366-bfd2-c623d3aa945f admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:36.465594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038590b8-7bb3-4366-bfd2-c623d3aa945f admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:36.465933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038590b8-7bb3-4366-bfd2-c623d3aa945f admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:36.466730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038590b8-7bb3-4366-bfd2-c623d3aa945f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:36.468497 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038590b8-7bb3-4366-bfd2-c623d3aa945f admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:36.480188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1240/2493] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:45:36.484310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b3192-49f9-4001-a319-0908191f683d admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:36.496248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b3192-49f9-4001-a319-0908191f683d admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:36.501338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1755212-aab9-4e65-ade6-2324d6eeba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:36.502317 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1755212-aab9-4e65-ade6-2324d6eeba55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:36.502689 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1755212-aab9-4e65-ade6-2324d6eeba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:36.503041 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1755212-aab9-4e65-ade6-2324d6eeba55 admin admin] PATH_INFO: `/v3/projects/257832542dd8494db254f4ba2c2bedeb/users/c5f9fa11490443be95cab8a0dfcef5e9/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:36.519181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1755212-aab9-4e65-ade6-2324d6eeba55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=257832542dd8494db254f4ba2c2bedeb, user_id=c5f9fa11490443be95cab8a0dfcef5e9, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:36.522027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1755212-aab9-4e65-ade6-2324d6eeba55 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:36.616687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1254/2494] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:45:36 2022] PUT /identity/v3/projects/257832542dd8494db254f4ba2c2bedeb/users/c5f9fa11490443be95cab8a0dfcef5e9/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:36.628877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb73d0-2cdf-42d0-a892-e2e733af2332 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:36.629245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb73d0-2cdf-42d0-a892-e2e733af2332 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:36.629630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb73d0-2cdf-42d0-a892-e2e733af2332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:36.658163 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-e1fb73d0-2cdf-42d0-a892-e2e733af2332 None None] MFA Rules not processed for user `c5f9fa11490443be95cab8a0dfcef5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:36.659387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-e1fb73d0-2cdf-42d0-a892-e2e733af2332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:36.766715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1241/2495] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:36.771263 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1755212-aab9-4e65-ade6-2324d6eeba55 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:36.835969 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1755212-aab9-4e65-ade6-2324d6eeba55 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:36.840769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b94d2-4d07-49b1-9a09-65fad082fc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:36.841434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b94d2-4d07-49b1-9a09-65fad082fc80 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:36.841720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b94d2-4d07-49b1-9a09-65fad082fc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:36.842019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b94d2-4d07-49b1-9a09-65fad082fc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:36.842989 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b94d2-4d07-49b1-9a09-65fad082fc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:36.845250 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b94d2-4d07-49b1-9a09-65fad082fc80 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:37.368225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1255/2496] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:45:36 2022] POST /identity/v3/projects => generated 363 bytes in 598 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:45:37.372569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb73d0-2cdf-42d0-a892-e2e733af2332 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:37.383262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb73d0-2cdf-42d0-a892-e2e733af2332 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:37.449228 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d16b-7cbe-49b2-9d06-048875f64ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:37.449819 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d16b-7cbe-49b2-9d06-048875f64ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:37.450107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d16b-7cbe-49b2-9d06-048875f64ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:37.450385 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d16b-7cbe-49b2-9d06-048875f64ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:37.451134 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222d16b-7cbe-49b2-9d06-048875f64ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:37.453110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222d16b-7cbe-49b2-9d06-048875f64ee0 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:37.523843 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1242/2497] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:45:37 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:45:37.525690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b94d2-4d07-49b1-9a09-65fad082fc80 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:37.538833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b94d2-4d07-49b1-9a09-65fad082fc80 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:37.560234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610b04-7187-44f7-b7cc-3d21dc5a68fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:37.560234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610b04-7187-44f7-b7cc-3d21dc5a68fe admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:37.560234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610b04-7187-44f7-b7cc-3d21dc5a68fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:37.560234 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610b04-7187-44f7-b7cc-3d21dc5a68fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:37.560688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23610b04-7187-44f7-b7cc-3d21dc5a68fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:37.560688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23610b04-7187-44f7-b7cc-3d21dc5a68fe admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:37.573876 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1256/2498] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:45:37.577811 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d16b-7cbe-49b2-9d06-048875f64ee0 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:37.588784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d16b-7cbe-49b2-9d06-048875f64ee0 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:37.593995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5656e57-116a-4818-9367-76d87a3ebfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:37.594903 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5656e57-116a-4818-9367-76d87a3ebfbd admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:37.595338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5656e57-116a-4818-9367-76d87a3ebfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:37.595625 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5656e57-116a-4818-9367-76d87a3ebfbd admin admin] PATH_INFO: `/v3/projects/cc2f09d6a92641e9ae6fcfde6b7310b9/users/6de5b6f9882e4a1ab4ea757a5a650e64/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:37.614754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5656e57-116a-4818-9367-76d87a3ebfbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2f09d6a92641e9ae6fcfde6b7310b9, user_id=6de5b6f9882e4a1ab4ea757a5a650e64, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:37.618323 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5656e57-116a-4818-9367-76d87a3ebfbd admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:37.698808 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1243/2499] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:45:37 2022] PUT /identity/v3/projects/cc2f09d6a92641e9ae6fcfde6b7310b9/users/6de5b6f9882e4a1ab4ea757a5a650e64/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:37.703106 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610b04-7187-44f7-b7cc-3d21dc5a68fe admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:37.715582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610b04-7187-44f7-b7cc-3d21dc5a68fe admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:37.905459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9795c-0d35-42c2-8cd0-4674cdc06a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:37.906134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9795c-0d35-42c2-8cd0-4674cdc06a1e admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:37.906420 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9795c-0d35-42c2-8cd0-4674cdc06a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:37.906698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9795c-0d35-42c2-8cd0-4674cdc06a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:37.907428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9795c-0d35-42c2-8cd0-4674cdc06a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:37.909069 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9795c-0d35-42c2-8cd0-4674cdc06a1e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:37.919785 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1257/2500] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:45:37.924013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5656e57-116a-4818-9367-76d87a3ebfbd admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:37.937093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5656e57-116a-4818-9367-76d87a3ebfbd admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:37.942193 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ba6ee-022c-476f-9a1f-b512c3e84d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:37.943225 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ba6ee-022c-476f-9a1f-b512c3e84d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:37.943515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ba6ee-022c-476f-9a1f-b512c3e84d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:37.944293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ba6ee-022c-476f-9a1f-b512c3e84d1b admin admin] PATH_INFO: `/v3/projects/cc2f09d6a92641e9ae6fcfde6b7310b9/users/6de5b6f9882e4a1ab4ea757a5a650e64/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:37.954151 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ba6ee-022c-476f-9a1f-b512c3e84d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2f09d6a92641e9ae6fcfde6b7310b9, user_id=6de5b6f9882e4a1ab4ea757a5a650e64, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:37.957239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ba6ee-022c-476f-9a1f-b512c3e84d1b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:37.969995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1244/2501] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:45:37 2022] PUT /identity/v3/projects/cc2f09d6a92641e9ae6fcfde6b7310b9/users/6de5b6f9882e4a1ab4ea757a5a650e64/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:45:37.980176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c8989-91ef-4baa-88be-6e6621024001 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:37.980470 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c8989-91ef-4baa-88be-6e6621024001 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:37.980746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c8989-91ef-4baa-88be-6e6621024001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:38.006711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-361c8989-91ef-4baa-88be-6e6621024001 None None] MFA Rules not processed for user `6de5b6f9882e4a1ab4ea757a5a650e64`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:38.008552 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-361c8989-91ef-4baa-88be-6e6621024001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:38.079963 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1258/2502] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:38.091273 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ba6ee-022c-476f-9a1f-b512c3e84d1b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:38.099835 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-618ba6ee-022c-476f-9a1f-b512c3e84d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:38.159909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ba6ee-022c-476f-9a1f-b512c3e84d1b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:38.164092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac00af-6657-48d3-af29-36663300c158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:38.164843 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac00af-6657-48d3-af29-36663300c158 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:38.165206 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac00af-6657-48d3-af29-36663300c158 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:38.165493 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac00af-6657-48d3-af29-36663300c158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:38.177668 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac00af-6657-48d3-af29-36663300c158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:38.179142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac00af-6657-48d3-af29-36663300c158 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:38.190559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1245/2503] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:38.733765 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c8989-91ef-4baa-88be-6e6621024001 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:38.795744 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c8989-91ef-4baa-88be-6e6621024001 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:38.800589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:38.802021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:38.802307 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:38.802587 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] PATH_INFO: `/v3/users/c5f9fa11490443be95cab8a0dfcef5e9` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:38.803794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f9fa11490443be95cab8a0dfcef5e9)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:38.805758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:38.973863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f9fa11490443be95cab8a0dfcef5e9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:38.974507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f9fa11490443be95cab8a0dfcef5e9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:39.022316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f9fa11490443be95cab8a0dfcef5e9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:39.028962 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f9fa11490443be95cab8a0dfcef5e9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:39.038665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f9fa11490443be95cab8a0dfcef5e9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:39.059238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1259/2504] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:45:38 2022] DELETE /identity/v3/users/c5f9fa11490443be95cab8a0dfcef5e9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:39.063962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e59c1-dfe3-4890-bc6f-93d995098d8c None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:39.064541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e59c1-dfe3-4890-bc6f-93d995098d8c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:39.064541 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e59c1-dfe3-4890-bc6f-93d995098d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:39.083216 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-770e59c1-dfe3-4890-bc6f-93d995098d8c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:39.084453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-770e59c1-dfe3-4890-bc6f-93d995098d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:39.158648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1246/2505] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:39.168503 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:39.173179 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:39.239698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049276c-c74c-4569-af51-b245d5357a4b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:39.243577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbafd18-56c0-4764-af70-ab584ae15b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:39.245031 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbafd18-56c0-4764-af70-ab584ae15b57 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:39.245326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbafd18-56c0-4764-af70-ab584ae15b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:39.245609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbafd18-56c0-4764-af70-ab584ae15b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:39.255617 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbafd18-56c0-4764-af70-ab584ae15b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:39.257091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbafd18-56c0-4764-af70-ab584ae15b57 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:39.268815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1260/2506] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:39.705594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e59c1-dfe3-4890-bc6f-93d995098d8c None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:39.707155 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-770e59c1-dfe3-4890-bc6f-93d995098d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:39.721942 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e59c1-dfe3-4890-bc6f-93d995098d8c None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:39.727297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:39.728326 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:39.728657 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:39.729015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] PATH_INFO: `/v3/projects/257832542dd8494db254f4ba2c2bedeb` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:39.735584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=257832542dd8494db254f4ba2c2bedeb)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:39.737583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:39.844583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257832542dd8494db254f4ba2c2bedeb', 'request_id': 'req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:39.850830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257832542dd8494db254f4ba2c2bedeb', 'request_id': 'req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:39.858309 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257832542dd8494db254f4ba2c2bedeb', 'request_id': 'req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:39.937478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] The token cache is being invalidate because project 257832542dd8494db254f4ba2c2bedeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:45:39.937829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:39.938485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:39.944757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1247/2507] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:45:39 2022] DELETE /identity/v3/projects/257832542dd8494db254f4ba2c2bedeb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:39.948932 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbafd18-56c0-4764-af70-ab584ae15b57 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:39.959316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbafd18-56c0-4764-af70-ab584ae15b57 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:40.020914 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3d862-c19b-433d-983a-6d51c7de5cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:40.021901 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3d862-c19b-433d-983a-6d51c7de5cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:40.022287 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3d862-c19b-433d-983a-6d51c7de5cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:40.022735 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3d862-c19b-433d-983a-6d51c7de5cf3 admin admin] PATH_INFO: `/v3/users/6de5b6f9882e4a1ab4ea757a5a650e64` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:40.023995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3d862-c19b-433d-983a-6d51c7de5cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de5b6f9882e4a1ab4ea757a5a650e64)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:40.026909 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3d862-c19b-433d-983a-6d51c7de5cf3 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:40.241660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-aff3d862-c19b-433d-983a-6d51c7de5cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de5b6f9882e4a1ab4ea757a5a650e64'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:40.247512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-aff3d862-c19b-433d-983a-6d51c7de5cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de5b6f9882e4a1ab4ea757a5a650e64'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:40.303436 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-aff3d862-c19b-433d-983a-6d51c7de5cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de5b6f9882e4a1ab4ea757a5a650e64'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:40.304058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-aff3d862-c19b-433d-983a-6d51c7de5cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de5b6f9882e4a1ab4ea757a5a650e64'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:40.318947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-aff3d862-c19b-433d-983a-6d51c7de5cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de5b6f9882e4a1ab4ea757a5a650e64'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:40.338093 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1261/2508] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:45:39 2022] DELETE /identity/v3/users/6de5b6f9882e4a1ab4ea757a5a650e64 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:45:40.762660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:40.764164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:40.780977 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f80d2-e0e9-4f67-b86a-477a1624cb35 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:40.858392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1c368-a933-4d00-a78f-a723051cb8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:40.859256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1c368-a933-4d00-a78f-a723051cb8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:40.859565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1c368-a933-4d00-a78f-a723051cb8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:40.859835 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1c368-a933-4d00-a78f-a723051cb8bd admin admin] PATH_INFO: `/v3/projects/cc2f09d6a92641e9ae6fcfde6b7310b9` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:40.861162 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1c368-a933-4d00-a78f-a723051cb8bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2f09d6a92641e9ae6fcfde6b7310b9)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:40.863120 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1c368-a933-4d00-a78f-a723051cb8bd admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:40.972542 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-39c1c368-a933-4d00-a78f-a723051cb8bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2f09d6a92641e9ae6fcfde6b7310b9', 'request_id': 'req-39c1c368-a933-4d00-a78f-a723051cb8bd'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:40.979443 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-39c1c368-a933-4d00-a78f-a723051cb8bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2f09d6a92641e9ae6fcfde6b7310b9', 'request_id': 'req-39c1c368-a933-4d00-a78f-a723051cb8bd'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:40.987361 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-39c1c368-a933-4d00-a78f-a723051cb8bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2f09d6a92641e9ae6fcfde6b7310b9', 'request_id': 'req-39c1c368-a933-4d00-a78f-a723051cb8bd'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:41.062658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-39c1c368-a933-4d00-a78f-a723051cb8bd admin admin] The token cache is being invalidate because project cc2f09d6a92641e9ae6fcfde6b7310b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:45:41.062878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-39c1c368-a933-4d00-a78f-a723051cb8bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:41.063505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-39c1c368-a933-4d00-a78f-a723051cb8bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:41.065089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1248/2509] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:45:40 2022] DELETE /identity/v3/projects/cc2f09d6a92641e9ae6fcfde6b7310b9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:41.070242 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae938eae-b906-484b-91a6-d8708b54ac50 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:41.070807 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae938eae-b906-484b-91a6-d8708b54ac50 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:41.070807 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae938eae-b906-484b-91a6-d8708b54ac50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:41.092416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-ae938eae-b906-484b-91a6-d8708b54ac50 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:41.093931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ae938eae-b906-484b-91a6-d8708b54ac50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:41.164442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1262/2510] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:41.174448 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fcab0-5196-4043-bdd0-31251f6eba12 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:41.174733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fcab0-5196-4043-bdd0-31251f6eba12 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:41.175004 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fcab0-5196-4043-bdd0-31251f6eba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:41.197599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-682fcab0-5196-4043-bdd0-31251f6eba12 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:41.198824 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-682fcab0-5196-4043-bdd0-31251f6eba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:41.207121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1249/2511] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:45:41.211398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae938eae-b906-484b-91a6-d8708b54ac50 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:41.222025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae938eae-b906-484b-91a6-d8708b54ac50 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:41.226879 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d007de-cf0c-4554-b1ca-7ea503c4f927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:41.227531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d007de-cf0c-4554-b1ca-7ea503c4f927 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:41.227811 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d007de-cf0c-4554-b1ca-7ea503c4f927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:41.228086 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d007de-cf0c-4554-b1ca-7ea503c4f927 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:41.229376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d007de-cf0c-4554-b1ca-7ea503c4f927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:45:41.229715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d007de-cf0c-4554-b1ca-7ea503c4f927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:41.231335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d007de-cf0c-4554-b1ca-7ea503c4f927 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:41.243521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1263/2512] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:45:41.247927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fcab0-5196-4043-bdd0-31251f6eba12 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:41.257035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fcab0-5196-4043-bdd0-31251f6eba12 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:41.263105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba979f-c858-44a4-b8c1-21b64c0e4f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:41.263922 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba979f-c858-44a4-b8c1-21b64c0e4f77 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:41.264378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba979f-c858-44a4-b8c1-21b64c0e4f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:41.264664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba979f-c858-44a4-b8c1-21b64c0e4f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:41.265719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba979f-c858-44a4-b8c1-21b64c0e4f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:41.267960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba979f-c858-44a4-b8c1-21b64c0e4f77 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:41.359330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1250/2513] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:45:41 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:45:41.360738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d007de-cf0c-4554-b1ca-7ea503c4f927 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:41.372116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d007de-cf0c-4554-b1ca-7ea503c4f927 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:41.444121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07e1d2-6f83-4520-a82f-bdb59f56371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:41.445258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07e1d2-6f83-4520-a82f-bdb59f56371a admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:41.445615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07e1d2-6f83-4520-a82f-bdb59f56371a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:41.445970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07e1d2-6f83-4520-a82f-bdb59f56371a admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:41.446874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07e1d2-6f83-4520-a82f-bdb59f56371a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:41.452106 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07e1d2-6f83-4520-a82f-bdb59f56371a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:41.581221 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1264/2514] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:45:41 2022] POST /identity/v3/users => generated 282 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:45:41.581840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba979f-c858-44a4-b8c1-21b64c0e4f77 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:41.604243 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba979f-c858-44a4-b8c1-21b64c0e4f77 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:41.609976 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab30160-e98a-48ab-982c-54c6fe39bfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:41.610825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab30160-e98a-48ab-982c-54c6fe39bfcf admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:41.611183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab30160-e98a-48ab-982c-54c6fe39bfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:41.611693 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab30160-e98a-48ab-982c-54c6fe39bfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:41.612904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab30160-e98a-48ab-982c-54c6fe39bfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:41.614816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab30160-e98a-48ab-982c-54c6fe39bfcf admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:41.627380 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1251/2515] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:45:41.631592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07e1d2-6f83-4520-a82f-bdb59f56371a admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:41.647270 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07e1d2-6f83-4520-a82f-bdb59f56371a admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:41.653816 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5543c4b-b783-4f8f-8fda-445c6fd482b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:41.654542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5543c4b-b783-4f8f-8fda-445c6fd482b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:41.654824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5543c4b-b783-4f8f-8fda-445c6fd482b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:41.655103 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5543c4b-b783-4f8f-8fda-445c6fd482b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:41.655833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5543c4b-b783-4f8f-8fda-445c6fd482b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:41.657483 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5543c4b-b783-4f8f-8fda-445c6fd482b5 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:41.670932 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1265/2516] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:45:41.675231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab30160-e98a-48ab-982c-54c6fe39bfcf admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:41.685687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab30160-e98a-48ab-982c-54c6fe39bfcf admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:41.690414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ac928-bd4c-451f-ac3c-c4d10a44c738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:41.691288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ac928-bd4c-451f-ac3c-c4d10a44c738 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:41.691574 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ac928-bd4c-451f-ac3c-c4d10a44c738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:41.691873 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ac928-bd4c-451f-ac3c-c4d10a44c738 admin admin] PATH_INFO: `/v3/projects/63f1e2ba29c54eb9a7a167c902facc6c/users/fe0afba53ccc4b44a8498a562b2d3c1f/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:41.705954 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ac928-bd4c-451f-ac3c-c4d10a44c738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f1e2ba29c54eb9a7a167c902facc6c, user_id=fe0afba53ccc4b44a8498a562b2d3c1f, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:41.708651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ac928-bd4c-451f-ac3c-c4d10a44c738 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:41.807571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1252/2517] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:45:41 2022] PUT /identity/v3/projects/63f1e2ba29c54eb9a7a167c902facc6c/users/fe0afba53ccc4b44a8498a562b2d3c1f/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:45:41.819971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e77769-d889-4deb-a1a7-1a048f1dea6b None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:41.820298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e77769-d889-4deb-a1a7-1a048f1dea6b None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:41.820579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e77769-d889-4deb-a1a7-1a048f1dea6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:41.867720 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-90e77769-d889-4deb-a1a7-1a048f1dea6b None None] MFA Rules not processed for user `fe0afba53ccc4b44a8498a562b2d3c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:41.869033 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-90e77769-d889-4deb-a1a7-1a048f1dea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:41.940935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1266/2518] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:41.945558 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ac928-bd4c-451f-ac3c-c4d10a44c738 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:42.013106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ac928-bd4c-451f-ac3c-c4d10a44c738 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:42.029473 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a335485-bc9a-46a2-9ab4-6fc2f2eb4756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:42.030154 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a335485-bc9a-46a2-9ab4-6fc2f2eb4756 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:42.030439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a335485-bc9a-46a2-9ab4-6fc2f2eb4756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:42.030716 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a335485-bc9a-46a2-9ab4-6fc2f2eb4756 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:42.031421 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a335485-bc9a-46a2-9ab4-6fc2f2eb4756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:42.033382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a335485-bc9a-46a2-9ab4-6fc2f2eb4756 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:42.144738 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1253/2519] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:45:41 2022] POST /identity/v3/projects => generated 363 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:45:42.149533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e77769-d889-4deb-a1a7-1a048f1dea6b None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:42.161106 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e77769-d889-4deb-a1a7-1a048f1dea6b None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:42.225030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d1d72-dbc6-4b99-b5d2-680971b6cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:42.225741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d1d72-dbc6-4b99-b5d2-680971b6cd1b admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:42.226018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d1d72-dbc6-4b99-b5d2-680971b6cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:42.226291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d1d72-dbc6-4b99-b5d2-680971b6cd1b admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:42.226995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d1d72-dbc6-4b99-b5d2-680971b6cd1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:42.229008 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d1d72-dbc6-4b99-b5d2-680971b6cd1b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:42.328809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1267/2520] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:45:42 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:45:42.330333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a335485-bc9a-46a2-9ab4-6fc2f2eb4756 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:42.342127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a335485-bc9a-46a2-9ab4-6fc2f2eb4756 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:42.360452 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8e102-03d9-4baa-b3f0-6c38c5354012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:42.361129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8e102-03d9-4baa-b3f0-6c38c5354012 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:42.361467 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8e102-03d9-4baa-b3f0-6c38c5354012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:42.361845 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8e102-03d9-4baa-b3f0-6c38c5354012 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:42.362582 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8e102-03d9-4baa-b3f0-6c38c5354012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:42.364360 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8e102-03d9-4baa-b3f0-6c38c5354012 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:42.375263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1254/2521] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:45:42.379729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d1d72-dbc6-4b99-b5d2-680971b6cd1b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:42.391741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d1d72-dbc6-4b99-b5d2-680971b6cd1b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:42.443141 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a44ff-3a10-475f-8464-64fe69eb57e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:42.443141 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a44ff-3a10-475f-8464-64fe69eb57e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:42.443141 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a44ff-3a10-475f-8464-64fe69eb57e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:42.443141 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a44ff-3a10-475f-8464-64fe69eb57e0 admin admin] PATH_INFO: `/v3/projects/8f1f7c213de544e9b1584d55096788cf/users/8b1c09f9ca9b46f58f418cac120ad824/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:42.444181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a44ff-3a10-475f-8464-64fe69eb57e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f7c213de544e9b1584d55096788cf, user_id=8b1c09f9ca9b46f58f418cac120ad824, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:42.444181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a44ff-3a10-475f-8464-64fe69eb57e0 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:43.151658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1268/2522] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:45:42 2022] PUT /identity/v3/projects/8f1f7c213de544e9b1584d55096788cf/users/8b1c09f9ca9b46f58f418cac120ad824/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:43.153837 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8e102-03d9-4baa-b3f0-6c38c5354012 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:43.163729 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8e102-03d9-4baa-b3f0-6c38c5354012 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:43.221761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41684e-dc95-4efc-968f-6c2894e91fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:43.222622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41684e-dc95-4efc-968f-6c2894e91fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:43.222742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41684e-dc95-4efc-968f-6c2894e91fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:43.222956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41684e-dc95-4efc-968f-6c2894e91fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:43.223675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41684e-dc95-4efc-968f-6c2894e91fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:43.225314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41684e-dc95-4efc-968f-6c2894e91fb7 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:43.235246 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1255/2523] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:45:43.239493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a44ff-3a10-475f-8464-64fe69eb57e0 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:43.249840 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a44ff-3a10-475f-8464-64fe69eb57e0 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:43.254517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842d3c2-493e-42f8-a765-d4ffe76d012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:43.255327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842d3c2-493e-42f8-a765-d4ffe76d012e admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:43.255608 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842d3c2-493e-42f8-a765-d4ffe76d012e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:43.255884 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842d3c2-493e-42f8-a765-d4ffe76d012e admin admin] PATH_INFO: `/v3/projects/8f1f7c213de544e9b1584d55096788cf/users/8b1c09f9ca9b46f58f418cac120ad824/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:43.257865 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842d3c2-493e-42f8-a765-d4ffe76d012e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f7c213de544e9b1584d55096788cf, user_id=8b1c09f9ca9b46f58f418cac120ad824, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:43.260519 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842d3c2-493e-42f8-a765-d4ffe76d012e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:43.270379 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1269/2524] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:45:43 2022] PUT /identity/v3/projects/8f1f7c213de544e9b1584d55096788cf/users/8b1c09f9ca9b46f58f418cac120ad824/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:43.280869 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d37b9b-b2c9-487d-96f3-f9ed1a3ab9c6 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:43.281165 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d37b9b-b2c9-487d-96f3-f9ed1a3ab9c6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:43.281446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d37b9b-b2c9-487d-96f3-f9ed1a3ab9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:43.307615 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-27d37b9b-b2c9-487d-96f3-f9ed1a3ab9c6 None None] MFA Rules not processed for user `8b1c09f9ca9b46f58f418cac120ad824`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:43.308836 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-27d37b9b-b2c9-487d-96f3-f9ed1a3ab9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:43.373126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1256/2525] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:43 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:43.383914 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842d3c2-493e-42f8-a765-d4ffe76d012e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:43.386166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-3842d3c2-493e-42f8-a765-d4ffe76d012e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:43.442905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842d3c2-493e-42f8-a765-d4ffe76d012e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:43.446639 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a74d01-9484-42b8-a04a-38bdedbd7e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:43.447826 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a74d01-9484-42b8-a04a-38bdedbd7e9c service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:43.448104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a74d01-9484-42b8-a04a-38bdedbd7e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:43.448405 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a74d01-9484-42b8-a04a-38bdedbd7e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:43.457905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a74d01-9484-42b8-a04a-38bdedbd7e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:43.459342 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a74d01-9484-42b8-a04a-38bdedbd7e9c service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:43.470139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1270/2526] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:43 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:43.766392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d37b9b-b2c9-487d-96f3-f9ed1a3ab9c6 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:43.775758 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d37b9b-b2c9-487d-96f3-f9ed1a3ab9c6 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:43.779328 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf39de-6779-4952-a3b5-d4f79e653c1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:43.779955 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf39de-6779-4952-a3b5-d4f79e653c1f service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:43.793050 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf39de-6779-4952-a3b5-d4f79e653c1f service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:43.793050 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf39de-6779-4952-a3b5-d4f79e653c1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:43.843235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf39de-6779-4952-a3b5-d4f79e653c1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:43.844850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf39de-6779-4952-a3b5-d4f79e653c1f service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:43.855095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1257/2527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:43 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:57.050014 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca36df9-bf6d-44d5-a973-28602968ad82 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:57.054348 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca36df9-bf6d-44d5-a973-28602968ad82 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:57.054348 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca36df9-bf6d-44d5-a973-28602968ad82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:57.068944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-dca36df9-bf6d-44d5-a973-28602968ad82 None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:57.070121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-dca36df9-bf6d-44d5-a973-28602968ad82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:57.125598 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1271/2528] 10.222.0.25 () {58 vars in 967 bytes} [Tue Mar 8 15:45:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:57.138812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf39de-6779-4952-a3b5-d4f79e653c1f service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:57.140282 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3dcf39de-6779-4952-a3b5-d4f79e653c1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:57.209203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf39de-6779-4952-a3b5-d4f79e653c1f service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:57.214682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0c546-8eaa-4bac-acc3-728dec926392 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:57.225311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0c546-8eaa-4bac-acc3-728dec926392 service swift] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:57.225311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0c546-8eaa-4bac-acc3-728dec926392 service swift] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:57.225311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0c546-8eaa-4bac-acc3-728dec926392 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:57.225311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0c546-8eaa-4bac-acc3-728dec926392 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:57.225704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0c546-8eaa-4bac-acc3-728dec926392 service swift] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:57.233820 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1258/2529] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:45:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:45:57.870691 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca36df9-bf6d-44d5-a973-28602968ad82 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:57.933666 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca36df9-bf6d-44d5-a973-28602968ad82 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:57.938083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:57.938930 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:57.939209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:57.939482 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] PATH_INFO: `/v3/users/fe0afba53ccc4b44a8498a562b2d3c1f` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:57.940831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe0afba53ccc4b44a8498a562b2d3c1f)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:57.942730 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:58.150378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe0afba53ccc4b44a8498a562b2d3c1f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:58.151012 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe0afba53ccc4b44a8498a562b2d3c1f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:58.222499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe0afba53ccc4b44a8498a562b2d3c1f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:58.223119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe0afba53ccc4b44a8498a562b2d3c1f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:58.235143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe0afba53ccc4b44a8498a562b2d3c1f'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:58.247775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1272/2530] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:45:57 2022] DELETE /identity/v3/users/fe0afba53ccc4b44a8498a562b2d3c1f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:58.252529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff80d3-cdcd-41ee-a0cb-892fe3306931 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:58.256242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff80d3-cdcd-41ee-a0cb-892fe3306931 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:58.256242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff80d3-cdcd-41ee-a0cb-892fe3306931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:58.270433 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ffff80d3-cdcd-41ee-a0cb-892fe3306931 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:45:58.271623 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ffff80d3-cdcd-41ee-a0cb-892fe3306931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:58.328962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1259/2531] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:45:58.338480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:58.339867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:58.394631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fb63a-9110-4520-9052-544b2091f2a3 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:58.398214 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b2cdd-63cf-4b26-963e-74a089387278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:58.398846 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b2cdd-63cf-4b26-963e-74a089387278 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:58.399127 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b2cdd-63cf-4b26-963e-74a089387278 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:58.399402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b2cdd-63cf-4b26-963e-74a089387278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:58.408133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b2cdd-63cf-4b26-963e-74a089387278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:58.409618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b2cdd-63cf-4b26-963e-74a089387278 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:58.419786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1273/2532] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:45:58.817150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff80d3-cdcd-41ee-a0cb-892fe3306931 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:58.818891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ffff80d3-cdcd-41ee-a0cb-892fe3306931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:58.833074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff80d3-cdcd-41ee-a0cb-892fe3306931 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:58.838542 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:58.839499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:58.839855 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:58.840278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] PATH_INFO: `/v3/projects/63f1e2ba29c54eb9a7a167c902facc6c` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:58.841564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f1e2ba29c54eb9a7a167c902facc6c)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:58.843646 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:58.965380 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f1e2ba29c54eb9a7a167c902facc6c', 'request_id': 'req-9adce292-9a6b-4cdc-89ce-667e545cc4a0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:58.970588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f1e2ba29c54eb9a7a167c902facc6c', 'request_id': 'req-9adce292-9a6b-4cdc-89ce-667e545cc4a0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:58.976577 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f1e2ba29c54eb9a7a167c902facc6c', 'request_id': 'req-9adce292-9a6b-4cdc-89ce-667e545cc4a0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:59.056051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] The token cache is being invalidate because project 63f1e2ba29c54eb9a7a167c902facc6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:45:59.056419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:59.057046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:59.058565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1260/2533] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:45:58 2022] DELETE /identity/v3/projects/63f1e2ba29c54eb9a7a167c902facc6c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:59.062673 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b2cdd-63cf-4b26-963e-74a089387278 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:59.072676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b2cdd-63cf-4b26-963e-74a089387278 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:59.128320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eb728-6496-4c1f-b244-456cf88669b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:59.129188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eb728-6496-4c1f-b244-456cf88669b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:59.129466 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eb728-6496-4c1f-b244-456cf88669b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:59.129741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eb728-6496-4c1f-b244-456cf88669b9 admin admin] PATH_INFO: `/v3/users/8b1c09f9ca9b46f58f418cac120ad824` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:59.130924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eb728-6496-4c1f-b244-456cf88669b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1c09f9ca9b46f58f418cac120ad824)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:59.132894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eb728-6496-4c1f-b244-456cf88669b9 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:59.287061 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9f0eb728-6496-4c1f-b244-456cf88669b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1c09f9ca9b46f58f418cac120ad824'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:59.287715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9f0eb728-6496-4c1f-b244-456cf88669b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1c09f9ca9b46f58f418cac120ad824'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:59.342286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9f0eb728-6496-4c1f-b244-456cf88669b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1c09f9ca9b46f58f418cac120ad824'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:59.343071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9f0eb728-6496-4c1f-b244-456cf88669b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1c09f9ca9b46f58f418cac120ad824'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:59.359226 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-9f0eb728-6496-4c1f-b244-456cf88669b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1c09f9ca9b46f58f418cac120ad824'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:59.376272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1274/2534] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:45:59 2022] DELETE /identity/v3/users/8b1c09f9ca9b46f58f418cac120ad824 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:45:59.760077 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:45:59.761930 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:45:59.777414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adce292-9a6b-4cdc-89ce-667e545cc4a0 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:45:59.833997 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b497f-6861-4bf0-aca8-1641749dfbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:45:59.834849 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b497f-6861-4bf0-aca8-1641749dfbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:45:59.835137 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b497f-6861-4bf0-aca8-1641749dfbef admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:45:59.835411 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b497f-6861-4bf0-aca8-1641749dfbef admin admin] PATH_INFO: `/v3/projects/8f1f7c213de544e9b1584d55096788cf` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:45:59.836621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b497f-6861-4bf0-aca8-1641749dfbef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1f7c213de544e9b1584d55096788cf)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:45:59.839082 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b497f-6861-4bf0-aca8-1641749dfbef admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:45:59.940527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-162b497f-6861-4bf0-aca8-1641749dfbef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1f7c213de544e9b1584d55096788cf', 'request_id': 'req-162b497f-6861-4bf0-aca8-1641749dfbef'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:59.945640 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-162b497f-6861-4bf0-aca8-1641749dfbef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1f7c213de544e9b1584d55096788cf', 'request_id': 'req-162b497f-6861-4bf0-aca8-1641749dfbef'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:45:59.952224 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-162b497f-6861-4bf0-aca8-1641749dfbef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1f7c213de544e9b1584d55096788cf', 'request_id': 'req-162b497f-6861-4bf0-aca8-1641749dfbef'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:00.044494 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-162b497f-6861-4bf0-aca8-1641749dfbef admin admin] The token cache is being invalidate because project 8f1f7c213de544e9b1584d55096788cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:00.044786 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-162b497f-6861-4bf0-aca8-1641749dfbef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:00.045408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-162b497f-6861-4bf0-aca8-1641749dfbef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:00.046944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1261/2535] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:45:59 2022] DELETE /identity/v3/projects/8f1f7c213de544e9b1584d55096788cf => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:00.052304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9599e2b-184f-44d8-a089-1054407673b6 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:00.056589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9599e2b-184f-44d8-a089-1054407673b6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:00.056589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9599e2b-184f-44d8-a089-1054407673b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:00.070293 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c9599e2b-184f-44d8-a089-1054407673b6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:00.071600 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c9599e2b-184f-44d8-a089-1054407673b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:00.131701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1275/2536] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:00.141784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076902-447c-4cbb-9914-90dd2093eafd None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:00.142449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076902-447c-4cbb-9914-90dd2093eafd None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:00.142804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076902-447c-4cbb-9914-90dd2093eafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:00.162050 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-75076902-447c-4cbb-9914-90dd2093eafd None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:00.163386 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-75076902-447c-4cbb-9914-90dd2093eafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:00.171501 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1262/2537] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:00.176129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9599e2b-184f-44d8-a089-1054407673b6 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:00.186628 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9599e2b-184f-44d8-a089-1054407673b6 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:00.191414 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9b8fd-64e8-4b48-b27e-51f3d9f17523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:00.192022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9b8fd-64e8-4b48-b27e-51f3d9f17523 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:00.192341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9b8fd-64e8-4b48-b27e-51f3d9f17523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:00.192622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9b8fd-64e8-4b48-b27e-51f3d9f17523 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:00.193355 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9b8fd-64e8-4b48-b27e-51f3d9f17523 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:46:00.193665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9b8fd-64e8-4b48-b27e-51f3d9f17523 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:00.195316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9b8fd-64e8-4b48-b27e-51f3d9f17523 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:00.211397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1276/2538] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:46:00.213000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75076902-447c-4cbb-9914-90dd2093eafd None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:00.222769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75076902-447c-4cbb-9914-90dd2093eafd None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:00.227489 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef48828-fe94-4c69-bd94-71f750a2266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:00.228267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef48828-fe94-4c69-bd94-71f750a2266a admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:00.228548 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef48828-fe94-4c69-bd94-71f750a2266a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:00.228826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef48828-fe94-4c69-bd94-71f750a2266a admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:00.229525 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef48828-fe94-4c69-bd94-71f750a2266a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:00.231482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef48828-fe94-4c69-bd94-71f750a2266a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:00.330050 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1263/2539] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:00 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:00.331376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9b8fd-64e8-4b48-b27e-51f3d9f17523 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:00.342252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9b8fd-64e8-4b48-b27e-51f3d9f17523 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:00.401934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6dff5-92c5-451c-8d5c-ff59c25d6684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:00.402887 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6dff5-92c5-451c-8d5c-ff59c25d6684 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:00.402887 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6dff5-92c5-451c-8d5c-ff59c25d6684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:00.403148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6dff5-92c5-451c-8d5c-ff59c25d6684 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:00.403837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6dff5-92c5-451c-8d5c-ff59c25d6684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:00.405785 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6dff5-92c5-451c-8d5c-ff59c25d6684 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:00.497341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1277/2540] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:00 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:00.501772 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef48828-fe94-4c69-bd94-71f750a2266a admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:00.511903 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef48828-fe94-4c69-bd94-71f750a2266a admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:00.516580 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba28016-1495-4d37-8081-b5781c840da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:00.517963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba28016-1495-4d37-8081-b5781c840da1 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:00.517963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba28016-1495-4d37-8081-b5781c840da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:00.517963 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba28016-1495-4d37-8081-b5781c840da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:00.518640 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba28016-1495-4d37-8081-b5781c840da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:00.520321 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba28016-1495-4d37-8081-b5781c840da1 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:00.530817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1264/2541] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:00.534611 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6dff5-92c5-451c-8d5c-ff59c25d6684 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:00.545084 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6dff5-92c5-451c-8d5c-ff59c25d6684 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:00.549669 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150e7f-a6c3-44ce-8570-c69b27743315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:00.550551 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150e7f-a6c3-44ce-8570-c69b27743315 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:00.550841 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150e7f-a6c3-44ce-8570-c69b27743315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:00.551111 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150e7f-a6c3-44ce-8570-c69b27743315 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:00.551848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150e7f-a6c3-44ce-8570-c69b27743315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:00.553531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150e7f-a6c3-44ce-8570-c69b27743315 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:00.562991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1278/2542] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:00.566871 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba28016-1495-4d37-8081-b5781c840da1 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:00.576978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba28016-1495-4d37-8081-b5781c840da1 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:00.581559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cea41a-720b-4eb8-890e-247c48e70dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:00.582416 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cea41a-720b-4eb8-890e-247c48e70dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:00.582697 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cea41a-720b-4eb8-890e-247c48e70dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:00.582972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cea41a-720b-4eb8-890e-247c48e70dd7 admin admin] PATH_INFO: `/v3/projects/7a97507e3bd74ef79b7333cbbfcc119b/users/2f1ea1021c5e4c89ba6e1e49b1b07f23/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:00.598305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cea41a-720b-4eb8-890e-247c48e70dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a97507e3bd74ef79b7333cbbfcc119b, user_id=2f1ea1021c5e4c89ba6e1e49b1b07f23, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:00.600973 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cea41a-720b-4eb8-890e-247c48e70dd7 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:00.680701 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1265/2543] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:00 2022] PUT /identity/v3/projects/7a97507e3bd74ef79b7333cbbfcc119b/users/2f1ea1021c5e4c89ba6e1e49b1b07f23/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:46:00.692937 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e74b2-b9e3-4247-a8cb-342e9acebac0 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:00.693334 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e74b2-b9e3-4247-a8cb-342e9acebac0 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:00.693685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e74b2-b9e3-4247-a8cb-342e9acebac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:00.721261 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-e01e74b2-b9e3-4247-a8cb-342e9acebac0 None None] MFA Rules not processed for user `2f1ea1021c5e4c89ba6e1e49b1b07f23`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:00.722462 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e01e74b2-b9e3-4247-a8cb-342e9acebac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:00.786564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1279/2544] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:00.790634 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cea41a-720b-4eb8-890e-247c48e70dd7 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:00.849835 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cea41a-720b-4eb8-890e-247c48e70dd7 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:00.854456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0561fc-edfc-4fc2-b740-f680672c1f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:00.855181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0561fc-edfc-4fc2-b740-f680672c1f9b admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:00.855418 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0561fc-edfc-4fc2-b740-f680672c1f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:00.855696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0561fc-edfc-4fc2-b740-f680672c1f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:00.856404 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0561fc-edfc-4fc2-b740-f680672c1f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:00.858319 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0561fc-edfc-4fc2-b740-f680672c1f9b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:00.949546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1266/2545] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:00 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:00.953622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e74b2-b9e3-4247-a8cb-342e9acebac0 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:00.963883 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e74b2-b9e3-4247-a8cb-342e9acebac0 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:01.018845 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c102f-01b1-47a5-bad6-a35a5825d9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:01.019569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c102f-01b1-47a5-bad6-a35a5825d9db admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:01.019848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c102f-01b1-47a5-bad6-a35a5825d9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:01.020120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c102f-01b1-47a5-bad6-a35a5825d9db admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:01.020839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c102f-01b1-47a5-bad6-a35a5825d9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:01.022743 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c102f-01b1-47a5-bad6-a35a5825d9db admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:01.113631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1280/2546] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:00 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:46:01.117340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0561fc-edfc-4fc2-b740-f680672c1f9b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:01.127989 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0561fc-edfc-4fc2-b740-f680672c1f9b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:01.132662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7136de3-f36d-4f22-9cf1-5ba363804206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:01.133305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7136de3-f36d-4f22-9cf1-5ba363804206 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:01.133587 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7136de3-f36d-4f22-9cf1-5ba363804206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:01.133860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7136de3-f36d-4f22-9cf1-5ba363804206 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:01.135181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7136de3-f36d-4f22-9cf1-5ba363804206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:01.136839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7136de3-f36d-4f22-9cf1-5ba363804206 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:01.147108 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1267/2547] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:01.151213 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c102f-01b1-47a5-bad6-a35a5825d9db admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:01.160987 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c102f-01b1-47a5-bad6-a35a5825d9db admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:01.165714 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8b611-7ed3-48b9-89ba-e6bfc9cfb873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:01.166374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8b611-7ed3-48b9-89ba-e6bfc9cfb873 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:01.166642 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8b611-7ed3-48b9-89ba-e6bfc9cfb873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:01.166922 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8b611-7ed3-48b9-89ba-e6bfc9cfb873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:01.167647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8b611-7ed3-48b9-89ba-e6bfc9cfb873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:01.169275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8b611-7ed3-48b9-89ba-e6bfc9cfb873 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:01.178960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1281/2548] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:01.187705 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7136de3-f36d-4f22-9cf1-5ba363804206 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:01.197927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7136de3-f36d-4f22-9cf1-5ba363804206 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:01.202462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc30b9-bbc3-4ae4-bb79-9c0d3219c2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:01.203313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc30b9-bbc3-4ae4-bb79-9c0d3219c2b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:01.203592 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc30b9-bbc3-4ae4-bb79-9c0d3219c2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:01.203869 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc30b9-bbc3-4ae4-bb79-9c0d3219c2b5 admin admin] PATH_INFO: `/v3/projects/c63bbb44c13d4c32b3633ed444de6908/users/91f7c36d467b4b9eacfa172dc5982710/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:01.218039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc30b9-bbc3-4ae4-bb79-9c0d3219c2b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63bbb44c13d4c32b3633ed444de6908, user_id=91f7c36d467b4b9eacfa172dc5982710, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:01.220785 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc30b9-bbc3-4ae4-bb79-9c0d3219c2b5 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:01.302012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1268/2549] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:01 2022] PUT /identity/v3/projects/c63bbb44c13d4c32b3633ed444de6908/users/91f7c36d467b4b9eacfa172dc5982710/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:01.312736 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9b79b-603e-462a-9f07-3d9617fb76a5 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:01.313030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9b79b-603e-462a-9f07-3d9617fb76a5 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:01.313314 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9b79b-603e-462a-9f07-3d9617fb76a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:01.338603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-15e9b79b-603e-462a-9f07-3d9617fb76a5 None None] MFA Rules not processed for user `91f7c36d467b4b9eacfa172dc5982710`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:01.339806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-15e9b79b-603e-462a-9f07-3d9617fb76a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:01.399786 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1282/2550] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:01.404166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc30b9-bbc3-4ae4-bb79-9c0d3219c2b5 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:01.464283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc30b9-bbc3-4ae4-bb79-9c0d3219c2b5 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:01.469126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cb89a-e90e-4232-9364-f3fe330da65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:01.469784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cb89a-e90e-4232-9364-f3fe330da65c admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:01.470068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cb89a-e90e-4232-9364-f3fe330da65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:01.470350 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cb89a-e90e-4232-9364-f3fe330da65c admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:01.471041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cb89a-e90e-4232-9364-f3fe330da65c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:01.472977 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cb89a-e90e-4232-9364-f3fe330da65c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:01.572872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1269/2551] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:01 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:01.579332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9b79b-603e-462a-9f07-3d9617fb76a5 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:01.590717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9b79b-603e-462a-9f07-3d9617fb76a5 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:01.648785 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623570e-90eb-4191-9c7c-8999bf6c954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:01.649576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623570e-90eb-4191-9c7c-8999bf6c954b admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:01.650370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623570e-90eb-4191-9c7c-8999bf6c954b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:01.650645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623570e-90eb-4191-9c7c-8999bf6c954b admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:01.651484 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623570e-90eb-4191-9c7c-8999bf6c954b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:01.653722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623570e-90eb-4191-9c7c-8999bf6c954b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:01.760998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1283/2552] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:01 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:46:01.766382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cb89a-e90e-4232-9364-f3fe330da65c admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:01.777765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cb89a-e90e-4232-9364-f3fe330da65c admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:01.786765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49138645-1a79-477a-acca-28a38f4d3efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:01.786765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49138645-1a79-477a-acca-28a38f4d3efa admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:01.786765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49138645-1a79-477a-acca-28a38f4d3efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:01.786765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49138645-1a79-477a-acca-28a38f4d3efa admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:01.787155 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49138645-1a79-477a-acca-28a38f4d3efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:01.788186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49138645-1a79-477a-acca-28a38f4d3efa admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:01.799641 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1270/2553] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:01.804264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623570e-90eb-4191-9c7c-8999bf6c954b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:01.814539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623570e-90eb-4191-9c7c-8999bf6c954b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:01.819339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05012906-0127-491f-a244-e25c7561789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:01.820266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05012906-0127-491f-a244-e25c7561789d admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:01.820545 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05012906-0127-491f-a244-e25c7561789d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:01.820823 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05012906-0127-491f-a244-e25c7561789d admin admin] PATH_INFO: `/v3/projects/b2d9d7ee352e4f26bf8ed07c7a19533e/users/168873a0d61d4ce79fa2f13731affc2c/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:01.835339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05012906-0127-491f-a244-e25c7561789d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d9d7ee352e4f26bf8ed07c7a19533e, user_id=168873a0d61d4ce79fa2f13731affc2c, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:01.838595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05012906-0127-491f-a244-e25c7561789d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:01.905259 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1284/2554] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:01 2022] PUT /identity/v3/projects/b2d9d7ee352e4f26bf8ed07c7a19533e/users/168873a0d61d4ce79fa2f13731affc2c/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:01.909297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49138645-1a79-477a-acca-28a38f4d3efa admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:01.919721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49138645-1a79-477a-acca-28a38f4d3efa admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:01.985526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90120a2d-b051-49e5-b1e7-0991e04abf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:01.986423 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120a2d-b051-49e5-b1e7-0991e04abf03 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:01.986940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120a2d-b051-49e5-b1e7-0991e04abf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:01.987426 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120a2d-b051-49e5-b1e7-0991e04abf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:01.988428 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90120a2d-b051-49e5-b1e7-0991e04abf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:01.990290 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90120a2d-b051-49e5-b1e7-0991e04abf03 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:02.001875 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1271/2555] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:02.005695 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05012906-0127-491f-a244-e25c7561789d admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:02.018028 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05012906-0127-491f-a244-e25c7561789d admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:02.023249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d9d16-36b2-4fbb-9a1b-c2b1f8560e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:02.024257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d9d16-36b2-4fbb-9a1b-c2b1f8560e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:02.024552 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d9d16-36b2-4fbb-9a1b-c2b1f8560e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:02.025321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d9d16-36b2-4fbb-9a1b-c2b1f8560e54 admin admin] PATH_INFO: `/v3/projects/b2d9d7ee352e4f26bf8ed07c7a19533e/users/168873a0d61d4ce79fa2f13731affc2c/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:02.027750 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d9d16-36b2-4fbb-9a1b-c2b1f8560e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d9d7ee352e4f26bf8ed07c7a19533e, user_id=168873a0d61d4ce79fa2f13731affc2c, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:02.030666 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d9d16-36b2-4fbb-9a1b-c2b1f8560e54 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:02.048139 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1285/2556] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:02 2022] PUT /identity/v3/projects/b2d9d7ee352e4f26bf8ed07c7a19533e/users/168873a0d61d4ce79fa2f13731affc2c/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:46:02.059735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cf600-78be-4fb9-92b7-eacafc6c1e1d None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:02.060304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cf600-78be-4fb9-92b7-eacafc6c1e1d None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:02.060593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cf600-78be-4fb9-92b7-eacafc6c1e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:02.088983 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-2c0cf600-78be-4fb9-92b7-eacafc6c1e1d None None] MFA Rules not processed for user `168873a0d61d4ce79fa2f13731affc2c`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:02.090340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2c0cf600-78be-4fb9-92b7-eacafc6c1e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:02.159972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1272/2557] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:02.172678 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d9d16-36b2-4fbb-9a1b-c2b1f8560e54 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:02.174696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-589d9d16-36b2-4fbb-9a1b-c2b1f8560e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:02.231924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d9d16-36b2-4fbb-9a1b-c2b1f8560e54 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:02.235681 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb18a9b-c4ed-4d9f-811b-e5079bea3255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:02.236355 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb18a9b-c4ed-4d9f-811b-e5079bea3255 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:02.236656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb18a9b-c4ed-4d9f-811b-e5079bea3255 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:02.236933 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb18a9b-c4ed-4d9f-811b-e5079bea3255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:02.246215 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb18a9b-c4ed-4d9f-811b-e5079bea3255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:02.247649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb18a9b-c4ed-4d9f-811b-e5079bea3255 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:02.257309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1286/2558] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:46:03.283389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cf600-78be-4fb9-92b7-eacafc6c1e1d None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:03.293453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cf600-78be-4fb9-92b7-eacafc6c1e1d None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:03.297019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c614446-c49f-42bd-9921-abbbf2e603b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:03.300806 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c614446-c49f-42bd-9921-abbbf2e603b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:03.300806 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c614446-c49f-42bd-9921-abbbf2e603b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:03.300806 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c614446-c49f-42bd-9921-abbbf2e603b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:03.353832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c614446-c49f-42bd-9921-abbbf2e603b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:03.356086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c614446-c49f-42bd-9921-abbbf2e603b6 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:03.368540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1273/2559] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:08.257902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb18a9b-c4ed-4d9f-811b-e5079bea3255 service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:08.259315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5bb18a9b-c4ed-4d9f-811b-e5079bea3255 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:08.270870 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb18a9b-c4ed-4d9f-811b-e5079bea3255 service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:08.274439 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570755b5-d5ce-4726-bb50-188db00e9e3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:08.275057 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570755b5-d5ce-4726-bb50-188db00e9e3d service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:08.275336 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570755b5-d5ce-4726-bb50-188db00e9e3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:08.275606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570755b5-d5ce-4726-bb50-188db00e9e3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:08.330996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570755b5-d5ce-4726-bb50-188db00e9e3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:08.332511 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570755b5-d5ce-4726-bb50-188db00e9e3d service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:08.341771 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1287/2560] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:12.128887 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c614446-c49f-42bd-9921-abbbf2e603b6 service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:12.190027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c614446-c49f-42bd-9921-abbbf2e603b6 service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:12.194864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:12.195720 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:12.195998 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:12.196310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] PATH_INFO: `/v3/users/2f1ea1021c5e4c89ba6e1e49b1b07f23` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:12.199262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1ea1021c5e4c89ba6e1e49b1b07f23)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:12.199452 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:12.406571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1ea1021c5e4c89ba6e1e49b1b07f23'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:12.467515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1ea1021c5e4c89ba6e1e49b1b07f23'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:12.480286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1ea1021c5e4c89ba6e1e49b1b07f23'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:12.481009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1ea1021c5e4c89ba6e1e49b1b07f23'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:12.488898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1ea1021c5e4c89ba6e1e49b1b07f23'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:12.495254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1274/2561] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:12 2022] DELETE /identity/v3/users/2f1ea1021c5e4c89ba6e1e49b1b07f23 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:12.500035 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848e32-2793-4e8d-8ab4-3620889ad595 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:12.500530 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848e32-2793-4e8d-8ab4-3620889ad595 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:12.502432 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848e32-2793-4e8d-8ab4-3620889ad595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:12.517417 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-e8848e32-2793-4e8d-8ab4-3620889ad595 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:12.518612 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e8848e32-2793-4e8d-8ab4-3620889ad595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:12.580729 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1288/2562] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:12.590469 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:12.591945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:12.650042 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4b22c-57b3-4fc8-815c-ffbd53b0f134 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:12.653620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e10d4-9a64-4f86-b412-92f3bab808ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:12.654348 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e10d4-9a64-4f86-b412-92f3bab808ba service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:12.654774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e10d4-9a64-4f86-b412-92f3bab808ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:12.655152 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e10d4-9a64-4f86-b412-92f3bab808ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:12.664330 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e10d4-9a64-4f86-b412-92f3bab808ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:12.665776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e10d4-9a64-4f86-b412-92f3bab808ba service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:12.678586 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1275/2563] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:12.793952 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848e32-2793-4e8d-8ab4-3620889ad595 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:12.795876 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e8848e32-2793-4e8d-8ab4-3620889ad595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:12.808419 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848e32-2793-4e8d-8ab4-3620889ad595 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:12.813716 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:12.814571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:12.820702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:12.820702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] PATH_INFO: `/v3/users/191b52bd64c947fea11740672fc1eda6` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:12.820702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191b52bd64c947fea11740672fc1eda6)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:12.820702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:13.035165 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191b52bd64c947fea11740672fc1eda6'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.035855 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191b52bd64c947fea11740672fc1eda6'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.091445 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e10d4-9a64-4f86-b412-92f3bab808ba service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:13.096022 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-856e10d4-9a64-4f86-b412-92f3bab808ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:13.096434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191b52bd64c947fea11740672fc1eda6'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.097126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191b52bd64c947fea11740672fc1eda6'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.111042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191b52bd64c947fea11740672fc1eda6'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.114224 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e10d4-9a64-4f86-b412-92f3bab808ba service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:13.123561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1289/2564] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:12 2022] DELETE /identity/v3/users/191b52bd64c947fea11740672fc1eda6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:13.126499 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:13.127415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:13.127415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:13.127585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] PATH_INFO: `/v3/projects/7a97507e3bd74ef79b7333cbbfcc119b` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:13.128788 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a97507e3bd74ef79b7333cbbfcc119b)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:13.130898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:13.237095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a97507e3bd74ef79b7333cbbfcc119b', 'request_id': 'req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.245526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a97507e3bd74ef79b7333cbbfcc119b', 'request_id': 'req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.256412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a97507e3bd74ef79b7333cbbfcc119b', 'request_id': 'req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.323706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] The token cache is being invalidate because project 7a97507e3bd74ef79b7333cbbfcc119b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:13.323987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.324626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.326833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1276/2565] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:13 2022] DELETE /identity/v3/projects/7a97507e3bd74ef79b7333cbbfcc119b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:46:13.330812 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:13.332290 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:13.372046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:13.373821 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:13.397658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00522c-6e96-4195-8fa8-dc24e68b9ba4 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:13.441961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ba3d9-33a2-48f8-a17e-5d2d7d921a6f admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:13.446614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:13.447474 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:13.447757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:13.448033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] PATH_INFO: `/v3/projects/2f89d9e4dc2940379c095e284e789ec4` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:13.449311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f89d9e4dc2940379c095e284e789ec4)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:13.451815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:13.453719 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:13.455875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:13.455875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:13.455875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] PATH_INFO: `/v3/users/91f7c36d467b4b9eacfa172dc5982710` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:13.456442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f7c36d467b4b9eacfa172dc5982710)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:13.458363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:13.558314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f89d9e4dc2940379c095e284e789ec4', 'request_id': 'req-18ac94aa-effa-430a-a721-e7ea5b2a52c7'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.564011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f89d9e4dc2940379c095e284e789ec4', 'request_id': 'req-18ac94aa-effa-430a-a721-e7ea5b2a52c7'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.569956 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f89d9e4dc2940379c095e284e789ec4', 'request_id': 'req-18ac94aa-effa-430a-a721-e7ea5b2a52c7'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.612109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f7c36d467b4b9eacfa172dc5982710'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.612791 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f7c36d467b4b9eacfa172dc5982710'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.621268 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] The token cache is being invalidate because project 2f89d9e4dc2940379c095e284e789ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:13.621612 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.622250 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.624365 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1277/2566] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:13 2022] DELETE /identity/v3/projects/2f89d9e4dc2940379c095e284e789ec4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:13.662124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f7c36d467b4b9eacfa172dc5982710'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.662751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f7c36d467b4b9eacfa172dc5982710'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.676383 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f7c36d467b4b9eacfa172dc5982710'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:13.690313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1290/2567] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:13 2022] DELETE /identity/v3/users/91f7c36d467b4b9eacfa172dc5982710 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:14.137150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:14.139292 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:14.202780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac94aa-effa-430a-a721-e7ea5b2a52c7 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:14.256653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:14.257344 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:14.257631 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:14.257910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] PATH_INFO: `/v3/projects/c63bbb44c13d4c32b3633ed444de6908` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:14.259111 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63bbb44c13d4c32b3633ed444de6908)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:14.261096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:14.360886 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63bbb44c13d4c32b3633ed444de6908', 'request_id': 'req-cca2d585-6278-403f-bfff-bf74983daf0d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:14.366098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63bbb44c13d4c32b3633ed444de6908', 'request_id': 'req-cca2d585-6278-403f-bfff-bf74983daf0d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:14.372087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63bbb44c13d4c32b3633ed444de6908', 'request_id': 'req-cca2d585-6278-403f-bfff-bf74983daf0d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:14.426861 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] The token cache is being invalidate because project c63bbb44c13d4c32b3633ed444de6908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:14.427150 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:14.427768 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:14.429355 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1278/2568] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:14 2022] DELETE /identity/v3/projects/c63bbb44c13d4c32b3633ed444de6908 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:14.433382 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:14.434797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:14.447962 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cab789-acfa-49d2-9fcb-4d06873c380c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:14.501443 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b7692-3a4d-4b07-9fe4-76477645836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:14.502378 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b7692-3a4d-4b07-9fe4-76477645836e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:14.502658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b7692-3a4d-4b07-9fe4-76477645836e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:14.502935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b7692-3a4d-4b07-9fe4-76477645836e admin admin] PATH_INFO: `/v3/users/168873a0d61d4ce79fa2f13731affc2c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:14.504108 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b7692-3a4d-4b07-9fe4-76477645836e admin admin] RBAC: Authorizing `identity:delete_user(user_id=168873a0d61d4ce79fa2f13731affc2c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:14.506042 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b7692-3a4d-4b07-9fe4-76477645836e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:14.685336 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-716b7692-3a4d-4b07-9fe4-76477645836e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168873a0d61d4ce79fa2f13731affc2c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:14.686043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-716b7692-3a4d-4b07-9fe4-76477645836e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168873a0d61d4ce79fa2f13731affc2c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:14.769949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-716b7692-3a4d-4b07-9fe4-76477645836e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168873a0d61d4ce79fa2f13731affc2c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:14.770571 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-716b7692-3a4d-4b07-9fe4-76477645836e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168873a0d61d4ce79fa2f13731affc2c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:14.784005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-716b7692-3a4d-4b07-9fe4-76477645836e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168873a0d61d4ce79fa2f13731affc2c'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:14.795868 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1291/2569] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:14 2022] DELETE /identity/v3/users/168873a0d61d4ce79fa2f13731affc2c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:15.143673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:15.145301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:15.158453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2d585-6278-403f-bfff-bf74983daf0d admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:15.214457 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6103d-62f2-410a-9fb7-458ed9ef0e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:15.215243 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6103d-62f2-410a-9fb7-458ed9ef0e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:15.215527 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6103d-62f2-410a-9fb7-458ed9ef0e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:15.215807 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6103d-62f2-410a-9fb7-458ed9ef0e64 admin admin] PATH_INFO: `/v3/projects/b2d9d7ee352e4f26bf8ed07c7a19533e` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:15.217031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6103d-62f2-410a-9fb7-458ed9ef0e64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d9d7ee352e4f26bf8ed07c7a19533e)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:15.218932 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6103d-62f2-410a-9fb7-458ed9ef0e64 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:15.313024 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60d6103d-62f2-410a-9fb7-458ed9ef0e64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d9d7ee352e4f26bf8ed07c7a19533e', 'request_id': 'req-60d6103d-62f2-410a-9fb7-458ed9ef0e64'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:15.318252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60d6103d-62f2-410a-9fb7-458ed9ef0e64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d9d7ee352e4f26bf8ed07c7a19533e', 'request_id': 'req-60d6103d-62f2-410a-9fb7-458ed9ef0e64'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:15.324106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60d6103d-62f2-410a-9fb7-458ed9ef0e64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d9d7ee352e4f26bf8ed07c7a19533e', 'request_id': 'req-60d6103d-62f2-410a-9fb7-458ed9ef0e64'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:15.403233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60d6103d-62f2-410a-9fb7-458ed9ef0e64 admin admin] The token cache is being invalidate because project b2d9d7ee352e4f26bf8ed07c7a19533e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:15.403523 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60d6103d-62f2-410a-9fb7-458ed9ef0e64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:15.404128 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60d6103d-62f2-410a-9fb7-458ed9ef0e64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:15.405671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1279/2570] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:15 2022] DELETE /identity/v3/projects/b2d9d7ee352e4f26bf8ed07c7a19533e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:15.411518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3400b2b-55a4-4458-9dc1-ce883e978ecf None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:15.411836 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3400b2b-55a4-4458-9dc1-ce883e978ecf None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:15.412104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3400b2b-55a4-4458-9dc1-ce883e978ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:15.430636 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-d3400b2b-55a4-4458-9dc1-ce883e978ecf None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:15.432211 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d3400b2b-55a4-4458-9dc1-ce883e978ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:15.489091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1292/2571] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:15.497386 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbab6d-c70e-4d69-a6b9-d1da16e7a085 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:15.498262 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbab6d-c70e-4d69-a6b9-d1da16e7a085 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:15.498580 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbab6d-c70e-4d69-a6b9-d1da16e7a085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:15.516110 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-03fbab6d-c70e-4d69-a6b9-d1da16e7a085 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:15.517301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-03fbab6d-c70e-4d69-a6b9-d1da16e7a085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:15.525003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1280/2572] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:15.528900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3400b2b-55a4-4458-9dc1-ce883e978ecf None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:15.538116 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3400b2b-55a4-4458-9dc1-ce883e978ecf None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:15.542590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435aa285-530a-4975-a04c-91b7406d2516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:15.543237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aa285-530a-4975-a04c-91b7406d2516 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:15.543498 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aa285-530a-4975-a04c-91b7406d2516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:15.543770 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aa285-530a-4975-a04c-91b7406d2516 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:15.545025 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435aa285-530a-4975-a04c-91b7406d2516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:46:15.545331 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435aa285-530a-4975-a04c-91b7406d2516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:15.546903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435aa285-530a-4975-a04c-91b7406d2516 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:15.557990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1293/2573] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:46:15.562481 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbab6d-c70e-4d69-a6b9-d1da16e7a085 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:15.571214 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbab6d-c70e-4d69-a6b9-d1da16e7a085 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:15.575779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77073356-3cdb-40a8-b611-51f63fb6bc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:15.577032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77073356-3cdb-40a8-b611-51f63fb6bc42 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:15.577317 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77073356-3cdb-40a8-b611-51f63fb6bc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:15.577596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77073356-3cdb-40a8-b611-51f63fb6bc42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:15.578271 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77073356-3cdb-40a8-b611-51f63fb6bc42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:15.580167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77073356-3cdb-40a8-b611-51f63fb6bc42 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:15.674456 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1281/2574] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:15 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:15.678757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435aa285-530a-4975-a04c-91b7406d2516 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:15.688727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435aa285-530a-4975-a04c-91b7406d2516 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:15.743910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236622c-22c1-4479-a543-a91ed87bc0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:15.744533 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236622c-22c1-4479-a543-a91ed87bc0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:15.744820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236622c-22c1-4479-a543-a91ed87bc0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:15.745151 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236622c-22c1-4479-a543-a91ed87bc0b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:15.745856 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236622c-22c1-4479-a543-a91ed87bc0b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:15.747888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236622c-22c1-4479-a543-a91ed87bc0b5 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:15.861204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1294/2575] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:15 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:46:15.865332 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77073356-3cdb-40a8-b611-51f63fb6bc42 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:15.876035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77073356-3cdb-40a8-b611-51f63fb6bc42 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:15.880677 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c3557-0516-4e9d-a63e-278288b3f277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:15.881325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c3557-0516-4e9d-a63e-278288b3f277 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:15.881607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c3557-0516-4e9d-a63e-278288b3f277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:15.881918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c3557-0516-4e9d-a63e-278288b3f277 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:15.882657 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c3557-0516-4e9d-a63e-278288b3f277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:15.884308 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c3557-0516-4e9d-a63e-278288b3f277 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:15.894940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1282/2576] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:15.898761 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236622c-22c1-4479-a543-a91ed87bc0b5 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:15.908434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236622c-22c1-4479-a543-a91ed87bc0b5 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:15.913047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa603da-6f19-484d-9608-b56cc538f3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:15.913688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa603da-6f19-484d-9608-b56cc538f3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:15.913972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa603da-6f19-484d-9608-b56cc538f3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:15.914252 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa603da-6f19-484d-9608-b56cc538f3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:15.914968 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa603da-6f19-484d-9608-b56cc538f3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:15.916589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa603da-6f19-484d-9608-b56cc538f3f1 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:15.926246 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1295/2577] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:15.930033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c3557-0516-4e9d-a63e-278288b3f277 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:15.940337 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c3557-0516-4e9d-a63e-278288b3f277 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:15.944935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4480a5-c777-4c73-aef8-d4bf0795b406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:15.945831 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4480a5-c777-4c73-aef8-d4bf0795b406 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:15.946118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4480a5-c777-4c73-aef8-d4bf0795b406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:15.946397 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4480a5-c777-4c73-aef8-d4bf0795b406 admin admin] PATH_INFO: `/v3/projects/4def4a05327b4d1d8a8e7bc8087b2a3e/users/6486b38c2ce34fca987222b88269be26/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:15.961204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4480a5-c777-4c73-aef8-d4bf0795b406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4def4a05327b4d1d8a8e7bc8087b2a3e, user_id=6486b38c2ce34fca987222b88269be26, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:15.963826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4480a5-c777-4c73-aef8-d4bf0795b406 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:16.038865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1283/2578] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:15 2022] PUT /identity/v3/projects/4def4a05327b4d1d8a8e7bc8087b2a3e/users/6486b38c2ce34fca987222b88269be26/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:16.051486 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ee1bb-f53b-48da-a76e-4f454b580cb7 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:16.051777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ee1bb-f53b-48da-a76e-4f454b580cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:16.052055 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ee1bb-f53b-48da-a76e-4f454b580cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:16.079053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b02ee1bb-f53b-48da-a76e-4f454b580cb7 None None] MFA Rules not processed for user `6486b38c2ce34fca987222b88269be26`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:16.080357 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b02ee1bb-f53b-48da-a76e-4f454b580cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:16.141671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1296/2579] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:16.146167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4480a5-c777-4c73-aef8-d4bf0795b406 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:16.205759 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4480a5-c777-4c73-aef8-d4bf0795b406 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:16.210352 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b91633-1754-473e-af78-6c7caacaf5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:16.210994 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91633-1754-473e-af78-6c7caacaf5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:16.211276 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91633-1754-473e-af78-6c7caacaf5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:16.211545 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91633-1754-473e-af78-6c7caacaf5c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:16.212248 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b91633-1754-473e-af78-6c7caacaf5c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:16.214143 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b91633-1754-473e-af78-6c7caacaf5c6 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:16.291585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1284/2580] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:16 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:16.295857 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ee1bb-f53b-48da-a76e-4f454b580cb7 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:16.307417 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ee1bb-f53b-48da-a76e-4f454b580cb7 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:16.361616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe9514-ff85-49f0-8c5d-dbf9affed9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:16.362539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9514-ff85-49f0-8c5d-dbf9affed9aa admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:16.362539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9514-ff85-49f0-8c5d-dbf9affed9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:16.362896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9514-ff85-49f0-8c5d-dbf9affed9aa admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:16.363582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe9514-ff85-49f0-8c5d-dbf9affed9aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:16.365539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe9514-ff85-49f0-8c5d-dbf9affed9aa admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:16.449839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1297/2581] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:16 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:16.453959 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b91633-1754-473e-af78-6c7caacaf5c6 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:16.464118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b91633-1754-473e-af78-6c7caacaf5c6 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:16.468744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5b898-e1cd-449b-83c5-a7b778ac3539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:16.469380 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b898-e1cd-449b-83c5-a7b778ac3539 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:16.469659 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b898-e1cd-449b-83c5-a7b778ac3539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:16.469933 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b898-e1cd-449b-83c5-a7b778ac3539 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:16.470642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5b898-e1cd-449b-83c5-a7b778ac3539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:16.472303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5b898-e1cd-449b-83c5-a7b778ac3539 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:16.481871 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1285/2582] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:46:16.486456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe9514-ff85-49f0-8c5d-dbf9affed9aa admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:16.496318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe9514-ff85-49f0-8c5d-dbf9affed9aa admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:16.501663 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec6f40-9ca4-4d47-9e56-1fc02fd79823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:16.502529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec6f40-9ca4-4d47-9e56-1fc02fd79823 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:16.502815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec6f40-9ca4-4d47-9e56-1fc02fd79823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:16.503090 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec6f40-9ca4-4d47-9e56-1fc02fd79823 admin admin] PATH_INFO: `/v3/projects/e2d99bc823ea44a88a7abc003d97d6f9/users/b56adf4ea53444d6ad84527787932d0c/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:16.517138 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec6f40-9ca4-4d47-9e56-1fc02fd79823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d99bc823ea44a88a7abc003d97d6f9, user_id=b56adf4ea53444d6ad84527787932d0c, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:16.519790 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec6f40-9ca4-4d47-9e56-1fc02fd79823 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:16.569861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1298/2583] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:16 2022] PUT /identity/v3/projects/e2d99bc823ea44a88a7abc003d97d6f9/users/b56adf4ea53444d6ad84527787932d0c/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:46:16.574323 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5b898-e1cd-449b-83c5-a7b778ac3539 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:16.584301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5b898-e1cd-449b-83c5-a7b778ac3539 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:16.637642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4398e-d761-4188-a203-f469e4ecd998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:16.638291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4398e-d761-4188-a203-f469e4ecd998 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:16.638575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4398e-d761-4188-a203-f469e4ecd998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:16.638850 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4398e-d761-4188-a203-f469e4ecd998 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:16.639555 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4398e-d761-4188-a203-f469e4ecd998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:16.641174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4398e-d761-4188-a203-f469e4ecd998 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:16.650450 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1286/2584] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:16.655090 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec6f40-9ca4-4d47-9e56-1fc02fd79823 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:16.665119 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec6f40-9ca4-4d47-9e56-1fc02fd79823 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:16.670286 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8606fa1-b431-4df9-bfc0-358b54fe07bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:16.671149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8606fa1-b431-4df9-bfc0-358b54fe07bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:16.671431 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8606fa1-b431-4df9-bfc0-358b54fe07bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:16.671702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8606fa1-b431-4df9-bfc0-358b54fe07bb admin admin] PATH_INFO: `/v3/projects/e2d99bc823ea44a88a7abc003d97d6f9/users/b56adf4ea53444d6ad84527787932d0c/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:16.673694 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8606fa1-b431-4df9-bfc0-358b54fe07bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d99bc823ea44a88a7abc003d97d6f9, user_id=b56adf4ea53444d6ad84527787932d0c, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:16.676613 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8606fa1-b431-4df9-bfc0-358b54fe07bb admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:16.686354 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1299/2585] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:16 2022] PUT /identity/v3/projects/e2d99bc823ea44a88a7abc003d97d6f9/users/b56adf4ea53444d6ad84527787932d0c/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:16.696125 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46fff3-47ed-47db-8aa0-875ee9898932 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:16.696531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46fff3-47ed-47db-8aa0-875ee9898932 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:16.696814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46fff3-47ed-47db-8aa0-875ee9898932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:16.722610 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7c46fff3-47ed-47db-8aa0-875ee9898932 None None] MFA Rules not processed for user `b56adf4ea53444d6ad84527787932d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:16.723797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7c46fff3-47ed-47db-8aa0-875ee9898932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:16.788961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1287/2586] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:16.800492 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8606fa1-b431-4df9-bfc0-358b54fe07bb admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:16.802228 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c8606fa1-b431-4df9-bfc0-358b54fe07bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:16.858324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8606fa1-b431-4df9-bfc0-358b54fe07bb admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:16.861892 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6ee54-458c-4c76-a27c-98612a0ee75f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:16.862519 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6ee54-458c-4c76-a27c-98612a0ee75f service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:16.862800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6ee54-458c-4c76-a27c-98612a0ee75f service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:16.863077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6ee54-458c-4c76-a27c-98612a0ee75f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:16.871738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6ee54-458c-4c76-a27c-98612a0ee75f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:16.873296 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6ee54-458c-4c76-a27c-98612a0ee75f service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:16.882430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1300/2587] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:17.384647 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46fff3-47ed-47db-8aa0-875ee9898932 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:17.445043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46fff3-47ed-47db-8aa0-875ee9898932 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:17.449652 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:17.450518 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:17.451392 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:17.451668 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] PATH_INFO: `/v3/users/6486b38c2ce34fca987222b88269be26` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:17.452891 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6486b38c2ce34fca987222b88269be26)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:17.454803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:17.582770 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6486b38c2ce34fca987222b88269be26'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:17.632553 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6486b38c2ce34fca987222b88269be26'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:17.644925 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6486b38c2ce34fca987222b88269be26'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:17.650329 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6486b38c2ce34fca987222b88269be26'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:17.652068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6486b38c2ce34fca987222b88269be26'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:17.657778 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1288/2588] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:17 2022] DELETE /identity/v3/users/6486b38c2ce34fca987222b88269be26 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:17.662194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd613-bd52-4abf-9c69-8e4652e46766 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:17.662483 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd613-bd52-4abf-9c69-8e4652e46766 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:17.662765 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd613-bd52-4abf-9c69-8e4652e46766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:17.679904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a94cd613-bd52-4abf-9c69-8e4652e46766 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:17.681129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a94cd613-bd52-4abf-9c69-8e4652e46766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:17.736975 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1301/2589] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:46:17.746531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:17.748496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:17.803673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e079db1-0016-4404-a7d6-ff83a79375fd admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:17.807497 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbdd4e-49c5-4457-bbbc-f180b438a29a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:17.808225 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbdd4e-49c5-4457-bbbc-f180b438a29a service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:17.808509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbdd4e-49c5-4457-bbbc-f180b438a29a service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:17.808782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbdd4e-49c5-4457-bbbc-f180b438a29a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:17.818239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbdd4e-49c5-4457-bbbc-f180b438a29a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:17.819667 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbdd4e-49c5-4457-bbbc-f180b438a29a service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:17.828864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1289/2590] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:18.183169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cd613-bd52-4abf-9c69-8e4652e46766 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:18.186026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a94cd613-bd52-4abf-9c69-8e4652e46766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:18.199428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cd613-bd52-4abf-9c69-8e4652e46766 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:18.204996 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:18.205971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:18.206418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:18.206797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] PATH_INFO: `/v3/projects/4def4a05327b4d1d8a8e7bc8087b2a3e` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:18.208268 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4def4a05327b4d1d8a8e7bc8087b2a3e)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:18.210660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:18.306852 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4def4a05327b4d1d8a8e7bc8087b2a3e', 'request_id': 'req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:18.312805 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4def4a05327b4d1d8a8e7bc8087b2a3e', 'request_id': 'req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:18.369514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4def4a05327b4d1d8a8e7bc8087b2a3e', 'request_id': 'req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:18.381209 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] The token cache is being invalidate because project 4def4a05327b4d1d8a8e7bc8087b2a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:18.381496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:18.382123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:18.383639 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1302/2591] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:18 2022] DELETE /identity/v3/projects/4def4a05327b4d1d8a8e7bc8087b2a3e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:18.387638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbdd4e-49c5-4457-bbbc-f180b438a29a service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:18.397865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbdd4e-49c5-4457-bbbc-f180b438a29a service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:18.452315 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8993e2-eab1-466d-a9f7-bb67d0f48110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:18.453105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8993e2-eab1-466d-a9f7-bb67d0f48110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:18.453415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8993e2-eab1-466d-a9f7-bb67d0f48110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:18.453694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8993e2-eab1-466d-a9f7-bb67d0f48110 admin admin] PATH_INFO: `/v3/users/b56adf4ea53444d6ad84527787932d0c` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:18.454883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8993e2-eab1-466d-a9f7-bb67d0f48110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56adf4ea53444d6ad84527787932d0c)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:18.456880 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8993e2-eab1-466d-a9f7-bb67d0f48110 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:18.639724 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ac8993e2-eab1-466d-a9f7-bb67d0f48110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56adf4ea53444d6ad84527787932d0c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:18.724265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ac8993e2-eab1-466d-a9f7-bb67d0f48110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56adf4ea53444d6ad84527787932d0c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:18.736670 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ac8993e2-eab1-466d-a9f7-bb67d0f48110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56adf4ea53444d6ad84527787932d0c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:18.737297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ac8993e2-eab1-466d-a9f7-bb67d0f48110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56adf4ea53444d6ad84527787932d0c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:18.743924 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ac8993e2-eab1-466d-a9f7-bb67d0f48110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56adf4ea53444d6ad84527787932d0c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:18.750472 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1290/2592] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:18 2022] DELETE /identity/v3/users/b56adf4ea53444d6ad84527787932d0c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:19.160481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:19.161902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:19.180108 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7ebe3-31a4-41cc-bdbd-254fe24dc461 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:19.233546 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0b1c4-031b-4230-a7ef-83851f49c5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:19.234403 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0b1c4-031b-4230-a7ef-83851f49c5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:19.234684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0b1c4-031b-4230-a7ef-83851f49c5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:19.234957 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0b1c4-031b-4230-a7ef-83851f49c5c9 admin admin] PATH_INFO: `/v3/projects/e2d99bc823ea44a88a7abc003d97d6f9` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:19.236136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0b1c4-031b-4230-a7ef-83851f49c5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d99bc823ea44a88a7abc003d97d6f9)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:19.238063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0b1c4-031b-4230-a7ef-83851f49c5c9 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:19.363285 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32e0b1c4-031b-4230-a7ef-83851f49c5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d99bc823ea44a88a7abc003d97d6f9', 'request_id': 'req-32e0b1c4-031b-4230-a7ef-83851f49c5c9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:19.368418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32e0b1c4-031b-4230-a7ef-83851f49c5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d99bc823ea44a88a7abc003d97d6f9', 'request_id': 'req-32e0b1c4-031b-4230-a7ef-83851f49c5c9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:19.444059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32e0b1c4-031b-4230-a7ef-83851f49c5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d99bc823ea44a88a7abc003d97d6f9', 'request_id': 'req-32e0b1c4-031b-4230-a7ef-83851f49c5c9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:19.455606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32e0b1c4-031b-4230-a7ef-83851f49c5c9 admin admin] The token cache is being invalidate because project e2d99bc823ea44a88a7abc003d97d6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:19.455894 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32e0b1c4-031b-4230-a7ef-83851f49c5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:19.456549 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-32e0b1c4-031b-4230-a7ef-83851f49c5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:19.458051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1303/2593] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:19 2022] DELETE /identity/v3/projects/e2d99bc823ea44a88a7abc003d97d6f9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:19.462883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a437cd1-4358-426f-87f7-68dffb9418dc None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:19.463370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a437cd1-4358-426f-87f7-68dffb9418dc None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:19.463469 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a437cd1-4358-426f-87f7-68dffb9418dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:19.481428 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-9a437cd1-4358-426f-87f7-68dffb9418dc None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:19.482669 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9a437cd1-4358-426f-87f7-68dffb9418dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:19.539059 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1291/2594] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:19.547284 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999bf5b-770f-4544-8128-c9515a3467b1 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:19.547578 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999bf5b-770f-4544-8128-c9515a3467b1 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:19.547858 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999bf5b-770f-4544-8128-c9515a3467b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:19.566337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-6999bf5b-770f-4544-8128-c9515a3467b1 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:19.567524 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-6999bf5b-770f-4544-8128-c9515a3467b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:19.575267 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1304/2595] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:46:19.579231 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a437cd1-4358-426f-87f7-68dffb9418dc None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:19.588558 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a437cd1-4358-426f-87f7-68dffb9418dc None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:19.593585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011e87e-4e3d-412f-8b7e-d0666fc9974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:19.594180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011e87e-4e3d-412f-8b7e-d0666fc9974b admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:19.594460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011e87e-4e3d-412f-8b7e-d0666fc9974b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:19.594732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011e87e-4e3d-412f-8b7e-d0666fc9974b admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:19.595442 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011e87e-4e3d-412f-8b7e-d0666fc9974b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:46:19.595746 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011e87e-4e3d-412f-8b7e-d0666fc9974b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:19.597388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011e87e-4e3d-412f-8b7e-d0666fc9974b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:19.609290 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1292/2596] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:46:19.613496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999bf5b-770f-4544-8128-c9515a3467b1 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:19.622763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999bf5b-770f-4544-8128-c9515a3467b1 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:19.627453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c3746-669d-4179-a98d-8b017cf6292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:19.628098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c3746-669d-4179-a98d-8b017cf6292f admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:19.628427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c3746-669d-4179-a98d-8b017cf6292f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:19.628705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c3746-669d-4179-a98d-8b017cf6292f admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:19.629402 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c3746-669d-4179-a98d-8b017cf6292f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:19.631291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c3746-669d-4179-a98d-8b017cf6292f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:19.701858 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1305/2597] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:19 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:19.706139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011e87e-4e3d-412f-8b7e-d0666fc9974b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:19.716000 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011e87e-4e3d-412f-8b7e-d0666fc9974b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:19.769591 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b23e9b-4388-49a0-972d-68ad6e181891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:19.770252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b23e9b-4388-49a0-972d-68ad6e181891 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:19.770534 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b23e9b-4388-49a0-972d-68ad6e181891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:19.770840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b23e9b-4388-49a0-972d-68ad6e181891 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:19.771529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b23e9b-4388-49a0-972d-68ad6e181891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:19.773492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b23e9b-4388-49a0-972d-68ad6e181891 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:19.838089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1293/2598] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:19 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:19.842800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c3746-669d-4179-a98d-8b017cf6292f admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:19.853123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c3746-669d-4179-a98d-8b017cf6292f admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:19.858420 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2000b0f-403d-4ebe-b986-0a28df853198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:19.859072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2000b0f-403d-4ebe-b986-0a28df853198 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:19.859353 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2000b0f-403d-4ebe-b986-0a28df853198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:19.859629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2000b0f-403d-4ebe-b986-0a28df853198 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:19.860392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2000b0f-403d-4ebe-b986-0a28df853198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:19.861992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2000b0f-403d-4ebe-b986-0a28df853198 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:19.872226 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1306/2599] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:19.875917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b23e9b-4388-49a0-972d-68ad6e181891 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:19.885679 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b23e9b-4388-49a0-972d-68ad6e181891 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:19.890328 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f56fa-d269-4bdf-bd59-0b0a9ba6387a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:19.890970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f56fa-d269-4bdf-bd59-0b0a9ba6387a admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:19.891255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f56fa-d269-4bdf-bd59-0b0a9ba6387a admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:19.891532 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f56fa-d269-4bdf-bd59-0b0a9ba6387a admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:19.892292 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f56fa-d269-4bdf-bd59-0b0a9ba6387a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:19.893875 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f56fa-d269-4bdf-bd59-0b0a9ba6387a admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:19.903375 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1294/2600] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:19.907759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2000b0f-403d-4ebe-b986-0a28df853198 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:19.917309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2000b0f-403d-4ebe-b986-0a28df853198 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:19.922784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b4ece-2417-4a29-9369-6bf8559f810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:19.923643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b4ece-2417-4a29-9369-6bf8559f810b admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:19.923923 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b4ece-2417-4a29-9369-6bf8559f810b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:19.924247 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b4ece-2417-4a29-9369-6bf8559f810b admin admin] PATH_INFO: `/v3/projects/7235969d204b4b8cb8eeb83b9238bd24/users/10fce719cbad46f984cf38be327141b3/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:19.938197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b4ece-2417-4a29-9369-6bf8559f810b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7235969d204b4b8cb8eeb83b9238bd24, user_id=10fce719cbad46f984cf38be327141b3, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:19.940861 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b4ece-2417-4a29-9369-6bf8559f810b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:20.010470 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1307/2601] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:19 2022] PUT /identity/v3/projects/7235969d204b4b8cb8eeb83b9238bd24/users/10fce719cbad46f984cf38be327141b3/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:46:20.021912 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103a86a-e617-41cb-9ebe-b4d8214d0e2c None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:20.022207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103a86a-e617-41cb-9ebe-b4d8214d0e2c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:20.022489 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103a86a-e617-41cb-9ebe-b4d8214d0e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:20.048540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-5103a86a-e617-41cb-9ebe-b4d8214d0e2c None None] MFA Rules not processed for user `10fce719cbad46f984cf38be327141b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:20.050006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-5103a86a-e617-41cb-9ebe-b4d8214d0e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:20.111738 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1295/2602] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:20.116165 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b4ece-2417-4a29-9369-6bf8559f810b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:20.174227 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b4ece-2417-4a29-9369-6bf8559f810b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:20.179015 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7430141-e6a8-4526-a380-fd7bac876654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:20.179654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430141-e6a8-4526-a380-fd7bac876654 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:20.179934 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430141-e6a8-4526-a380-fd7bac876654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:20.180246 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430141-e6a8-4526-a380-fd7bac876654 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:20.180935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7430141-e6a8-4526-a380-fd7bac876654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:20.182809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7430141-e6a8-4526-a380-fd7bac876654 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:20.285899 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1308/2603] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:20 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:20.289912 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103a86a-e617-41cb-9ebe-b4d8214d0e2c None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:20.300680 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103a86a-e617-41cb-9ebe-b4d8214d0e2c None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:20.354578 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0751f-71c7-40d9-b9df-099dfc885ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:20.355283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0751f-71c7-40d9-b9df-099dfc885ace admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:20.355566 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0751f-71c7-40d9-b9df-099dfc885ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:20.355842 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0751f-71c7-40d9-b9df-099dfc885ace admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:20.356561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0751f-71c7-40d9-b9df-099dfc885ace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:20.358476 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0751f-71c7-40d9-b9df-099dfc885ace admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:20.421349 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1296/2604] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:20 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:20.425518 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7430141-e6a8-4526-a380-fd7bac876654 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:20.436168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7430141-e6a8-4526-a380-fd7bac876654 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:20.440776 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb9c87-e60c-4572-bde3-8f5321676c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:20.441423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb9c87-e60c-4572-bde3-8f5321676c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:20.441716 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb9c87-e60c-4572-bde3-8f5321676c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:20.441991 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb9c87-e60c-4572-bde3-8f5321676c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:20.442710 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb9c87-e60c-4572-bde3-8f5321676c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:20.444320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb9c87-e60c-4572-bde3-8f5321676c82 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:20.454935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1309/2605] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:46:20.458597 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0751f-71c7-40d9-b9df-099dfc885ace admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:20.468354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0751f-71c7-40d9-b9df-099dfc885ace admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:20.472965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb20962-a650-4e32-8193-2917ef05380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:20.473607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb20962-a650-4e32-8193-2917ef05380b admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:20.473889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb20962-a650-4e32-8193-2917ef05380b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:20.474165 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb20962-a650-4e32-8193-2917ef05380b admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:20.474881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb20962-a650-4e32-8193-2917ef05380b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:20.476505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb20962-a650-4e32-8193-2917ef05380b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:20.486161 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1297/2606] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:20.490145 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb9c87-e60c-4572-bde3-8f5321676c82 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:20.500403 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb9c87-e60c-4572-bde3-8f5321676c82 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:20.504968 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490d07-c050-4a2c-94bd-e5acaabb2ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:20.505831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490d07-c050-4a2c-94bd-e5acaabb2ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:20.506110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490d07-c050-4a2c-94bd-e5acaabb2ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:20.508818 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20490d07-c050-4a2c-94bd-e5acaabb2ca6 admin admin] PATH_INFO: `/v3/projects/bf255a4f57314a85b4d98061f85145e1/users/5dbe76c11baa46bb90e02cf247c7893e/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:20.520843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20490d07-c050-4a2c-94bd-e5acaabb2ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf255a4f57314a85b4d98061f85145e1, user_id=5dbe76c11baa46bb90e02cf247c7893e, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:20.523510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20490d07-c050-4a2c-94bd-e5acaabb2ca6 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:20.569540 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1310/2607] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:20 2022] PUT /identity/v3/projects/bf255a4f57314a85b4d98061f85145e1/users/5dbe76c11baa46bb90e02cf247c7893e/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:20.580221 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fb715-02a0-48e9-a3a0-f48463acfd94 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:20.580517 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fb715-02a0-48e9-a3a0-f48463acfd94 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:20.580799 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fb715-02a0-48e9-a3a0-f48463acfd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:20.606763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-2e1fb715-02a0-48e9-a3a0-f48463acfd94 None None] MFA Rules not processed for user `5dbe76c11baa46bb90e02cf247c7893e`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:20.607993 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2e1fb715-02a0-48e9-a3a0-f48463acfd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:20.669032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1298/2608] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:20.674053 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490d07-c050-4a2c-94bd-e5acaabb2ca6 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:20.732674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20490d07-c050-4a2c-94bd-e5acaabb2ca6 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:20.737323 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8ad82-29c0-4953-ad3e-f13f1a1cb476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:20.737974 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8ad82-29c0-4953-ad3e-f13f1a1cb476 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:20.738266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8ad82-29c0-4953-ad3e-f13f1a1cb476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:20.738548 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8ad82-29c0-4953-ad3e-f13f1a1cb476 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:20.739231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8ad82-29c0-4953-ad3e-f13f1a1cb476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:20.741193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8ad82-29c0-4953-ad3e-f13f1a1cb476 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:20.822239 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1311/2609] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:20 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:20.826837 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fb715-02a0-48e9-a3a0-f48463acfd94 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:20.837385 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fb715-02a0-48e9-a3a0-f48463acfd94 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:20.891309 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee0814-bfec-48a9-9df5-22a1e37fd7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:20.891968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee0814-bfec-48a9-9df5-22a1e37fd7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:20.892291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee0814-bfec-48a9-9df5-22a1e37fd7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:20.892575 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee0814-bfec-48a9-9df5-22a1e37fd7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:20.893254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee0814-bfec-48a9-9df5-22a1e37fd7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:20.895164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee0814-bfec-48a9-9df5-22a1e37fd7b1 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:20.986598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1299/2610] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:20 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:20.990430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8ad82-29c0-4953-ad3e-f13f1a1cb476 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:21.000582 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8ad82-29c0-4953-ad3e-f13f1a1cb476 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:21.005206 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a93b3-5e3d-4d02-975a-c2abb386ad60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:21.005852 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a93b3-5e3d-4d02-975a-c2abb386ad60 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:21.006136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a93b3-5e3d-4d02-975a-c2abb386ad60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:21.006412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a93b3-5e3d-4d02-975a-c2abb386ad60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:21.007131 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a93b3-5e3d-4d02-975a-c2abb386ad60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:21.008769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a93b3-5e3d-4d02-975a-c2abb386ad60 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:21.020653 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1312/2611] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:21.024584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee0814-bfec-48a9-9df5-22a1e37fd7b1 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:21.034740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee0814-bfec-48a9-9df5-22a1e37fd7b1 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:21.039252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135ee0-a95f-4b2f-9e54-d716911da6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:21.040103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135ee0-a95f-4b2f-9e54-d716911da6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:21.040415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135ee0-a95f-4b2f-9e54-d716911da6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:21.040687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135ee0-a95f-4b2f-9e54-d716911da6b2 admin admin] PATH_INFO: `/v3/projects/72c20ed18b84474baddd9844132c3d93/users/253797979061430ebc0fa9a3a4f64d5e/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:21.054759 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135ee0-a95f-4b2f-9e54-d716911da6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c20ed18b84474baddd9844132c3d93, user_id=253797979061430ebc0fa9a3a4f64d5e, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:21.057428 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135ee0-a95f-4b2f-9e54-d716911da6b2 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:21.181602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1300/2612] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:21 2022] PUT /identity/v3/projects/72c20ed18b84474baddd9844132c3d93/users/253797979061430ebc0fa9a3a4f64d5e/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:21.185980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a93b3-5e3d-4d02-975a-c2abb386ad60 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:21.195586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a93b3-5e3d-4d02-975a-c2abb386ad60 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:21.248836 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4297cb2-9062-4b05-a6f5-d00e90edd8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:21.249416 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4297cb2-9062-4b05-a6f5-d00e90edd8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:21.249698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4297cb2-9062-4b05-a6f5-d00e90edd8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:21.249972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4297cb2-9062-4b05-a6f5-d00e90edd8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:21.250684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4297cb2-9062-4b05-a6f5-d00e90edd8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:21.252287 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4297cb2-9062-4b05-a6f5-d00e90edd8a7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:21.261555 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1313/2613] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:21.266293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135ee0-a95f-4b2f-9e54-d716911da6b2 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:21.276402 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135ee0-a95f-4b2f-9e54-d716911da6b2 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:21.281280 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4a9d0-a712-4bc4-a734-78c92b6e4dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:21.282159 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4a9d0-a712-4bc4-a734-78c92b6e4dba admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:21.282622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4a9d0-a712-4bc4-a734-78c92b6e4dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:21.282907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4a9d0-a712-4bc4-a734-78c92b6e4dba admin admin] PATH_INFO: `/v3/projects/72c20ed18b84474baddd9844132c3d93/users/253797979061430ebc0fa9a3a4f64d5e/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:21.284919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4a9d0-a712-4bc4-a734-78c92b6e4dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c20ed18b84474baddd9844132c3d93, user_id=253797979061430ebc0fa9a3a4f64d5e, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:21.287568 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4a9d0-a712-4bc4-a734-78c92b6e4dba admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:21.297510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1301/2614] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:21 2022] PUT /identity/v3/projects/72c20ed18b84474baddd9844132c3d93/users/253797979061430ebc0fa9a3a4f64d5e/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:21.308626 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea93a0-d857-418c-b5a5-dffb116ac603 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:21.309100 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea93a0-d857-418c-b5a5-dffb116ac603 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:21.309195 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea93a0-d857-418c-b5a5-dffb116ac603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:21.334946 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-45ea93a0-d857-418c-b5a5-dffb116ac603 None None] MFA Rules not processed for user `253797979061430ebc0fa9a3a4f64d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:21.336132 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-45ea93a0-d857-418c-b5a5-dffb116ac603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:21.399216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1314/2615] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:21.410289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4a9d0-a712-4bc4-a734-78c92b6e4dba admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:21.411966 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-19f4a9d0-a712-4bc4-a734-78c92b6e4dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:21.466567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4a9d0-a712-4bc4-a734-78c92b6e4dba admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:21.470210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8fdab-4b70-4bc1-b584-059e178fb5d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:21.470848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8fdab-4b70-4bc1-b584-059e178fb5d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:21.471123 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8fdab-4b70-4bc1-b584-059e178fb5d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:21.471400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8fdab-4b70-4bc1-b584-059e178fb5d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:21.524778 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8fdab-4b70-4bc1-b584-059e178fb5d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:21.526151 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8fdab-4b70-4bc1-b584-059e178fb5d2 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:21.534726 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1302/2616] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:23.523358 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea93a0-d857-418c-b5a5-dffb116ac603 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:23.524826 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-45ea93a0-d857-418c-b5a5-dffb116ac603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:23.536537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea93a0-d857-418c-b5a5-dffb116ac603 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:23.540072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7742e7e-0084-4568-b605-974505f9683a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:23.540736 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7742e7e-0084-4568-b605-974505f9683a service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:23.541021 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7742e7e-0084-4568-b605-974505f9683a service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:23.541299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7742e7e-0084-4568-b605-974505f9683a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:23.595668 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7742e7e-0084-4568-b605-974505f9683a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:23.597123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7742e7e-0084-4568-b605-974505f9683a service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:23.605810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1315/2617] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:24.847673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8fdab-4b70-4bc1-b584-059e178fb5d2 service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:24.856461 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8fdab-4b70-4bc1-b584-059e178fb5d2 service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:24.860174 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d586bf-ce39-4370-a4ee-e59b74bd7d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:24.860804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d586bf-ce39-4370-a4ee-e59b74bd7d2d service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:24.861088 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d586bf-ce39-4370-a4ee-e59b74bd7d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:24.861363 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d586bf-ce39-4370-a4ee-e59b74bd7d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:24.870102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d586bf-ce39-4370-a4ee-e59b74bd7d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:24.871515 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d586bf-ce39-4370-a4ee-e59b74bd7d2d service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:24.881665 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1303/2618] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:29.373105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7742e7e-0084-4568-b605-974505f9683a service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:29.431581 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7742e7e-0084-4568-b605-974505f9683a service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:29.435949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:29.436822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:29.437104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:29.437377 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] PATH_INFO: `/v3/users/10fce719cbad46f984cf38be327141b3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:29.438531 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10fce719cbad46f984cf38be327141b3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:29.440481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:29.616454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10fce719cbad46f984cf38be327141b3'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:29.617114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10fce719cbad46f984cf38be327141b3'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:29.677629 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10fce719cbad46f984cf38be327141b3'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:29.678272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10fce719cbad46f984cf38be327141b3'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:29.690925 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10fce719cbad46f984cf38be327141b3'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:29.703055 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1316/2619] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:29 2022] DELETE /identity/v3/users/10fce719cbad46f984cf38be327141b3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:29.707740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6507321-7c26-4e5f-b57d-6383faffe95e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:29.711559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6507321-7c26-4e5f-b57d-6383faffe95e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:29.711559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6507321-7c26-4e5f-b57d-6383faffe95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:29.726143 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-e6507321-7c26-4e5f-b57d-6383faffe95e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:29.727367 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-e6507321-7c26-4e5f-b57d-6383faffe95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:29.801661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1304/2620] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:29.811901 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:29.813301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:29.867722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b682642-f4ab-438c-8309-04e8b05d19e2 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:29.871290 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79503-c62d-460b-a265-e7f992ef1c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:29.871917 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79503-c62d-460b-a265-e7f992ef1c59 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:29.872262 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79503-c62d-460b-a265-e7f992ef1c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:29.872542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c79503-c62d-460b-a265-e7f992ef1c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:29.881397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c79503-c62d-460b-a265-e7f992ef1c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:29.882910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c79503-c62d-460b-a265-e7f992ef1c59 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:29.892784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1317/2621] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:30.290991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6507321-7c26-4e5f-b57d-6383faffe95e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:30.292569 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-e6507321-7c26-4e5f-b57d-6383faffe95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:30.305907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6507321-7c26-4e5f-b57d-6383faffe95e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:30.310556 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:30.311602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:30.311889 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:30.312216 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] PATH_INFO: `/v3/projects/7235969d204b4b8cb8eeb83b9238bd24` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:30.313410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7235969d204b4b8cb8eeb83b9238bd24)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:30.315334 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:30.408717 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7235969d204b4b8cb8eeb83b9238bd24', 'request_id': 'req-60a97d5c-6950-43f9-b151-5e2dbee570ad'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:30.414118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7235969d204b4b8cb8eeb83b9238bd24', 'request_id': 'req-60a97d5c-6950-43f9-b151-5e2dbee570ad'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:30.420757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7235969d204b4b8cb8eeb83b9238bd24', 'request_id': 'req-60a97d5c-6950-43f9-b151-5e2dbee570ad'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:30.466324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] The token cache is being invalidate because project 7235969d204b4b8cb8eeb83b9238bd24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:30.466630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:30.467240 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:30.468809 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1305/2622] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:30 2022] DELETE /identity/v3/projects/7235969d204b4b8cb8eeb83b9238bd24 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:30.472889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79503-c62d-460b-a265-e7f992ef1c59 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:30.482284 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c79503-c62d-460b-a265-e7f992ef1c59 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:30.535566 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:30.536386 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:30.536669 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:30.536944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] PATH_INFO: `/v3/users/5dbe76c11baa46bb90e02cf247c7893e` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:30.538114 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dbe76c11baa46bb90e02cf247c7893e)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:30.540026 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:30.684919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dbe76c11baa46bb90e02cf247c7893e'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:30.685578 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dbe76c11baa46bb90e02cf247c7893e'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:30.746509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dbe76c11baa46bb90e02cf247c7893e'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:30.747147 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dbe76c11baa46bb90e02cf247c7893e'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:30.759015 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dbe76c11baa46bb90e02cf247c7893e'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:30.771149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1318/2623] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:30 2022] DELETE /identity/v3/users/5dbe76c11baa46bb90e02cf247c7893e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:31.188751 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:31.190195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:31.203674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a97d5c-6950-43f9-b151-5e2dbee570ad admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:31.259453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:31.260340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:31.260626 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:31.260901 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] PATH_INFO: `/v3/projects/bf255a4f57314a85b4d98061f85145e1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:31.262060 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf255a4f57314a85b4d98061f85145e1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:31.264024 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:31.345788 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf255a4f57314a85b4d98061f85145e1', 'request_id': 'req-20b4fb1b-58c4-49e8-b5bd-994dba47060b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:31.351234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf255a4f57314a85b4d98061f85145e1', 'request_id': 'req-20b4fb1b-58c4-49e8-b5bd-994dba47060b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:31.357838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf255a4f57314a85b4d98061f85145e1', 'request_id': 'req-20b4fb1b-58c4-49e8-b5bd-994dba47060b'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:31.402388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] The token cache is being invalidate because project bf255a4f57314a85b4d98061f85145e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:31.402595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:31.403809 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:31.405366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1306/2624] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:31 2022] DELETE /identity/v3/projects/bf255a4f57314a85b4d98061f85145e1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:31.409551 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:31.410938 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:31.423617 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20933eff-fa32-47cb-aa7e-7f69f9f96807 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:31.478218 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6916a1d-cd5d-4b2b-8e1f-c69e3311a57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:31.479084 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916a1d-cd5d-4b2b-8e1f-c69e3311a57c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:31.479362 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916a1d-cd5d-4b2b-8e1f-c69e3311a57c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:31.479633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6916a1d-cd5d-4b2b-8e1f-c69e3311a57c admin admin] PATH_INFO: `/v3/users/253797979061430ebc0fa9a3a4f64d5e` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:31.480822 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6916a1d-cd5d-4b2b-8e1f-c69e3311a57c admin admin] RBAC: Authorizing `identity:delete_user(user_id=253797979061430ebc0fa9a3a4f64d5e)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:31.482793 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6916a1d-cd5d-4b2b-8e1f-c69e3311a57c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:31.661706 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b6916a1d-cd5d-4b2b-8e1f-c69e3311a57c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253797979061430ebc0fa9a3a4f64d5e'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:31.662271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b6916a1d-cd5d-4b2b-8e1f-c69e3311a57c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253797979061430ebc0fa9a3a4f64d5e'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:31.740843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b6916a1d-cd5d-4b2b-8e1f-c69e3311a57c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253797979061430ebc0fa9a3a4f64d5e'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:31.741470 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b6916a1d-cd5d-4b2b-8e1f-c69e3311a57c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253797979061430ebc0fa9a3a4f64d5e'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:31.753494 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-b6916a1d-cd5d-4b2b-8e1f-c69e3311a57c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253797979061430ebc0fa9a3a4f64d5e'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:31.765312 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1319/2625] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:31 2022] DELETE /identity/v3/users/253797979061430ebc0fa9a3a4f64d5e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:32.143198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:32.144958 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:32.158031 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4fb1b-58c4-49e8-b5bd-994dba47060b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:32.214730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3e85f-db90-4974-ac58-269bc650d832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:32.215492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3e85f-db90-4974-ac58-269bc650d832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:32.216400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3e85f-db90-4974-ac58-269bc650d832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:32.216680 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3e85f-db90-4974-ac58-269bc650d832 admin admin] PATH_INFO: `/v3/projects/72c20ed18b84474baddd9844132c3d93` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:32.217860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3e85f-db90-4974-ac58-269bc650d832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c20ed18b84474baddd9844132c3d93)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:32.219783 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3e85f-db90-4974-ac58-269bc650d832 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:32.439229 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-fee3e85f-db90-4974-ac58-269bc650d832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c20ed18b84474baddd9844132c3d93', 'request_id': 'req-fee3e85f-db90-4974-ac58-269bc650d832'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:32.449912 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-fee3e85f-db90-4974-ac58-269bc650d832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c20ed18b84474baddd9844132c3d93', 'request_id': 'req-fee3e85f-db90-4974-ac58-269bc650d832'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:32.451244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-fee3e85f-db90-4974-ac58-269bc650d832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c20ed18b84474baddd9844132c3d93', 'request_id': 'req-fee3e85f-db90-4974-ac58-269bc650d832'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:32.511212 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-fee3e85f-db90-4974-ac58-269bc650d832 admin admin] The token cache is being invalidate because project 72c20ed18b84474baddd9844132c3d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:32.511438 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-fee3e85f-db90-4974-ac58-269bc650d832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:32.512058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-fee3e85f-db90-4974-ac58-269bc650d832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:32.513622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1307/2626] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:32 2022] DELETE /identity/v3/projects/72c20ed18b84474baddd9844132c3d93 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:32.519590 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a465d-79ea-40df-9190-a246dc195c87 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:32.520047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a465d-79ea-40df-9190-a246dc195c87 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:32.520159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a465d-79ea-40df-9190-a246dc195c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:32.539715 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-0c7a465d-79ea-40df-9190-a246dc195c87 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:32.540949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0c7a465d-79ea-40df-9190-a246dc195c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:32.597092 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1320/2627] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:32.604868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2b403-cd24-4797-8bad-e1b280b464e0 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:32.605224 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2b403-cd24-4797-8bad-e1b280b464e0 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:32.605537 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2b403-cd24-4797-8bad-e1b280b464e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:32.623802 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-34e2b403-cd24-4797-8bad-e1b280b464e0 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:32.625015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-34e2b403-cd24-4797-8bad-e1b280b464e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:32.633151 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1308/2628] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:32.637159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a465d-79ea-40df-9190-a246dc195c87 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:32.646703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a465d-79ea-40df-9190-a246dc195c87 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:32.651318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93a3d4-911d-4cb1-8efb-a5599d10e86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:32.651951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93a3d4-911d-4cb1-8efb-a5599d10e86e admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:32.652268 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93a3d4-911d-4cb1-8efb-a5599d10e86e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:32.652542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93a3d4-911d-4cb1-8efb-a5599d10e86e admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:32.653893 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93a3d4-911d-4cb1-8efb-a5599d10e86e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:46:32.654203 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93a3d4-911d-4cb1-8efb-a5599d10e86e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:32.655779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93a3d4-911d-4cb1-8efb-a5599d10e86e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:32.670446 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1321/2629] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 15:46:32.674992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2b403-cd24-4797-8bad-e1b280b464e0 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:32.683917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2b403-cd24-4797-8bad-e1b280b464e0 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:32.688625 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ff058-65a4-44e0-85c5-fb9bff8e0cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:32.689260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ff058-65a4-44e0-85c5-fb9bff8e0cae admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:32.689540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ff058-65a4-44e0-85c5-fb9bff8e0cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:32.689826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ff058-65a4-44e0-85c5-fb9bff8e0cae admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:32.690491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ff058-65a4-44e0-85c5-fb9bff8e0cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:32.692400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ff058-65a4-44e0-85c5-fb9bff8e0cae admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:32.782457 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1309/2630] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:32 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:32.786451 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93a3d4-911d-4cb1-8efb-a5599d10e86e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:32.796134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93a3d4-911d-4cb1-8efb-a5599d10e86e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:32.850655 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b3cdf-417a-4ebc-baf6-65489c0668fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:32.851321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b3cdf-417a-4ebc-baf6-65489c0668fe admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:32.851606 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b3cdf-417a-4ebc-baf6-65489c0668fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:32.851883 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b3cdf-417a-4ebc-baf6-65489c0668fe admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:32.852616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b3cdf-417a-4ebc-baf6-65489c0668fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:32.854610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b3cdf-417a-4ebc-baf6-65489c0668fe admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:32.980598 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1322/2631] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:32 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:46:32.984739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ff058-65a4-44e0-85c5-fb9bff8e0cae admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:32.994649 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ff058-65a4-44e0-85c5-fb9bff8e0cae admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:32.999183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62aab9-b6eb-429a-8a2b-2baa077e162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:32.999836 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62aab9-b6eb-429a-8a2b-2baa077e162e admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:33.000106 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62aab9-b6eb-429a-8a2b-2baa077e162e admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:33.000408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62aab9-b6eb-429a-8a2b-2baa077e162e admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:33.001122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62aab9-b6eb-429a-8a2b-2baa077e162e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:33.002747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62aab9-b6eb-429a-8a2b-2baa077e162e admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:33.012207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1310/2632] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:33.016502 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b3cdf-417a-4ebc-baf6-65489c0668fe admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:33.026226 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b3cdf-417a-4ebc-baf6-65489c0668fe admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:33.031415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635729bb-b988-4767-a771-b5e3a154ea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:33.032058 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635729bb-b988-4767-a771-b5e3a154ea94 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:33.032371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635729bb-b988-4767-a771-b5e3a154ea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:33.032697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635729bb-b988-4767-a771-b5e3a154ea94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:33.033364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635729bb-b988-4767-a771-b5e3a154ea94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:33.034943 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635729bb-b988-4767-a771-b5e3a154ea94 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:33.044691 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1323/2633] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:33.048614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62aab9-b6eb-429a-8a2b-2baa077e162e admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:33.058236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62aab9-b6eb-429a-8a2b-2baa077e162e admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:33.063125 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf227b8-c4c9-46da-9112-7596b02150aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:33.063972 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf227b8-c4c9-46da-9112-7596b02150aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:33.064294 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf227b8-c4c9-46da-9112-7596b02150aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:33.064568 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf227b8-c4c9-46da-9112-7596b02150aa admin admin] PATH_INFO: `/v3/projects/6c1ebb14d8c0420b80497ed1d1eed585/users/26e84d1c3dba49b29c16bc46fe8faa4f/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:33.078769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf227b8-c4c9-46da-9112-7596b02150aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1ebb14d8c0420b80497ed1d1eed585, user_id=26e84d1c3dba49b29c16bc46fe8faa4f, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:33.081397 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf227b8-c4c9-46da-9112-7596b02150aa admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:33.169245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1311/2634] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:33 2022] PUT /identity/v3/projects/6c1ebb14d8c0420b80497ed1d1eed585/users/26e84d1c3dba49b29c16bc46fe8faa4f/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:33.179593 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770a539-acc8-43b4-81df-be6e68df0076 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:33.179889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770a539-acc8-43b4-81df-be6e68df0076 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:33.180192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770a539-acc8-43b4-81df-be6e68df0076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:33.206709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-7770a539-acc8-43b4-81df-be6e68df0076 None None] MFA Rules not processed for user `26e84d1c3dba49b29c16bc46fe8faa4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:33.207905 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7770a539-acc8-43b4-81df-be6e68df0076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:33.268765 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1324/2635] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:33.279179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf227b8-c4c9-46da-9112-7596b02150aa admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:33.280944 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7cf227b8-c4c9-46da-9112-7596b02150aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:33.335032 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf227b8-c4c9-46da-9112-7596b02150aa admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:33.338545 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fdf00-ea11-411f-8e11-b27744192cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:33.339175 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fdf00-ea11-411f-8e11-b27744192cff service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:33.339466 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fdf00-ea11-411f-8e11-b27744192cff service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:33.339743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fdf00-ea11-411f-8e11-b27744192cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:33.347719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fdf00-ea11-411f-8e11-b27744192cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:33.349160 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fdf00-ea11-411f-8e11-b27744192cff service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:33.357585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1312/2636] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:35.011065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b1af6-daa2-4398-92c8-2e35681d7949 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:35.011610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b1af6-daa2-4398-92c8-2e35681d7949 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:35.011819 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b1af6-daa2-4398-92c8-2e35681d7949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:35.031924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f63b1af6-daa2-4398-92c8-2e35681d7949 None None] MFA Rules not processed for user `26e84d1c3dba49b29c16bc46fe8faa4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:35.033189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f63b1af6-daa2-4398-92c8-2e35681d7949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:35.040346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1325/2637] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:39.323036 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fdf00-ea11-411f-8e11-b27744192cff service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:39.324603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a86fdf00-ea11-411f-8e11-b27744192cff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:39.382067 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fdf00-ea11-411f-8e11-b27744192cff service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:39.386017 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e3661-8071-4a2f-933d-e4a525f535f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:39.388354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e3661-8071-4a2f-933d-e4a525f535f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:39.388354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e3661-8071-4a2f-933d-e4a525f535f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:39.388354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e3661-8071-4a2f-933d-e4a525f535f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:39.389634 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-cd0e3661-8071-4a2f-933d-e4a525f535f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:39.461201 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e3661-8071-4a2f-933d-e4a525f535f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:39.463054 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e3661-8071-4a2f-933d-e4a525f535f3 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:39.474588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1313/2638] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:43.436408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b1af6-daa2-4398-92c8-2e35681d7949 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:43.438005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f63b1af6-daa2-4398-92c8-2e35681d7949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:43.451863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b1af6-daa2-4398-92c8-2e35681d7949 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:43.456738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d61004-c570-413c-b430-53814e9e8ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:43.457971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d61004-c570-413c-b430-53814e9e8ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:43.458358 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d61004-c570-413c-b430-53814e9e8ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:43.458636 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d61004-c570-413c-b430-53814e9e8ae6 admin admin] PATH_INFO: `/v3/users/af4907a2aa8b48b0a0810f23d75f9eaf` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:43.459980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d61004-c570-413c-b430-53814e9e8ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4907a2aa8b48b0a0810f23d75f9eaf)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:43.462333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d61004-c570-413c-b430-53814e9e8ae6 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:43.657830 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-62d61004-c570-413c-b430-53814e9e8ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4907a2aa8b48b0a0810f23d75f9eaf'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:43.658368 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-62d61004-c570-413c-b430-53814e9e8ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4907a2aa8b48b0a0810f23d75f9eaf'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:43.735146 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-62d61004-c570-413c-b430-53814e9e8ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4907a2aa8b48b0a0810f23d75f9eaf'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:43.738797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-62d61004-c570-413c-b430-53814e9e8ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4907a2aa8b48b0a0810f23d75f9eaf'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:43.752405 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-62d61004-c570-413c-b430-53814e9e8ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4907a2aa8b48b0a0810f23d75f9eaf'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:43.766832 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1326/2639] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:43 2022] DELETE /identity/v3/users/af4907a2aa8b48b0a0810f23d75f9eaf => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:44.062059 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e3661-8071-4a2f-933d-e4a525f535f3 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:44.080484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e3661-8071-4a2f-933d-e4a525f535f3 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:44.160303 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:44.161165 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:44.161446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:44.162192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2 admin admin] PATH_INFO: `/v3/projects/9ac62b56e40d4f0981ee3ca2bb898333` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:44.162969 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac62b56e40d4f0981ee3ca2bb898333)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:44.165012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:44.268021 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac62b56e40d4f0981ee3ca2bb898333', 'request_id': 'req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:44.273460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac62b56e40d4f0981ee3ca2bb898333', 'request_id': 'req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:44.279494 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac62b56e40d4f0981ee3ca2bb898333', 'request_id': 'req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:44.346239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2 admin admin] The token cache is being invalidate because project 9ac62b56e40d4f0981ee3ca2bb898333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:44.346537 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:44.347153 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-f0b19d7a-fcdb-4bf2-8baf-3653e1db30b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:44.348748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1314/2640] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:44 2022] DELETE /identity/v3/projects/9ac62b56e40d4f0981ee3ca2bb898333 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:44.354394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750a78d-8e20-45a9-8f24-57cf02bb8683 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:44.354687 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750a78d-8e20-45a9-8f24-57cf02bb8683 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:44.354969 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750a78d-8e20-45a9-8f24-57cf02bb8683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:44.372651 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-2750a78d-8e20-45a9-8f24-57cf02bb8683 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:44.373906 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2750a78d-8e20-45a9-8f24-57cf02bb8683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:44.431538 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1327/2641] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:44.439362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f986a97-2b62-4420-98e8-522beb6c3743 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:44.439651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f986a97-2b62-4420-98e8-522beb6c3743 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:44.439927 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f986a97-2b62-4420-98e8-522beb6c3743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:44.457677 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-1f986a97-2b62-4420-98e8-522beb6c3743 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:44.458881 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1f986a97-2b62-4420-98e8-522beb6c3743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:44.467276 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1315/2642] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:44.471307 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750a78d-8e20-45a9-8f24-57cf02bb8683 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:44.480853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750a78d-8e20-45a9-8f24-57cf02bb8683 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:44.485428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d1d0-349d-4f3c-b158-083ac7798318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:44.488773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d1d0-349d-4f3c-b158-083ac7798318 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:44.488773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d1d0-349d-4f3c-b158-083ac7798318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:44.488773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d1d0-349d-4f3c-b158-083ac7798318 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:44.488773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488d1d0-349d-4f3c-b158-083ac7798318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:46:44.488773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488d1d0-349d-4f3c-b158-083ac7798318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:44.489244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488d1d0-349d-4f3c-b158-083ac7798318 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:44.500951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1328/2643] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:46:44.505227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f986a97-2b62-4420-98e8-522beb6c3743 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:44.514788 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f986a97-2b62-4420-98e8-522beb6c3743 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:44.519390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a654b-f685-40ce-a4d6-df35e9f9cc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:44.520066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a654b-f685-40ce-a4d6-df35e9f9cc45 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:44.525340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a654b-f685-40ce-a4d6-df35e9f9cc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:44.525340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a654b-f685-40ce-a4d6-df35e9f9cc45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:44.525340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a654b-f685-40ce-a4d6-df35e9f9cc45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:44.525340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a654b-f685-40ce-a4d6-df35e9f9cc45 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:44.633139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1316/2644] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:44 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:46:44.637363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d1d0-349d-4f3c-b158-083ac7798318 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:44.647034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d1d0-349d-4f3c-b158-083ac7798318 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:44.702505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458fbd3-cb05-45a1-bece-a49f066192cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:44.703166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458fbd3-cb05-45a1-bece-a49f066192cd admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:44.703447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458fbd3-cb05-45a1-bece-a49f066192cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:44.703722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458fbd3-cb05-45a1-bece-a49f066192cd admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:44.704510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458fbd3-cb05-45a1-bece-a49f066192cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:44.706408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458fbd3-cb05-45a1-bece-a49f066192cd admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:44.803900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1329/2645] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:44 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:46:44.808384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a654b-f685-40ce-a4d6-df35e9f9cc45 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:44.818660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a654b-f685-40ce-a4d6-df35e9f9cc45 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:44.823274 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8323f2f-2a08-4aba-9f2b-8fe0e0ade9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:44.823926 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8323f2f-2a08-4aba-9f2b-8fe0e0ade9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:44.824235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8323f2f-2a08-4aba-9f2b-8fe0e0ade9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:44.825148 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8323f2f-2a08-4aba-9f2b-8fe0e0ade9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:44.825759 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8323f2f-2a08-4aba-9f2b-8fe0e0ade9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:44.827370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8323f2f-2a08-4aba-9f2b-8fe0e0ade9d9 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:44.837974 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1317/2646] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:44.842631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458fbd3-cb05-45a1-bece-a49f066192cd admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:44.852796 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458fbd3-cb05-45a1-bece-a49f066192cd admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:44.857570 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe2919-3424-40d4-aeb8-1503f1e13970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:44.858225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe2919-3424-40d4-aeb8-1503f1e13970 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:44.858972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe2919-3424-40d4-aeb8-1503f1e13970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:44.858972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe2919-3424-40d4-aeb8-1503f1e13970 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:44.859496 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe2919-3424-40d4-aeb8-1503f1e13970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:44.861109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe2919-3424-40d4-aeb8-1503f1e13970 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:44.871243 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1330/2647] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:44.875839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8323f2f-2a08-4aba-9f2b-8fe0e0ade9d9 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:44.885748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8323f2f-2a08-4aba-9f2b-8fe0e0ade9d9 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:44.891006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf857e-732e-4991-90de-d959a73cc7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:44.891872 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf857e-732e-4991-90de-d959a73cc7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:44.892196 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf857e-732e-4991-90de-d959a73cc7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:44.892467 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf857e-732e-4991-90de-d959a73cc7e4 admin admin] PATH_INFO: `/v3/projects/6b4fddcac7194bdea80ea16d7a6b6f5d/users/f16cbb5dbdf84efca454e2711076e342/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:44.908105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf857e-732e-4991-90de-d959a73cc7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4fddcac7194bdea80ea16d7a6b6f5d, user_id=f16cbb5dbdf84efca454e2711076e342, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:44.910978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf857e-732e-4991-90de-d959a73cc7e4 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:44.997535 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1318/2648] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:44 2022] PUT /identity/v3/projects/6b4fddcac7194bdea80ea16d7a6b6f5d/users/f16cbb5dbdf84efca454e2711076e342/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:45.008347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1146c4-d40b-4da8-be72-99d0f6aca856 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:45.008583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1146c4-d40b-4da8-be72-99d0f6aca856 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:45.008870 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1146c4-d40b-4da8-be72-99d0f6aca856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:45.036246 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-5c1146c4-d40b-4da8-be72-99d0f6aca856 None None] MFA Rules not processed for user `f16cbb5dbdf84efca454e2711076e342`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:45.037505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-5c1146c4-d40b-4da8-be72-99d0f6aca856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:45.100936 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1331/2649] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:45.105039 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf857e-732e-4991-90de-d959a73cc7e4 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:45.170988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf857e-732e-4991-90de-d959a73cc7e4 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:45.177239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420e854-89be-46ef-930a-dfc5f1e24af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:45.177978 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420e854-89be-46ef-930a-dfc5f1e24af4 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:45.178334 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420e854-89be-46ef-930a-dfc5f1e24af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:45.178721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420e854-89be-46ef-930a-dfc5f1e24af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:45.179619 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420e854-89be-46ef-930a-dfc5f1e24af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:45.181336 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420e854-89be-46ef-930a-dfc5f1e24af4 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:45.278883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1319/2650] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:45 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:45.284667 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1146c4-d40b-4da8-be72-99d0f6aca856 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:45.295238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1146c4-d40b-4da8-be72-99d0f6aca856 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:45.349542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff0383-0c50-4c9a-bbc9-ffe5e0aa3289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:45.350197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff0383-0c50-4c9a-bbc9-ffe5e0aa3289 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:45.350482 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff0383-0c50-4c9a-bbc9-ffe5e0aa3289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:45.350771 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff0383-0c50-4c9a-bbc9-ffe5e0aa3289 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:45.351436 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff0383-0c50-4c9a-bbc9-ffe5e0aa3289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:45.353370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff0383-0c50-4c9a-bbc9-ffe5e0aa3289 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:45.432094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1332/2651] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:45 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:45.436650 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420e854-89be-46ef-930a-dfc5f1e24af4 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:45.446611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420e854-89be-46ef-930a-dfc5f1e24af4 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:45.451167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938be78e-7534-4df3-8bc4-87eea71fe14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:45.453990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938be78e-7534-4df3-8bc4-87eea71fe14c admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:45.453990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938be78e-7534-4df3-8bc4-87eea71fe14c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:45.453990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938be78e-7534-4df3-8bc4-87eea71fe14c admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:45.453990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938be78e-7534-4df3-8bc4-87eea71fe14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:45.454622 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938be78e-7534-4df3-8bc4-87eea71fe14c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:45.464817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1320/2652] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:45.468674 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff0383-0c50-4c9a-bbc9-ffe5e0aa3289 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:45.478355 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff0383-0c50-4c9a-bbc9-ffe5e0aa3289 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:45.483475 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb61260-6b9b-4eae-9b72-6996db631ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:45.484371 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb61260-6b9b-4eae-9b72-6996db631ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:45.484657 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb61260-6b9b-4eae-9b72-6996db631ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:45.484935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb61260-6b9b-4eae-9b72-6996db631ad2 admin admin] PATH_INFO: `/v3/projects/788183c0505343bd83915fe3d57dd90b/users/4f533040db754e2d84d49c49ae46cfb9/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:45.500965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb61260-6b9b-4eae-9b72-6996db631ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=788183c0505343bd83915fe3d57dd90b, user_id=4f533040db754e2d84d49c49ae46cfb9, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:45.503649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb61260-6b9b-4eae-9b72-6996db631ad2 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:45.575374 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1333/2653] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:45 2022] PUT /identity/v3/projects/788183c0505343bd83915fe3d57dd90b/users/4f533040db754e2d84d49c49ae46cfb9/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:46:45.579323 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938be78e-7534-4df3-8bc4-87eea71fe14c admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:45.590244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938be78e-7534-4df3-8bc4-87eea71fe14c admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:45.645305 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a1a2e-ea81-4b3d-ba65-61a9d56c7228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:45.645957 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a1a2e-ea81-4b3d-ba65-61a9d56c7228 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:45.646236 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a1a2e-ea81-4b3d-ba65-61a9d56c7228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:45.646509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a1a2e-ea81-4b3d-ba65-61a9d56c7228 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:45.647226 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a1a2e-ea81-4b3d-ba65-61a9d56c7228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:45.648846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a1a2e-ea81-4b3d-ba65-61a9d56c7228 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:45.658509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1321/2654] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:45.662953 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb61260-6b9b-4eae-9b72-6996db631ad2 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:45.677860 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb61260-6b9b-4eae-9b72-6996db631ad2 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:45.683063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef9d84-0c87-49fb-bf22-3d5e16797f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:45.684700 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef9d84-0c87-49fb-bf22-3d5e16797f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:45.685232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef9d84-0c87-49fb-bf22-3d5e16797f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:45.685232 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef9d84-0c87-49fb-bf22-3d5e16797f34 admin admin] PATH_INFO: `/v3/projects/788183c0505343bd83915fe3d57dd90b/users/4f533040db754e2d84d49c49ae46cfb9/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:45.687225 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef9d84-0c87-49fb-bf22-3d5e16797f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=788183c0505343bd83915fe3d57dd90b, user_id=4f533040db754e2d84d49c49ae46cfb9, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:45.689962 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef9d84-0c87-49fb-bf22-3d5e16797f34 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:45.702782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1334/2655] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:45 2022] PUT /identity/v3/projects/788183c0505343bd83915fe3d57dd90b/users/4f533040db754e2d84d49c49ae46cfb9/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:45.712765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa9743-94a9-4efd-b32d-f038a98c2adc None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:45.713127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa9743-94a9-4efd-b32d-f038a98c2adc None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:45.713503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa9743-94a9-4efd-b32d-f038a98c2adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:45.743692 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7baa9743-94a9-4efd-b32d-f038a98c2adc None None] MFA Rules not processed for user `4f533040db754e2d84d49c49ae46cfb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:45.745086 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7baa9743-94a9-4efd-b32d-f038a98c2adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:45.830606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1322/2656] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:45.849732 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef9d84-0c87-49fb-bf22-3d5e16797f34 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:45.851940 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-19ef9d84-0c87-49fb-bf22-3d5e16797f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:45.917649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef9d84-0c87-49fb-bf22-3d5e16797f34 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:45.922842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80e45e-8081-44b7-bb5e-cc94a7090a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:45.926900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80e45e-8081-44b7-bb5e-cc94a7090a59 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:45.926900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80e45e-8081-44b7-bb5e-cc94a7090a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:45.926900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80e45e-8081-44b7-bb5e-cc94a7090a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:45.935468 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80e45e-8081-44b7-bb5e-cc94a7090a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:45.936968 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80e45e-8081-44b7-bb5e-cc94a7090a59 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:45.948397 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1335/2657] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:45 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:46.793198 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff9d0-750d-4207-a62a-3a4094560ce1 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:46.794215 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff9d0-750d-4207-a62a-3a4094560ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:46.794347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff9d0-750d-4207-a62a-3a4094560ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:46.812653 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-57cff9d0-750d-4207-a62a-3a4094560ce1 None None] MFA Rules not processed for user `c09f638d00cb4ae5b4959cf2c5c2ae71`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:46.814018 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-57cff9d0-750d-4207-a62a-3a4094560ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:46.870870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1323/2658] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:48.831435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80e45e-8081-44b7-bb5e-cc94a7090a59 service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:48.897604 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80e45e-8081-44b7-bb5e-cc94a7090a59 service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:48.902890 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:48.903746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:48.904318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:48.904602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] PATH_INFO: `/v3/users/f16cbb5dbdf84efca454e2711076e342` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:48.905792 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16cbb5dbdf84efca454e2711076e342)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:48.907783 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:49.096208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16cbb5dbdf84efca454e2711076e342'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:49.096811 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16cbb5dbdf84efca454e2711076e342'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:49.140195 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16cbb5dbdf84efca454e2711076e342'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:49.140833 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16cbb5dbdf84efca454e2711076e342'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:49.152649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16cbb5dbdf84efca454e2711076e342'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:49.164267 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1336/2659] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:48 2022] DELETE /identity/v3/users/f16cbb5dbdf84efca454e2711076e342 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:49.169342 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfda4d1-72e1-41ca-a0e5-f97965ff0fb3 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:49.169814 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfda4d1-72e1-41ca-a0e5-f97965ff0fb3 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:49.169911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfda4d1-72e1-41ca-a0e5-f97965ff0fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:49.187488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-cdfda4d1-72e1-41ca-a0e5-f97965ff0fb3 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:49.188707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-cdfda4d1-72e1-41ca-a0e5-f97965ff0fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:49.244545 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1324/2660] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:49.255067 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:49.256516 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:49.317683 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1a8f7-8700-4538-b06a-3e4c8171cb11 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:49.321347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f51b-604c-489a-82d7-0f6bff074598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:49.322018 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f51b-604c-489a-82d7-0f6bff074598 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:49.322301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f51b-604c-489a-82d7-0f6bff074598 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:49.322578 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f51b-604c-489a-82d7-0f6bff074598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:49.331709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668f51b-604c-489a-82d7-0f6bff074598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:49.333177 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668f51b-604c-489a-82d7-0f6bff074598 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:49.343136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1337/2661] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:49.737071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfda4d1-72e1-41ca-a0e5-f97965ff0fb3 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:49.740377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-cdfda4d1-72e1-41ca-a0e5-f97965ff0fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:49.761508 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfda4d1-72e1-41ca-a0e5-f97965ff0fb3 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:49.768583 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:49.769505 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:49.769968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:49.770407 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] PATH_INFO: `/v3/projects/6b4fddcac7194bdea80ea16d7a6b6f5d` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:49.771635 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4fddcac7194bdea80ea16d7a6b6f5d)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:49.774005 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:49.884912 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4fddcac7194bdea80ea16d7a6b6f5d', 'request_id': 'req-a12795ca-f938-49be-8494-204371b92bdb'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:49.891061 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4fddcac7194bdea80ea16d7a6b6f5d', 'request_id': 'req-a12795ca-f938-49be-8494-204371b92bdb'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:49.897476 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4fddcac7194bdea80ea16d7a6b6f5d', 'request_id': 'req-a12795ca-f938-49be-8494-204371b92bdb'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:50.025721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] The token cache is being invalidate because project 6b4fddcac7194bdea80ea16d7a6b6f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:50.025895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:50.026465 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:50.028707 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1325/2662] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:49 2022] DELETE /identity/v3/projects/6b4fddcac7194bdea80ea16d7a6b6f5d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:50.032813 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f51b-604c-489a-82d7-0f6bff074598 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:50.042424 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f51b-604c-489a-82d7-0f6bff074598 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:50.097916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22188b0a-cb59-4ade-9710-6e418fac476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:50.098782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188b0a-cb59-4ade-9710-6e418fac476e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:50.099066 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188b0a-cb59-4ade-9710-6e418fac476e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:50.099344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188b0a-cb59-4ade-9710-6e418fac476e admin admin] PATH_INFO: `/v3/users/4f533040db754e2d84d49c49ae46cfb9` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:50.100661 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22188b0a-cb59-4ade-9710-6e418fac476e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f533040db754e2d84d49c49ae46cfb9)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:50.102592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22188b0a-cb59-4ade-9710-6e418fac476e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:50.250764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-22188b0a-cb59-4ade-9710-6e418fac476e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f533040db754e2d84d49c49ae46cfb9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:50.251648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-22188b0a-cb59-4ade-9710-6e418fac476e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f533040db754e2d84d49c49ae46cfb9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:50.341960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-22188b0a-cb59-4ade-9710-6e418fac476e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f533040db754e2d84d49c49ae46cfb9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:50.343204 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-22188b0a-cb59-4ade-9710-6e418fac476e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f533040db754e2d84d49c49ae46cfb9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:50.363159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-22188b0a-cb59-4ade-9710-6e418fac476e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f533040db754e2d84d49c49ae46cfb9'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:50.379193 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1338/2663] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:50 2022] DELETE /identity/v3/users/4f533040db754e2d84d49c49ae46cfb9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:50.938055 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:50.949286 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:50.960567 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12795ca-f938-49be-8494-204371b92bdb admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:51.038434 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ab449-1596-49e8-b3dc-d31e15cec254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:51.039095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ab449-1596-49e8-b3dc-d31e15cec254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:51.039376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ab449-1596-49e8-b3dc-d31e15cec254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:51.039696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ab449-1596-49e8-b3dc-d31e15cec254 admin admin] PATH_INFO: `/v3/projects/788183c0505343bd83915fe3d57dd90b` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:51.041946 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ab449-1596-49e8-b3dc-d31e15cec254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=788183c0505343bd83915fe3d57dd90b)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:51.043509 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ab449-1596-49e8-b3dc-d31e15cec254 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:51.168607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d66ab449-1596-49e8-b3dc-d31e15cec254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788183c0505343bd83915fe3d57dd90b', 'request_id': 'req-d66ab449-1596-49e8-b3dc-d31e15cec254'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:51.174229 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d66ab449-1596-49e8-b3dc-d31e15cec254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788183c0505343bd83915fe3d57dd90b', 'request_id': 'req-d66ab449-1596-49e8-b3dc-d31e15cec254'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:51.180530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d66ab449-1596-49e8-b3dc-d31e15cec254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788183c0505343bd83915fe3d57dd90b', 'request_id': 'req-d66ab449-1596-49e8-b3dc-d31e15cec254'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:51.243696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d66ab449-1596-49e8-b3dc-d31e15cec254 admin admin] The token cache is being invalidate because project 788183c0505343bd83915fe3d57dd90b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:51.248038 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d66ab449-1596-49e8-b3dc-d31e15cec254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:51.248038 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-d66ab449-1596-49e8-b3dc-d31e15cec254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:51.248038 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1326/2664] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:50 2022] DELETE /identity/v3/projects/788183c0505343bd83915fe3d57dd90b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:51.251727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd97c-7635-4de8-93a4-4819ee1407a5 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:51.252222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd97c-7635-4de8-93a4-4819ee1407a5 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:51.252355 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efd97c-7635-4de8-93a4-4819ee1407a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:51.270731 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-96efd97c-7635-4de8-93a4-4819ee1407a5 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:51.272275 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-96efd97c-7635-4de8-93a4-4819ee1407a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:51.331401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1339/2665] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:51.339078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa83ba-0b85-4fb3-92c1-0d67df356823 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:51.339370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa83ba-0b85-4fb3-92c1-0d67df356823 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:51.339652 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa83ba-0b85-4fb3-92c1-0d67df356823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:51.358501 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-6faa83ba-0b85-4fb3-92c1-0d67df356823 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:51.359698 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-6faa83ba-0b85-4fb3-92c1-0d67df356823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:51.367712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1327/2666] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:46:51.371784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efd97c-7635-4de8-93a4-4819ee1407a5 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:51.381230 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efd97c-7635-4de8-93a4-4819ee1407a5 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:51.386121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700ba2-cb31-4e3d-8c8e-cbbcced0b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:51.386809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700ba2-cb31-4e3d-8c8e-cbbcced0b6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:51.387094 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700ba2-cb31-4e3d-8c8e-cbbcced0b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:51.387377 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700ba2-cb31-4e3d-8c8e-cbbcced0b6c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:51.388136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce700ba2-cb31-4e3d-8c8e-cbbcced0b6c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:46:51.388478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce700ba2-cb31-4e3d-8c8e-cbbcced0b6c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:51.390202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce700ba2-cb31-4e3d-8c8e-cbbcced0b6c1 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:51.404363 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1340/2667] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:46:51.407288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa83ba-0b85-4fb3-92c1-0d67df356823 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:51.417563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa83ba-0b85-4fb3-92c1-0d67df356823 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:51.424191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1156378-ae23-4f54-ab7c-34c71fbbb8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:51.424191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156378-ae23-4f54-ab7c-34c71fbbb8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:51.424868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156378-ae23-4f54-ab7c-34c71fbbb8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:51.424868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156378-ae23-4f54-ab7c-34c71fbbb8f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:51.425526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1156378-ae23-4f54-ab7c-34c71fbbb8f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:51.427304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1156378-ae23-4f54-ab7c-34c71fbbb8f7 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:51.516397 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1328/2668] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:51 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:46:51.517862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700ba2-cb31-4e3d-8c8e-cbbcced0b6c1 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:51.529266 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700ba2-cb31-4e3d-8c8e-cbbcced0b6c1 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:51.596901 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33aff7-e765-4dfd-9ffc-39f549eb6aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:51.597600 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33aff7-e765-4dfd-9ffc-39f549eb6aff admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:51.597875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33aff7-e765-4dfd-9ffc-39f549eb6aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:51.598467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33aff7-e765-4dfd-9ffc-39f549eb6aff admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:51.598854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33aff7-e765-4dfd-9ffc-39f549eb6aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:51.600853 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33aff7-e765-4dfd-9ffc-39f549eb6aff admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:51.704135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1341/2669] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:51 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:46:51.705378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1156378-ae23-4f54-ab7c-34c71fbbb8f7 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:51.722815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1156378-ae23-4f54-ab7c-34c71fbbb8f7 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:51.728663 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746d43f-7d84-4763-a9e4-0812a7e1daf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:51.729729 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746d43f-7d84-4763-a9e4-0812a7e1daf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:51.729935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746d43f-7d84-4763-a9e4-0812a7e1daf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:51.730276 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746d43f-7d84-4763-a9e4-0812a7e1daf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:51.731107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746d43f-7d84-4763-a9e4-0812a7e1daf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:51.733045 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746d43f-7d84-4763-a9e4-0812a7e1daf5 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:51.747394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1329/2670] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:51.748624 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33aff7-e765-4dfd-9ffc-39f549eb6aff admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:51.759212 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33aff7-e765-4dfd-9ffc-39f549eb6aff admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:51.764709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb500f8-4c10-440d-9646-5d07d0448716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:51.766942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb500f8-4c10-440d-9646-5d07d0448716 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:51.766942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb500f8-4c10-440d-9646-5d07d0448716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:51.766942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb500f8-4c10-440d-9646-5d07d0448716 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:51.766942 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb500f8-4c10-440d-9646-5d07d0448716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:51.768515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb500f8-4c10-440d-9646-5d07d0448716 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:51.780780 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1342/2671] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:51.785296 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746d43f-7d84-4763-a9e4-0812a7e1daf5 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:51.795789 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746d43f-7d84-4763-a9e4-0812a7e1daf5 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:51.800571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ca86f-e922-4790-8e4b-b5ad1e0eb212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:51.801449 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ca86f-e922-4790-8e4b-b5ad1e0eb212 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:51.801725 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ca86f-e922-4790-8e4b-b5ad1e0eb212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:51.802013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ca86f-e922-4790-8e4b-b5ad1e0eb212 admin admin] PATH_INFO: `/v3/projects/6b1c4026d9e04e1293d2335aec79707e/users/377ad1e291b04c7ab21a2f92a6b2fae6/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:51.822290 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ca86f-e922-4790-8e4b-b5ad1e0eb212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1c4026d9e04e1293d2335aec79707e, user_id=377ad1e291b04c7ab21a2f92a6b2fae6, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:51.826214 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ca86f-e922-4790-8e4b-b5ad1e0eb212 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:51.878647 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c545190-4615-426b-b125-101926d8d7f5 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:51.878945 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c545190-4615-426b-b125-101926d8d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:51.879437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c545190-4615-426b-b125-101926d8d7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:51.900325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-2c545190-4615-426b-b125-101926d8d7f5 None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:51.901730 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2c545190-4615-426b-b125-101926d8d7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:51.912324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1330/2672] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:51 2022] PUT /identity/v3/projects/6b1c4026d9e04e1293d2335aec79707e/users/377ad1e291b04c7ab21a2f92a6b2fae6/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:51.924166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ab4cb-3f46-4ad0-a82a-fed39b56c26b None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:51.924460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ab4cb-3f46-4ad0-a82a-fed39b56c26b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:51.927917 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ab4cb-3f46-4ad0-a82a-fed39b56c26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:51.955419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-bd1ab4cb-3f46-4ad0-a82a-fed39b56c26b None None] MFA Rules not processed for user `377ad1e291b04c7ab21a2f92a6b2fae6`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:51.958252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-bd1ab4cb-3f46-4ad0-a82a-fed39b56c26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:51.976981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1343/2673] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:46:52.004800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c545190-4615-426b-b125-101926d8d7f5 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:52.006351 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2c545190-4615-426b-b125-101926d8d7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:52.028782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1331/2674] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:46:52.033581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ab4cb-3f46-4ad0-a82a-fed39b56c26b None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:52.076377 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c545190-4615-426b-b125-101926d8d7f5 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:52.101269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ab4cb-3f46-4ad0-a82a-fed39b56c26b None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:52.106244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c44b0-e2b0-4547-b1d7-25b91b7477e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:52.106910 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c44b0-e2b0-4547-b1d7-25b91b7477e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:52.107192 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c44b0-e2b0-4547-b1d7-25b91b7477e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:52.107464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c44b0-e2b0-4547-b1d7-25b91b7477e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:52.108173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c44b0-e2b0-4547-b1d7-25b91b7477e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:52.110238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c44b0-e2b0-4547-b1d7-25b91b7477e8 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:52.145366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fcc09-f458-43d6-870b-169512c07079 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:52.146143 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fcc09-f458-43d6-870b-169512c07079 service swift] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:52.146435 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fcc09-f458-43d6-870b-169512c07079 service swift] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:52.146716 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fcc09-f458-43d6-870b-169512c07079 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:52.198660 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1332/2675] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:46:52 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:46:52.202782 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c44b0-e2b0-4547-b1d7-25b91b7477e8 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:52.203793 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fcc09-f458-43d6-870b-169512c07079 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:52.205512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fcc09-f458-43d6-870b-169512c07079 service swift] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:52.214162 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1344/2676] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:46:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 15:46:52.270179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c44b0-e2b0-4547-b1d7-25b91b7477e8 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:52.274887 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b527e07-64ac-42bb-944d-5ef7e200f786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:52.275549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b527e07-64ac-42bb-944d-5ef7e200f786 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:52.275918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b527e07-64ac-42bb-944d-5ef7e200f786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:52.276441 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b527e07-64ac-42bb-944d-5ef7e200f786 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:52.277134 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b527e07-64ac-42bb-944d-5ef7e200f786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:52.279593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b527e07-64ac-42bb-944d-5ef7e200f786 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:52.396980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1333/2677] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:46:52 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:46:52.399863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fcc09-f458-43d6-870b-169512c07079 service swift] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:52.412271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fcc09-f458-43d6-870b-169512c07079 service swift] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:52.421615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b867b-97b7-4133-ac4f-58270514e189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:52.445398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b867b-97b7-4133-ac4f-58270514e189 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:52.445740 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b867b-97b7-4133-ac4f-58270514e189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:52.445971 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b867b-97b7-4133-ac4f-58270514e189 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:52.446808 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b867b-97b7-4133-ac4f-58270514e189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:52.450098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b867b-97b7-4133-ac4f-58270514e189 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:52.467072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1345/2678] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:52.469003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b527e07-64ac-42bb-944d-5ef7e200f786 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:52.479965 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b527e07-64ac-42bb-944d-5ef7e200f786 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:52.485299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36411245-beb3-4ecc-b1b2-2885b3bc8fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:52.486180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36411245-beb3-4ecc-b1b2-2885b3bc8fec admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:52.486503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36411245-beb3-4ecc-b1b2-2885b3bc8fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:52.486774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36411245-beb3-4ecc-b1b2-2885b3bc8fec admin admin] PATH_INFO: `/v3/projects/8c3cb5f274ea475c97591413283a893c/users/f48aeaf5d2b64897bb2b8396b09594f6/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:52.502849 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36411245-beb3-4ecc-b1b2-2885b3bc8fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3cb5f274ea475c97591413283a893c, user_id=f48aeaf5d2b64897bb2b8396b09594f6, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:52.505630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36411245-beb3-4ecc-b1b2-2885b3bc8fec admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:52.586255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1334/2679] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:52 2022] PUT /identity/v3/projects/8c3cb5f274ea475c97591413283a893c/users/f48aeaf5d2b64897bb2b8396b09594f6/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:52.590781 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b867b-97b7-4133-ac4f-58270514e189 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:52.600951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b867b-97b7-4133-ac4f-58270514e189 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:52.658149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdde2d2-4abc-4ce8-832e-d8871833ad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:52.658826 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdde2d2-4abc-4ce8-832e-d8871833ad08 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:52.659105 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdde2d2-4abc-4ce8-832e-d8871833ad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:52.659572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdde2d2-4abc-4ce8-832e-d8871833ad08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:52.660493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdde2d2-4abc-4ce8-832e-d8871833ad08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:52.662097 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdde2d2-4abc-4ce8-832e-d8871833ad08 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:52.671819 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1346/2680] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:46:52.676301 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36411245-beb3-4ecc-b1b2-2885b3bc8fec admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:52.686787 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36411245-beb3-4ecc-b1b2-2885b3bc8fec admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:52.691469 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ddb97-6e0e-4d15-af49-dd7cee0a118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:52.692387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ddb97-6e0e-4d15-af49-dd7cee0a118b admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:52.692674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ddb97-6e0e-4d15-af49-dd7cee0a118b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:52.692970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ddb97-6e0e-4d15-af49-dd7cee0a118b admin admin] PATH_INFO: `/v3/projects/8c3cb5f274ea475c97591413283a893c/users/f48aeaf5d2b64897bb2b8396b09594f6/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:52.694943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ddb97-6e0e-4d15-af49-dd7cee0a118b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3cb5f274ea475c97591413283a893c, user_id=f48aeaf5d2b64897bb2b8396b09594f6, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:52.697603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ddb97-6e0e-4d15-af49-dd7cee0a118b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:52.708763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1335/2681] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:46:52 2022] PUT /identity/v3/projects/8c3cb5f274ea475c97591413283a893c/users/f48aeaf5d2b64897bb2b8396b09594f6/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:52.719751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7f10e-cad2-41d8-82a6-38d910c80ade None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:52.720048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7f10e-cad2-41d8-82a6-38d910c80ade None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:52.720386 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7f10e-cad2-41d8-82a6-38d910c80ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:52.748084 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-04e7f10e-cad2-41d8-82a6-38d910c80ade None None] MFA Rules not processed for user `f48aeaf5d2b64897bb2b8396b09594f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:52.750336 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-04e7f10e-cad2-41d8-82a6-38d910c80ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:52.827510 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1347/2682] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:52.842803 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ddb97-6e0e-4d15-af49-dd7cee0a118b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:52.849523 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-353ddb97-6e0e-4d15-af49-dd7cee0a118b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:52.917028 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ddb97-6e0e-4d15-af49-dd7cee0a118b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:52.921530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453fc29-1c96-45e8-bd7a-403fb7654e76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:52.924037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453fc29-1c96-45e8-bd7a-403fb7654e76 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:52.924037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453fc29-1c96-45e8-bd7a-403fb7654e76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:52.924037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453fc29-1c96-45e8-bd7a-403fb7654e76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:52.939973 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453fc29-1c96-45e8-bd7a-403fb7654e76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:52.939973 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453fc29-1c96-45e8-bd7a-403fb7654e76 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:52.952279 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1336/2683] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:53.049324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7f10e-cad2-41d8-82a6-38d910c80ade None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:53.051208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-04e7f10e-cad2-41d8-82a6-38d910c80ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:53.066298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7f10e-cad2-41d8-82a6-38d910c80ade None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:53.070078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6949bf-3cf5-4d81-83c6-4451ec1d77dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:53.070722 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6949bf-3cf5-4d81-83c6-4451ec1d77dc service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:53.071005 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6949bf-3cf5-4d81-83c6-4451ec1d77dc service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:53.071280 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6949bf-3cf5-4d81-83c6-4451ec1d77dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:53.147338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6949bf-3cf5-4d81-83c6-4451ec1d77dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:53.148460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6949bf-3cf5-4d81-83c6-4451ec1d77dc service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:53.159519 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1348/2684] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:46:53.169561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd61c1e-3733-4293-85d8-ed3e9434014d None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:53.170064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd61c1e-3733-4293-85d8-ed3e9434014d None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:53.170335 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd61c1e-3733-4293-85d8-ed3e9434014d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:53.191136 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-8bd61c1e-3733-4293-85d8-ed3e9434014d None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:53.192451 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8bd61c1e-3733-4293-85d8-ed3e9434014d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:53.248508 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1337/2685] 10.222.0.25 () {58 vars in 967 bytes} [Tue Mar 8 15:46:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:53.260717 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6949bf-3cf5-4d81-83c6-4451ec1d77dc service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:53.323785 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6949bf-3cf5-4d81-83c6-4451ec1d77dc service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:53.329458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d51881-45a5-4b3c-b22f-2ff1c3564885 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:53.330085 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d51881-45a5-4b3c-b22f-2ff1c3564885 service swift] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:53.330427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d51881-45a5-4b3c-b22f-2ff1c3564885 service swift] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:53.330702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d51881-45a5-4b3c-b22f-2ff1c3564885 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:53.338616 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d51881-45a5-4b3c-b22f-2ff1c3564885 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:53.340788 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d51881-45a5-4b3c-b22f-2ff1c3564885 service swift] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:53.348552 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1349/2686] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:46:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:46:53.894243 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795f08a-1d3c-4560-866e-f2a39a7ca07e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:53.894588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795f08a-1d3c-4560-866e-f2a39a7ca07e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:53.894962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795f08a-1d3c-4560-866e-f2a39a7ca07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:53.914227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-3795f08a-1d3c-4560-866e-f2a39a7ca07e None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:53.915529 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-3795f08a-1d3c-4560-866e-f2a39a7ca07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:53.924108 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1338/2687] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Mar 8 15:46:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:53.938048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d51881-45a5-4b3c-b22f-2ff1c3564885 service swift] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:53.948809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d51881-45a5-4b3c-b22f-2ff1c3564885 service swift] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:53.954090 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24340b98-bca9-4d2a-9c20-8a9611cd1ec1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:53.954712 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24340b98-bca9-4d2a-9c20-8a9611cd1ec1 service swift] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:53.955072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24340b98-bca9-4d2a-9c20-8a9611cd1ec1 service swift] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:53.955422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24340b98-bca9-4d2a-9c20-8a9611cd1ec1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:53.963873 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24340b98-bca9-4d2a-9c20-8a9611cd1ec1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:53.965567 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24340b98-bca9-4d2a-9c20-8a9611cd1ec1 service swift] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:53.973777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1350/2688] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:46:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:46:54.626827 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedaba6-c4cf-4562-854e-67199d472174 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:54.627234 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedaba6-c4cf-4562-854e-67199d472174 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:54.627385 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedaba6-c4cf-4562-854e-67199d472174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:54.645931 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7bedaba6-c4cf-4562-854e-67199d472174 None None] MFA Rules not processed for user `21f49c3c297e4a2b89260910c90bc21d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:54.647128 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7bedaba6-c4cf-4562-854e-67199d472174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:54.655129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1339/2689] 10.222.0.25 () {58 vars in 967 bytes} [Tue Mar 8 15:46:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:54.667767 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24340b98-bca9-4d2a-9c20-8a9611cd1ec1 service swift] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:54.679447 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24340b98-bca9-4d2a-9c20-8a9611cd1ec1 service swift] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:54.684652 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659569a-798e-4a33-836c-6af8db74f84e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10fc82e0c3f0414492c1df4381918877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:54.685296 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659569a-798e-4a33-836c-6af8db74f84e service swift] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:54.685631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659569a-798e-4a33-836c-6af8db74f84e service swift] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:54.685931 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659569a-798e-4a33-836c-6af8db74f84e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:54.694425 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659569a-798e-4a33-836c-6af8db74f84e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:54.696010 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659569a-798e-4a33-836c-6af8db74f84e service swift] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:54.705222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1351/2690] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Mar 8 15:46:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 15:46:57.558233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedaba6-c4cf-4562-854e-67199d472174 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:57.559642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7bedaba6-c4cf-4562-854e-67199d472174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:57.627716 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedaba6-c4cf-4562-854e-67199d472174 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:57.634642 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818f582-d572-46d9-820e-c7b64153f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:57.635526 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818f582-d572-46d9-820e-c7b64153f03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:57.635810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818f582-d572-46d9-820e-c7b64153f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:57.636223 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818f582-d572-46d9-820e-c7b64153f03b admin admin] PATH_INFO: `/v3/users/26e84d1c3dba49b29c16bc46fe8faa4f` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:57.638124 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818f582-d572-46d9-820e-c7b64153f03b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e84d1c3dba49b29c16bc46fe8faa4f)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:57.640625 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818f582-d572-46d9-820e-c7b64153f03b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:57.977044 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659569a-798e-4a33-836c-6af8db74f84e service swift] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:57.987854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659569a-798e-4a33-836c-6af8db74f84e service swift] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:57.992711 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d12e5-242e-4fae-880c-eb7f2285992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:57.993565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d12e5-242e-4fae-880c-eb7f2285992b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:57.993843 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d12e5-242e-4fae-880c-eb7f2285992b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:57.994115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d12e5-242e-4fae-880c-eb7f2285992b admin admin] PATH_INFO: `/v3/users/377ad1e291b04c7ab21a2f92a6b2fae6` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:57.995299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d12e5-242e-4fae-880c-eb7f2285992b admin admin] RBAC: Authorizing `identity:delete_user(user_id=377ad1e291b04c7ab21a2f92a6b2fae6)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:57.997367 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d12e5-242e-4fae-880c-eb7f2285992b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:58.057599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3818f582-d572-46d9-820e-c7b64153f03b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e84d1c3dba49b29c16bc46fe8faa4f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.151736 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3818f582-d572-46d9-820e-c7b64153f03b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e84d1c3dba49b29c16bc46fe8faa4f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.165413 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3818f582-d572-46d9-820e-c7b64153f03b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e84d1c3dba49b29c16bc46fe8faa4f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.166376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3818f582-d572-46d9-820e-c7b64153f03b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e84d1c3dba49b29c16bc46fe8faa4f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.174258 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-3818f582-d572-46d9-820e-c7b64153f03b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e84d1c3dba49b29c16bc46fe8faa4f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.180835 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1340/2691] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:57 2022] DELETE /identity/v3/users/26e84d1c3dba49b29c16bc46fe8faa4f => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:58.185213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf322d2-2b34-40da-8ced-cc87d03a13dc None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:58.185572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf322d2-2b34-40da-8ced-cc87d03a13dc None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:58.185945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf322d2-2b34-40da-8ced-cc87d03a13dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:58.212616 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-caf322d2-2b34-40da-8ced-cc87d03a13dc None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:58.214935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-caf322d2-2b34-40da-8ced-cc87d03a13dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:58.236300 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e58d12e5-242e-4fae-880c-eb7f2285992b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377ad1e291b04c7ab21a2f92a6b2fae6'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.237063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e58d12e5-242e-4fae-880c-eb7f2285992b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377ad1e291b04c7ab21a2f92a6b2fae6'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.276672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1341/2692] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:46:58.293767 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf322d2-2b34-40da-8ced-cc87d03a13dc None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:58.295432 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-caf322d2-2b34-40da-8ced-cc87d03a13dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:58.327910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e58d12e5-242e-4fae-880c-eb7f2285992b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377ad1e291b04c7ab21a2f92a6b2fae6'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.328573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e58d12e5-242e-4fae-880c-eb7f2285992b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377ad1e291b04c7ab21a2f92a6b2fae6'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.341207 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e58d12e5-242e-4fae-880c-eb7f2285992b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377ad1e291b04c7ab21a2f92a6b2fae6'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.356872 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1352/2693] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:57 2022] DELETE /identity/v3/users/377ad1e291b04c7ab21a2f92a6b2fae6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:46:58.358080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf322d2-2b34-40da-8ced-cc87d03a13dc None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:58.365133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ac45e-7824-4a86-826f-20e7a17c9f5c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:58.365426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ac45e-7824-4a86-826f-20e7a17c9f5c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:58.365910 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ac45e-7824-4a86-826f-20e7a17c9f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:58.384168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-000ac45e-7824-4a86-826f-20e7a17c9f5c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:46:58.385655 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-000ac45e-7824-4a86-826f-20e7a17c9f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:58.407539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edacc4-db5c-45df-8f43-aa0da79c53ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:58.408235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edacc4-db5c-45df-8f43-aa0da79c53ec service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:58.408525 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edacc4-db5c-45df-8f43-aa0da79c53ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:58.408804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edacc4-db5c-45df-8f43-aa0da79c53ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:58.445973 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1353/2694] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:46:58.455643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ac45e-7824-4a86-826f-20e7a17c9f5c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:58.465542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ac45e-7824-4a86-826f-20e7a17c9f5c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:58.469150 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cf02d-9b16-4ce1-946c-7c25da8b238f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:58.474915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cf02d-9b16-4ce1-946c-7c25da8b238f service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:58.474915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cf02d-9b16-4ce1-946c-7c25da8b238f service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:58.474915 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cf02d-9b16-4ce1-946c-7c25da8b238f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:58.475213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edacc4-db5c-45df-8f43-aa0da79c53ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:58.475213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edacc4-db5c-45df-8f43-aa0da79c53ec service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:58.479392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cf02d-9b16-4ce1-946c-7c25da8b238f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:58.480897 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cf02d-9b16-4ce1-946c-7c25da8b238f service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:58.484059 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1342/2695] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:46:58.490492 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1354/2696] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:46:58.740030 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edacc4-db5c-45df-8f43-aa0da79c53ec service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:58.741564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-61edacc4-db5c-45df-8f43-aa0da79c53ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:58.754562 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edacc4-db5c-45df-8f43-aa0da79c53ec service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:58.760377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:58.760555 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:58.760708 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:58.760955 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] PATH_INFO: `/v3/projects/6c1ebb14d8c0420b80497ed1d1eed585` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:58.762291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c1ebb14d8c0420b80497ed1d1eed585)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:58.764308 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:58.883496 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c1ebb14d8c0420b80497ed1d1eed585', 'request_id': 'req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.888992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c1ebb14d8c0420b80497ed1d1eed585', 'request_id': 'req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.895248 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c1ebb14d8c0420b80497ed1d1eed585', 'request_id': 'req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.970747 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cf02d-9b16-4ce1-946c-7c25da8b238f service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:58.972201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-da6cf02d-9b16-4ce1-946c-7c25da8b238f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:58.986075 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cf02d-9b16-4ce1-946c-7c25da8b238f service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:58.986934 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] The token cache is being invalidate because project 6c1ebb14d8c0420b80497ed1d1eed585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:58.987331 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.988109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:58.990470 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1343/2697] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:58 2022] DELETE /identity/v3/projects/6c1ebb14d8c0420b80497ed1d1eed585 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:46:59.048824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:59.049698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:59.050006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:59.050281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] PATH_INFO: `/v3/projects/6b1c4026d9e04e1293d2335aec79707e` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:59.051624 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1c4026d9e04e1293d2335aec79707e)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:59.053692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:59.181580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1c4026d9e04e1293d2335aec79707e', 'request_id': 'req-bc966bda-4bf9-4055-83a2-18e886daa3de'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:59.187198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1c4026d9e04e1293d2335aec79707e', 'request_id': 'req-bc966bda-4bf9-4055-83a2-18e886daa3de'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:59.265685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1c4026d9e04e1293d2335aec79707e', 'request_id': 'req-bc966bda-4bf9-4055-83a2-18e886daa3de'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:59.277829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] The token cache is being invalidate because project 6b1c4026d9e04e1293d2335aec79707e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:46:59.278117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:59.278776 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:59.280333 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1355/2698] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:46:58 2022] DELETE /identity/v3/projects/6b1c4026d9e04e1293d2335aec79707e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:46:59.284387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:46:59.285776 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:46:59.298580 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae94c3-3bf0-4937-ba79-bdafbe2d3bab admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:46:59.361692 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0422a3-5737-479f-b019-d11537fc625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:46:59.362577 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0422a3-5737-479f-b019-d11537fc625e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:46:59.362865 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0422a3-5737-479f-b019-d11537fc625e admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:46:59.363127 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0422a3-5737-479f-b019-d11537fc625e admin admin] PATH_INFO: `/v3/users/f48aeaf5d2b64897bb2b8396b09594f6` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:46:59.364395 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0422a3-5737-479f-b019-d11537fc625e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48aeaf5d2b64897bb2b8396b09594f6)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:46:59.366939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0422a3-5737-479f-b019-d11537fc625e admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:46:59.530282 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-aa0422a3-5737-479f-b019-d11537fc625e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48aeaf5d2b64897bb2b8396b09594f6'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:59.586281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-aa0422a3-5737-479f-b019-d11537fc625e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48aeaf5d2b64897bb2b8396b09594f6'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:59.598540 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-aa0422a3-5737-479f-b019-d11537fc625e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48aeaf5d2b64897bb2b8396b09594f6'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:59.599166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-aa0422a3-5737-479f-b019-d11537fc625e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48aeaf5d2b64897bb2b8396b09594f6'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:59.605787 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-aa0422a3-5737-479f-b019-d11537fc625e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48aeaf5d2b64897bb2b8396b09594f6'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:46:59.611470 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1344/2699] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:46:59 2022] DELETE /identity/v3/users/f48aeaf5d2b64897bb2b8396b09594f6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:00.016198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:00.017705 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:00.030295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc966bda-4bf9-4055-83a2-18e886daa3de admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:00.084985 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2e02f-ed34-4880-9bee-8598934b68e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:00.085749 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2e02f-ed34-4880-9bee-8598934b68e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:00.086035 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2e02f-ed34-4880-9bee-8598934b68e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:00.086313 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2e02f-ed34-4880-9bee-8598934b68e4 admin admin] PATH_INFO: `/v3/projects/8c3cb5f274ea475c97591413283a893c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:00.087481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2e02f-ed34-4880-9bee-8598934b68e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3cb5f274ea475c97591413283a893c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:00.089437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2e02f-ed34-4880-9bee-8598934b68e4 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:00.186664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7ea2e02f-ed34-4880-9bee-8598934b68e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3cb5f274ea475c97591413283a893c', 'request_id': 'req-7ea2e02f-ed34-4880-9bee-8598934b68e4'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:00.191841 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7ea2e02f-ed34-4880-9bee-8598934b68e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3cb5f274ea475c97591413283a893c', 'request_id': 'req-7ea2e02f-ed34-4880-9bee-8598934b68e4'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:00.242341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7ea2e02f-ed34-4880-9bee-8598934b68e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3cb5f274ea475c97591413283a893c', 'request_id': 'req-7ea2e02f-ed34-4880-9bee-8598934b68e4'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:00.253044 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7ea2e02f-ed34-4880-9bee-8598934b68e4 admin admin] The token cache is being invalidate because project 8c3cb5f274ea475c97591413283a893c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:47:00.253327 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7ea2e02f-ed34-4880-9bee-8598934b68e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:00.256391 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7ea2e02f-ed34-4880-9bee-8598934b68e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:00.256391 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1356/2700] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:47:00 2022] DELETE /identity/v3/projects/8c3cb5f274ea475c97591413283a893c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:00.261245 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed69ee1-bf96-4b6d-9f53-36a4b69b665c None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:00.261732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed69ee1-bf96-4b6d-9f53-36a4b69b665c None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:00.261832 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed69ee1-bf96-4b6d-9f53-36a4b69b665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:00.279900 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-bed69ee1-bf96-4b6d-9f53-36a4b69b665c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:00.281115 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-bed69ee1-bf96-4b6d-9f53-36a4b69b665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:00.338140 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1345/2701] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:00.346298 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1cc89-f7c5-4c69-a40f-8418dbf2030c None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:00.346586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1cc89-f7c5-4c69-a40f-8418dbf2030c None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:00.346864 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1cc89-f7c5-4c69-a40f-8418dbf2030c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:00.364951 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-46f1cc89-f7c5-4c69-a40f-8418dbf2030c None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:00.366121 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-46f1cc89-f7c5-4c69-a40f-8418dbf2030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:00.373840 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1357/2702] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:00.377829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed69ee1-bf96-4b6d-9f53-36a4b69b665c None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:00.387136 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed69ee1-bf96-4b6d-9f53-36a4b69b665c None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:00.391578 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc152aab-345a-404f-a696-97da7fc23500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:00.392242 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc152aab-345a-404f-a696-97da7fc23500 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:00.392522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc152aab-345a-404f-a696-97da7fc23500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:00.392793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc152aab-345a-404f-a696-97da7fc23500 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:00.393495 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc152aab-345a-404f-a696-97da7fc23500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:47:00.393797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc152aab-345a-404f-a696-97da7fc23500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:00.395370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc152aab-345a-404f-a696-97da7fc23500 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:00.406716 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1346/2703] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:47:00.410664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1cc89-f7c5-4c69-a40f-8418dbf2030c None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:00.420369 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1cc89-f7c5-4c69-a40f-8418dbf2030c None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:00.425312 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1181c-6455-4693-9391-b6a41273f928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:00.425950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1181c-6455-4693-9391-b6a41273f928 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:00.426231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1181c-6455-4693-9391-b6a41273f928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:00.426507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1181c-6455-4693-9391-b6a41273f928 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:00.427196 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1181c-6455-4693-9391-b6a41273f928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:00.429130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1181c-6455-4693-9391-b6a41273f928 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:00.545485 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1358/2704] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:47:00 2022] POST /identity/v3/projects => generated 401 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:47:00.550585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc152aab-345a-404f-a696-97da7fc23500 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:00.556961 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc152aab-345a-404f-a696-97da7fc23500 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:00.618093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac32e0-5dbc-49ab-9447-8492b0a9082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:00.618761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac32e0-5dbc-49ab-9447-8492b0a9082f admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:00.619064 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac32e0-5dbc-49ab-9447-8492b0a9082f admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:00.619332 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac32e0-5dbc-49ab-9447-8492b0a9082f admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:00.620021 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac32e0-5dbc-49ab-9447-8492b0a9082f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:00.622648 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac32e0-5dbc-49ab-9447-8492b0a9082f admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:00.705826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1347/2705] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:47:00 2022] POST /identity/v3/users => generated 301 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:47:00.714925 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1181c-6455-4693-9391-b6a41273f928 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:00.725594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1181c-6455-4693-9391-b6a41273f928 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:00.731027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fdbb0-35c6-46d7-b13c-68c05da8128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:00.731759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fdbb0-35c6-46d7-b13c-68c05da8128d admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:00.732113 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fdbb0-35c6-46d7-b13c-68c05da8128d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:00.732488 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fdbb0-35c6-46d7-b13c-68c05da8128d admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:00.733290 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fdbb0-35c6-46d7-b13c-68c05da8128d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:00.734897 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fdbb0-35c6-46d7-b13c-68c05da8128d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:00.746675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1359/2706] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:00.750539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac32e0-5dbc-49ab-9447-8492b0a9082f admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:00.760780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac32e0-5dbc-49ab-9447-8492b0a9082f admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:00.765684 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bed18-3034-4379-b6c3-2c3da5f907e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:00.766424 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bed18-3034-4379-b6c3-2c3da5f907e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:00.766991 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bed18-3034-4379-b6c3-2c3da5f907e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:00.767270 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bed18-3034-4379-b6c3-2c3da5f907e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:00.767988 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bed18-3034-4379-b6c3-2c3da5f907e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:00.769689 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bed18-3034-4379-b6c3-2c3da5f907e9 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:00.780254 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1348/2707] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:00.784233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fdbb0-35c6-46d7-b13c-68c05da8128d admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:00.794620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fdbb0-35c6-46d7-b13c-68c05da8128d admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:00.799664 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4abf0c-954d-4ca5-8cc5-9fff8b7b7995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:00.800567 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4abf0c-954d-4ca5-8cc5-9fff8b7b7995 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:00.800848 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4abf0c-954d-4ca5-8cc5-9fff8b7b7995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:00.801120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4abf0c-954d-4ca5-8cc5-9fff8b7b7995 admin admin] PATH_INFO: `/v3/projects/77ce8751741c4b57933ca5306e2da59c/users/55e549a65a844257bdc6f1795e119444/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:00.815866 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4abf0c-954d-4ca5-8cc5-9fff8b7b7995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ce8751741c4b57933ca5306e2da59c, user_id=55e549a65a844257bdc6f1795e119444, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:00.818532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4abf0c-954d-4ca5-8cc5-9fff8b7b7995 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:00.865701 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1360/2708] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:47:00 2022] PUT /identity/v3/projects/77ce8751741c4b57933ca5306e2da59c/users/55e549a65a844257bdc6f1795e119444/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:00.876444 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df182d-ae1a-48a5-9fc7-bcae2066655a None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:00.876747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df182d-ae1a-48a5-9fc7-bcae2066655a None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:00.877002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df182d-ae1a-48a5-9fc7-bcae2066655a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:00.902696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-11df182d-ae1a-48a5-9fc7-bcae2066655a None None] MFA Rules not processed for user `55e549a65a844257bdc6f1795e119444`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:00.903892 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-11df182d-ae1a-48a5-9fc7-bcae2066655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:00.971324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1349/2709] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:00.975792 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4abf0c-954d-4ca5-8cc5-9fff8b7b7995 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:01.034697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4abf0c-954d-4ca5-8cc5-9fff8b7b7995 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:01.039736 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf824cf-b650-4d8f-956a-cca15b27319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:01.040415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf824cf-b650-4d8f-956a-cca15b27319e admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:01.040696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf824cf-b650-4d8f-956a-cca15b27319e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:01.040972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf824cf-b650-4d8f-956a-cca15b27319e admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:01.041649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf824cf-b650-4d8f-956a-cca15b27319e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:01.044156 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf824cf-b650-4d8f-956a-cca15b27319e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:01.116337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1361/2710] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:47:00 2022] POST /identity/v3/projects => generated 401 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:47:01.117594 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df182d-ae1a-48a5-9fc7-bcae2066655a None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:01.128230 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df182d-ae1a-48a5-9fc7-bcae2066655a None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:01.182747 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd00902-8610-406a-93e7-bfeff3113c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:01.183543 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd00902-8610-406a-93e7-bfeff3113c57 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:01.183820 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd00902-8610-406a-93e7-bfeff3113c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:01.184094 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd00902-8610-406a-93e7-bfeff3113c57 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:01.184809 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd00902-8610-406a-93e7-bfeff3113c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:01.186704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd00902-8610-406a-93e7-bfeff3113c57 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:01.242907 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1350/2711] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:47:01 2022] POST /identity/v3/users => generated 307 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:47:01.246924 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf824cf-b650-4d8f-956a-cca15b27319e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:01.257434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf824cf-b650-4d8f-956a-cca15b27319e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:01.262098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124eb4b-2338-4d4c-85e7-cb4b5169214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:01.262751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124eb4b-2338-4d4c-85e7-cb4b5169214d admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:01.263186 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124eb4b-2338-4d4c-85e7-cb4b5169214d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:01.263466 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124eb4b-2338-4d4c-85e7-cb4b5169214d admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:01.264221 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124eb4b-2338-4d4c-85e7-cb4b5169214d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:01.265805 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124eb4b-2338-4d4c-85e7-cb4b5169214d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:01.276577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1362/2712] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:01.281188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd00902-8610-406a-93e7-bfeff3113c57 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:01.291199 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd00902-8610-406a-93e7-bfeff3113c57 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:01.300662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99101c3-1fa0-44a3-957d-c5c0888e7eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:01.300662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99101c3-1fa0-44a3-957d-c5c0888e7eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:01.300662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99101c3-1fa0-44a3-957d-c5c0888e7eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:01.300662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99101c3-1fa0-44a3-957d-c5c0888e7eaa admin admin] PATH_INFO: `/v3/projects/a128459d23964788a8c52e4ede538e54/users/3b7ba7bc4857456982fbf44fb4bbe8a0/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:01.312107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99101c3-1fa0-44a3-957d-c5c0888e7eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a128459d23964788a8c52e4ede538e54, user_id=3b7ba7bc4857456982fbf44fb4bbe8a0, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:01.314826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99101c3-1fa0-44a3-957d-c5c0888e7eaa admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:01.385651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1351/2713] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:47:01 2022] PUT /identity/v3/projects/a128459d23964788a8c52e4ede538e54/users/3b7ba7bc4857456982fbf44fb4bbe8a0/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:01.390048 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124eb4b-2338-4d4c-85e7-cb4b5169214d admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:01.400082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124eb4b-2338-4d4c-85e7-cb4b5169214d admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:01.454941 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02135f6f-1be6-439d-af5e-88b975260cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:01.455603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02135f6f-1be6-439d-af5e-88b975260cff admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:01.455887 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02135f6f-1be6-439d-af5e-88b975260cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:01.456181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02135f6f-1be6-439d-af5e-88b975260cff admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:01.456899 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02135f6f-1be6-439d-af5e-88b975260cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:01.458487 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02135f6f-1be6-439d-af5e-88b975260cff admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:01.471745 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1363/2714] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:01.472780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99101c3-1fa0-44a3-957d-c5c0888e7eaa admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:01.482902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99101c3-1fa0-44a3-957d-c5c0888e7eaa admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:01.487645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6788c-d580-4c01-899b-1dbf050ef276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:01.488558 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6788c-d580-4c01-899b-1dbf050ef276 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:01.488842 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6788c-d580-4c01-899b-1dbf050ef276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:01.489115 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6788c-d580-4c01-899b-1dbf050ef276 admin admin] PATH_INFO: `/v3/projects/a128459d23964788a8c52e4ede538e54/users/3b7ba7bc4857456982fbf44fb4bbe8a0/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:01.491079 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6788c-d580-4c01-899b-1dbf050ef276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a128459d23964788a8c52e4ede538e54, user_id=3b7ba7bc4857456982fbf44fb4bbe8a0, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:01.493762 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6788c-d580-4c01-899b-1dbf050ef276 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:01.503999 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1352/2715] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:47:01 2022] PUT /identity/v3/projects/a128459d23964788a8c52e4ede538e54/users/3b7ba7bc4857456982fbf44fb4bbe8a0/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:01.514653 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a755fd-2385-41ee-a9c9-33b62b66eac3 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:01.514970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a755fd-2385-41ee-a9c9-33b62b66eac3 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:01.515248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a755fd-2385-41ee-a9c9-33b62b66eac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:01.541550 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-54a755fd-2385-41ee-a9c9-33b62b66eac3 None None] MFA Rules not processed for user `3b7ba7bc4857456982fbf44fb4bbe8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:01.542768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-54a755fd-2385-41ee-a9c9-33b62b66eac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:01.609086 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1364/2716] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:01.619768 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6788c-d580-4c01-899b-1dbf050ef276 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:01.621562 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-55b6788c-d580-4c01-899b-1dbf050ef276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:01.678588 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6788c-d580-4c01-899b-1dbf050ef276 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:01.682203 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fb333-4819-43df-8f20-4079a2e4f9a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:01.682838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fb333-4819-43df-8f20-4079a2e4f9a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:01.683180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fb333-4819-43df-8f20-4079a2e4f9a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:01.683457 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fb333-4819-43df-8f20-4079a2e4f9a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:01.692309 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fb333-4819-43df-8f20-4079a2e4f9a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:01.693732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fb333-4819-43df-8f20-4079a2e4f9a1 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:01.703476 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1353/2717] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:01 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:47:01.957927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a755fd-2385-41ee-a9c9-33b62b66eac3 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:01.969016 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a755fd-2385-41ee-a9c9-33b62b66eac3 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:01.973561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf9dad-ef6f-4a58-8241-09ee32d689bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:01.974366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf9dad-ef6f-4a58-8241-09ee32d689bc service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:01.975104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf9dad-ef6f-4a58-8241-09ee32d689bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:01.975104 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf9dad-ef6f-4a58-8241-09ee32d689bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:02.035389 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf9dad-ef6f-4a58-8241-09ee32d689bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:02.037552 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf9dad-ef6f-4a58-8241-09ee32d689bc service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:02.049348 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1365/2718] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:47:06.815209 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fb333-4819-43df-8f20-4079a2e4f9a1 service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:06.873124 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fb333-4819-43df-8f20-4079a2e4f9a1 service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:06.877425 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:06.878272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:06.878551 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:06.878819 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] PATH_INFO: `/v3/users/55e549a65a844257bdc6f1795e119444` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:06.879977 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e549a65a844257bdc6f1795e119444)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:06.881902 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:07.015297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e549a65a844257bdc6f1795e119444'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:07.059562 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e549a65a844257bdc6f1795e119444'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:07.071116 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e549a65a844257bdc6f1795e119444'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:07.071785 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e549a65a844257bdc6f1795e119444'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:07.079156 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e549a65a844257bdc6f1795e119444'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:07.084682 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1354/2719] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:47:06 2022] DELETE /identity/v3/users/55e549a65a844257bdc6f1795e119444 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:07.089238 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b0209-7e34-46f8-b6c4-8bc11635c37d None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:07.089706 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b0209-7e34-46f8-b6c4-8bc11635c37d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:07.089823 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b0209-7e34-46f8-b6c4-8bc11635c37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:07.106902 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-1c2b0209-7e34-46f8-b6c4-8bc11635c37d None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:07.108108 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-1c2b0209-7e34-46f8-b6c4-8bc11635c37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:07.167325 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1366/2720] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:47:07.176938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:07.178513 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:07.233607 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ec3dd-895d-4a2b-8e56-ae9464030508 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:07.237445 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee4ae8-b257-4dcb-af96-8391f2b75c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:07.238084 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee4ae8-b257-4dcb-af96-8391f2b75c77 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:07.238494 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee4ae8-b257-4dcb-af96-8391f2b75c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:07.238876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee4ae8-b257-4dcb-af96-8391f2b75c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:07.248571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee4ae8-b257-4dcb-af96-8391f2b75c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:07.250100 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee4ae8-b257-4dcb-af96-8391f2b75c77 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:07.260735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1355/2721] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:47:07.638272 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b0209-7e34-46f8-b6c4-8bc11635c37d None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:07.639690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-1c2b0209-7e34-46f8-b6c4-8bc11635c37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:07.652966 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b0209-7e34-46f8-b6c4-8bc11635c37d None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:07.657694 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:07.658611 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:07.658889 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:07.659167 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] PATH_INFO: `/v3/projects/77ce8751741c4b57933ca5306e2da59c` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:07.661809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ce8751741c4b57933ca5306e2da59c)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:07.663821 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:07.755703 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ce8751741c4b57933ca5306e2da59c', 'request_id': 'req-baf8cdb5-5b80-436e-96a1-bc40533c0d71'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:07.761155 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ce8751741c4b57933ca5306e2da59c', 'request_id': 'req-baf8cdb5-5b80-436e-96a1-bc40533c0d71'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:07.813775 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ce8751741c4b57933ca5306e2da59c', 'request_id': 'req-baf8cdb5-5b80-436e-96a1-bc40533c0d71'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:07.824697 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] The token cache is being invalidate because project 77ce8751741c4b57933ca5306e2da59c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:47:07.824986 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:07.825603 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:07.827202 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1367/2722] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:47:07 2022] DELETE /identity/v3/projects/77ce8751741c4b57933ca5306e2da59c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:07.831122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee4ae8-b257-4dcb-af96-8391f2b75c77 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:07.841661 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee4ae8-b257-4dcb-af96-8391f2b75c77 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:07.896019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba93a8-2a86-4a9a-93f3-4e42775701a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:07.896911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba93a8-2a86-4a9a-93f3-4e42775701a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:07.897200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba93a8-2a86-4a9a-93f3-4e42775701a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:07.897474 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba93a8-2a86-4a9a-93f3-4e42775701a0 admin admin] PATH_INFO: `/v3/users/3b7ba7bc4857456982fbf44fb4bbe8a0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:07.898758 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba93a8-2a86-4a9a-93f3-4e42775701a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7ba7bc4857456982fbf44fb4bbe8a0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:07.900911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba93a8-2a86-4a9a-93f3-4e42775701a0 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:08.028313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-05ba93a8-2a86-4a9a-93f3-4e42775701a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7ba7bc4857456982fbf44fb4bbe8a0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:08.071083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-05ba93a8-2a86-4a9a-93f3-4e42775701a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7ba7bc4857456982fbf44fb4bbe8a0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:08.086464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-05ba93a8-2a86-4a9a-93f3-4e42775701a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7ba7bc4857456982fbf44fb4bbe8a0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:08.087384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-05ba93a8-2a86-4a9a-93f3-4e42775701a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7ba7bc4857456982fbf44fb4bbe8a0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:08.096936 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-05ba93a8-2a86-4a9a-93f3-4e42775701a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7ba7bc4857456982fbf44fb4bbe8a0'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:08.104870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1356/2723] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:47:07 2022] DELETE /identity/v3/users/3b7ba7bc4857456982fbf44fb4bbe8a0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:08.518935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:08.520561 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:08.536250 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8cdb5-5b80-436e-96a1-bc40533c0d71 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:08.599431 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:08.600401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:08.600675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:08.600950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf admin admin] PATH_INFO: `/v3/projects/a128459d23964788a8c52e4ede538e54` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:08.602330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a128459d23964788a8c52e4ede538e54)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:08.604572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:08.704881 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a128459d23964788a8c52e4ede538e54', 'request_id': 'req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:08.710082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a128459d23964788a8c52e4ede538e54', 'request_id': 'req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:08.785537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a128459d23964788a8c52e4ede538e54', 'request_id': 'req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:08.796831 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf admin admin] The token cache is being invalidate because project a128459d23964788a8c52e4ede538e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:47:08.797117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:08.797769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-5e27c8b1-a7e0-4706-968e-f24d6ebdceaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:08.799524 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1368/2724] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:47:08 2022] DELETE /identity/v3/projects/a128459d23964788a8c52e4ede538e54 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:08.805313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3493af-427b-4bf5-8a56-86bea2ac439e None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:08.805605 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3493af-427b-4bf5-8a56-86bea2ac439e None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:08.805882 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3493af-427b-4bf5-8a56-86bea2ac439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:08.824476 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-7c3493af-427b-4bf5-8a56-86bea2ac439e None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:08.825789 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7c3493af-427b-4bf5-8a56-86bea2ac439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:08.884854 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1357/2725] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:08.893828 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc8c49-eb84-4420-824d-593863c75336 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:08.894118 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc8c49-eb84-4420-824d-593863c75336 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:08.894398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc8c49-eb84-4420-824d-593863c75336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:08.920649 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-1ccc8c49-eb84-4420-824d-593863c75336 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:08.922043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-1ccc8c49-eb84-4420-824d-593863c75336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:08.931328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1369/2726] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:08.936897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3493af-427b-4bf5-8a56-86bea2ac439e None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:08.947754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3493af-427b-4bf5-8a56-86bea2ac439e None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:08.953012 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d505a-b7c2-427e-bab3-3f51bc9a51a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:08.953739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d505a-b7c2-427e-bab3-3f51bc9a51a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:08.954109 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d505a-b7c2-427e-bab3-3f51bc9a51a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:08.954436 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d505a-b7c2-427e-bab3-3f51bc9a51a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:08.955346 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d505a-b7c2-427e-bab3-3f51bc9a51a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:47:08.955722 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d505a-b7c2-427e-bab3-3f51bc9a51a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:08.957701 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d505a-b7c2-427e-bab3-3f51bc9a51a4 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:08.970688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1358/2727] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:47:08.974927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc8c49-eb84-4420-824d-593863c75336 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:08.984804 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc8c49-eb84-4420-824d-593863c75336 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:08.989524 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73dd58-4f39-4d27-8d8a-22534a2b9daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:08.990168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73dd58-4f39-4d27-8d8a-22534a2b9daa admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:08.990456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73dd58-4f39-4d27-8d8a-22534a2b9daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:08.990736 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73dd58-4f39-4d27-8d8a-22534a2b9daa admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:08.991434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73dd58-4f39-4d27-8d8a-22534a2b9daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:08.993380 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73dd58-4f39-4d27-8d8a-22534a2b9daa admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:09.077972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1370/2728] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:47:08 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:47:09.082256 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d505a-b7c2-427e-bab3-3f51bc9a51a4 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:09.092370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d505a-b7c2-427e-bab3-3f51bc9a51a4 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:09.147033 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a409a98-8d55-4df5-bfec-3fd38e22d2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:09.147730 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a409a98-8d55-4df5-bfec-3fd38e22d2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:09.148011 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a409a98-8d55-4df5-bfec-3fd38e22d2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:09.148322 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a409a98-8d55-4df5-bfec-3fd38e22d2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:09.149036 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a409a98-8d55-4df5-bfec-3fd38e22d2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:09.150996 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a409a98-8d55-4df5-bfec-3fd38e22d2a3 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:09.225706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1359/2729] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:47:09 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:47:09.229878 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73dd58-4f39-4d27-8d8a-22534a2b9daa admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:09.240408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73dd58-4f39-4d27-8d8a-22534a2b9daa admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:09.245043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436a36b-61a0-466d-88c1-931faae138a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:09.245690 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436a36b-61a0-466d-88c1-931faae138a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:09.245970 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436a36b-61a0-466d-88c1-931faae138a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:09.246753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436a36b-61a0-466d-88c1-931faae138a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:09.247480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436a36b-61a0-466d-88c1-931faae138a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:09.249110 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436a36b-61a0-466d-88c1-931faae138a4 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:09.259289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1371/2730] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:09.263792 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a409a98-8d55-4df5-bfec-3fd38e22d2a3 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:09.273547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a409a98-8d55-4df5-bfec-3fd38e22d2a3 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:09.278071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a161e-37bb-458b-871d-dd1722dbc8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:09.278710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a161e-37bb-458b-871d-dd1722dbc8dc admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:09.278993 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a161e-37bb-458b-871d-dd1722dbc8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:09.279270 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a161e-37bb-458b-871d-dd1722dbc8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:09.279981 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a161e-37bb-458b-871d-dd1722dbc8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:09.281593 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a161e-37bb-458b-871d-dd1722dbc8dc admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:09.291139 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1360/2731] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:09.295197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436a36b-61a0-466d-88c1-931faae138a4 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:09.305136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436a36b-61a0-466d-88c1-931faae138a4 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:09.310231 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b32ec6-a514-4f31-8530-b60642118472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:09.311088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b32ec6-a514-4f31-8530-b60642118472 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:09.311368 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b32ec6-a514-4f31-8530-b60642118472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:09.311641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b32ec6-a514-4f31-8530-b60642118472 admin admin] PATH_INFO: `/v3/projects/019209509b0344018b82fdfa64e1e2b1/users/224b129c6194439092c36033a8b1adb5/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:09.326516 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b32ec6-a514-4f31-8530-b60642118472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019209509b0344018b82fdfa64e1e2b1, user_id=224b129c6194439092c36033a8b1adb5, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:09.329256 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b32ec6-a514-4f31-8530-b60642118472 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:09.395805 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1372/2732] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:47:09 2022] PUT /identity/v3/projects/019209509b0344018b82fdfa64e1e2b1/users/224b129c6194439092c36033a8b1adb5/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:09.406743 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4266800-ebe9-4ca2-b199-ace95eea2b36 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:09.407034 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4266800-ebe9-4ca2-b199-ace95eea2b36 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:09.407313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4266800-ebe9-4ca2-b199-ace95eea2b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:09.433815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-c4266800-ebe9-4ca2-b199-ace95eea2b36 None None] MFA Rules not processed for user `224b129c6194439092c36033a8b1adb5`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:09.435006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c4266800-ebe9-4ca2-b199-ace95eea2b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:09.496387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1361/2733] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:09.501192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b32ec6-a514-4f31-8530-b60642118472 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:09.573766 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b32ec6-a514-4f31-8530-b60642118472 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:09.580750 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a4729-5df9-4ed9-9834-30dfc499a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:09.581549 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a4729-5df9-4ed9-9834-30dfc499a411 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:09.581896 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a4729-5df9-4ed9-9834-30dfc499a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:09.582273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a4729-5df9-4ed9-9834-30dfc499a411 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:09.583113 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a4729-5df9-4ed9-9834-30dfc499a411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:09.585583 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a4729-5df9-4ed9-9834-30dfc499a411 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:09.688957 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1373/2734] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:47:09 2022] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:47:09.693096 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4266800-ebe9-4ca2-b199-ace95eea2b36 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:09.704442 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4266800-ebe9-4ca2-b199-ace95eea2b36 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:09.773382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd32a44-a668-4b52-81f7-b22fbca08c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:09.774210 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd32a44-a668-4b52-81f7-b22fbca08c28 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:09.774544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd32a44-a668-4b52-81f7-b22fbca08c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:09.774898 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd32a44-a668-4b52-81f7-b22fbca08c28 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:09.775805 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd32a44-a668-4b52-81f7-b22fbca08c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:09.779004 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd32a44-a668-4b52-81f7-b22fbca08c28 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:09.853530 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1362/2735] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:47:09 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:47:09.858148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a4729-5df9-4ed9-9834-30dfc499a411 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:09.868355 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a4729-5df9-4ed9-9834-30dfc499a411 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:09.873508 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ae13c-8474-4673-b2fa-33c1236663f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:09.874149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ae13c-8474-4673-b2fa-33c1236663f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:09.874433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ae13c-8474-4673-b2fa-33c1236663f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:09.874709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ae13c-8474-4673-b2fa-33c1236663f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:09.875423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ae13c-8474-4673-b2fa-33c1236663f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:09.877040 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ae13c-8474-4673-b2fa-33c1236663f2 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:09.887043 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1374/2736] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:09.891756 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd32a44-a668-4b52-81f7-b22fbca08c28 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:09.902539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd32a44-a668-4b52-81f7-b22fbca08c28 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:09.908252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00174d0-2694-4d48-8c53-03fc48f24bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:09.909134 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00174d0-2694-4d48-8c53-03fc48f24bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:09.909416 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00174d0-2694-4d48-8c53-03fc48f24bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:09.909690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00174d0-2694-4d48-8c53-03fc48f24bc9 admin admin] PATH_INFO: `/v3/projects/3abafd9c635a48ac82b42331dcc382f1/users/3fafce12400647459dd17a00c1525c81/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:09.925186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00174d0-2694-4d48-8c53-03fc48f24bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abafd9c635a48ac82b42331dcc382f1, user_id=3fafce12400647459dd17a00c1525c81, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:09.929413 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00174d0-2694-4d48-8c53-03fc48f24bc9 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:09.997081 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1363/2737] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:47:09 2022] PUT /identity/v3/projects/3abafd9c635a48ac82b42331dcc382f1/users/3fafce12400647459dd17a00c1525c81/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:10.001123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ae13c-8474-4673-b2fa-33c1236663f2 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:10.011099 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ae13c-8474-4673-b2fa-33c1236663f2 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:10.071643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9ee1d-76f4-41c5-b2ff-6426c61e997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:10.072326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9ee1d-76f4-41c5-b2ff-6426c61e997d admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:10.072609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9ee1d-76f4-41c5-b2ff-6426c61e997d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:10.072882 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9ee1d-76f4-41c5-b2ff-6426c61e997d admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:10.073623 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9ee1d-76f4-41c5-b2ff-6426c61e997d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:10.075194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9ee1d-76f4-41c5-b2ff-6426c61e997d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:10.084659 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1375/2738] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:10.089046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00174d0-2694-4d48-8c53-03fc48f24bc9 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:10.099896 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00174d0-2694-4d48-8c53-03fc48f24bc9 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:10.104506 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b241cfd-5824-489b-9705-1659e8ce38e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:10.105319 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b241cfd-5824-489b-9705-1659e8ce38e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:10.105683 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b241cfd-5824-489b-9705-1659e8ce38e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:10.106629 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b241cfd-5824-489b-9705-1659e8ce38e0 admin admin] PATH_INFO: `/v3/projects/3abafd9c635a48ac82b42331dcc382f1/users/3fafce12400647459dd17a00c1525c81/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:10.109235 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b241cfd-5824-489b-9705-1659e8ce38e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abafd9c635a48ac82b42331dcc382f1, user_id=3fafce12400647459dd17a00c1525c81, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:10.112800 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b241cfd-5824-489b-9705-1659e8ce38e0 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:10.126211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1364/2739] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:47:10 2022] PUT /identity/v3/projects/3abafd9c635a48ac82b42331dcc382f1/users/3fafce12400647459dd17a00c1525c81/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:10.139394 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ab428-7228-4735-92e1-b2c0daa4c6a8 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:10.139719 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ab428-7228-4735-92e1-b2c0daa4c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:10.140000 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ab428-7228-4735-92e1-b2c0daa4c6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:10.165809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-e39ab428-7228-4735-92e1-b2c0daa4c6a8 None None] MFA Rules not processed for user `3fafce12400647459dd17a00c1525c81`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:10.167030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e39ab428-7228-4735-92e1-b2c0daa4c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:10.231437 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1376/2740] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:10.242358 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b241cfd-5824-489b-9705-1659e8ce38e0 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:10.244279 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1b241cfd-5824-489b-9705-1659e8ce38e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:10.305829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b241cfd-5824-489b-9705-1659e8ce38e0 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:10.310491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bc07b-7328-4e36-84ba-93c70fb8b1cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:10.311207 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bc07b-7328-4e36-84ba-93c70fb8b1cb service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:10.311554 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bc07b-7328-4e36-84ba-93c70fb8b1cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:10.311877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bc07b-7328-4e36-84ba-93c70fb8b1cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:10.321714 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bc07b-7328-4e36-84ba-93c70fb8b1cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:10.323287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bc07b-7328-4e36-84ba-93c70fb8b1cb service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:10.334002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1365/2741] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:47:11.238820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ab428-7228-4735-92e1-b2c0daa4c6a8 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:11.306699 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ab428-7228-4735-92e1-b2c0daa4c6a8 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:11.312406 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:11.313369 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:11.313698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:11.314027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] PATH_INFO: `/v3/users/224b129c6194439092c36033a8b1adb5` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:11.315373 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=224b129c6194439092c36033a8b1adb5)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:11.317613 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:11.466471 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224b129c6194439092c36033a8b1adb5'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:11.467129 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224b129c6194439092c36033a8b1adb5'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:11.516577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224b129c6194439092c36033a8b1adb5'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:11.517197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224b129c6194439092c36033a8b1adb5'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:11.528536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224b129c6194439092c36033a8b1adb5'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:11.540159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1377/2742] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:47:11 2022] DELETE /identity/v3/users/224b129c6194439092c36033a8b1adb5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:11.544590 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd7395-2c6d-44c8-9be8-59ea318da6e8 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:11.545073 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd7395-2c6d-44c8-9be8-59ea318da6e8 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:11.545282 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd7395-2c6d-44c8-9be8-59ea318da6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:11.563121 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-75dd7395-2c6d-44c8-9be8-59ea318da6e8 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:11.564264 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-75dd7395-2c6d-44c8-9be8-59ea318da6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:11.618338 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1366/2743] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:47:11.628545 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:11.629939 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:11.686810 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b774e6-1c01-4d3a-adef-9f7c0f470c5d admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:11.690476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84222ac3-adc0-4024-bf56-1bb3bb7b72c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:11.691117 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84222ac3-adc0-4024-bf56-1bb3bb7b72c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:11.691408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84222ac3-adc0-4024-bf56-1bb3bb7b72c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:11.691685 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84222ac3-adc0-4024-bf56-1bb3bb7b72c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:11.700468 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84222ac3-adc0-4024-bf56-1bb3bb7b72c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:11.701911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84222ac3-adc0-4024-bf56-1bb3bb7b72c1 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:11.711073 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1378/2744] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:47:12.084478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd7395-2c6d-44c8-9be8-59ea318da6e8 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:12.086027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-75dd7395-2c6d-44c8-9be8-59ea318da6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:12.099404 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd7395-2c6d-44c8-9be8-59ea318da6e8 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:12.104112 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:12.105087 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:12.105523 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:12.105662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] PATH_INFO: `/v3/projects/019209509b0344018b82fdfa64e1e2b1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:12.106823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=019209509b0344018b82fdfa64e1e2b1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:12.108777 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:12.196834 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019209509b0344018b82fdfa64e1e2b1', 'request_id': 'req-95840b2a-d875-4202-bd8b-125e68e61238'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:12.202763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019209509b0344018b82fdfa64e1e2b1', 'request_id': 'req-95840b2a-d875-4202-bd8b-125e68e61238'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:12.208745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019209509b0344018b82fdfa64e1e2b1', 'request_id': 'req-95840b2a-d875-4202-bd8b-125e68e61238'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:12.264922 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] The token cache is being invalidate because project 019209509b0344018b82fdfa64e1e2b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:47:12.265211 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:12.265828 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:12.267353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1367/2745] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:47:12 2022] DELETE /identity/v3/projects/019209509b0344018b82fdfa64e1e2b1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:12.272505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84222ac3-adc0-4024-bf56-1bb3bb7b72c1 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:12.286361 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84222ac3-adc0-4024-bf56-1bb3bb7b72c1 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:12.337532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8388f-406a-441d-a599-6336ff47994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:12.338395 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8388f-406a-441d-a599-6336ff47994d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:12.338675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8388f-406a-441d-a599-6336ff47994d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:12.338949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8388f-406a-441d-a599-6336ff47994d admin admin] PATH_INFO: `/v3/users/3fafce12400647459dd17a00c1525c81` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:12.340130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8388f-406a-441d-a599-6336ff47994d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fafce12400647459dd17a00c1525c81)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:12.342077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8388f-406a-441d-a599-6336ff47994d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:12.529763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d4f8388f-406a-441d-a599-6336ff47994d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fafce12400647459dd17a00c1525c81'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:12.530358 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d4f8388f-406a-441d-a599-6336ff47994d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fafce12400647459dd17a00c1525c81'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:12.590486 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d4f8388f-406a-441d-a599-6336ff47994d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fafce12400647459dd17a00c1525c81'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:12.591704 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d4f8388f-406a-441d-a599-6336ff47994d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fafce12400647459dd17a00c1525c81'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:12.603348 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-d4f8388f-406a-441d-a599-6336ff47994d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fafce12400647459dd17a00c1525c81'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:12.615113 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1379/2746] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:47:12 2022] DELETE /identity/v3/users/3fafce12400647459dd17a00c1525c81 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:13.009439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:13.010918 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:13.025337 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95840b2a-d875-4202-bd8b-125e68e61238 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:13.082280 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:13.083952 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:13.084272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:13.084572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31 admin admin] PATH_INFO: `/v3/projects/3abafd9c635a48ac82b42331dcc382f1` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:13.085741 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abafd9c635a48ac82b42331dcc382f1)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:13.087704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:13.184951 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abafd9c635a48ac82b42331dcc382f1', 'request_id': 'req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:13.190148 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abafd9c635a48ac82b42331dcc382f1', 'request_id': 'req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:13.196060 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abafd9c635a48ac82b42331dcc382f1', 'request_id': 'req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:13.269522 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31 admin admin] The token cache is being invalidate because project 3abafd9c635a48ac82b42331dcc382f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:47:13.269809 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:13.270419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-4fbbb9e5-186a-4717-89d5-c4270cfe9b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:13.271935 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1368/2747] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:47:13 2022] DELETE /identity/v3/projects/3abafd9c635a48ac82b42331dcc382f1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:13.276818 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eee021-97d9-43f6-981d-a37a70b04671 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:13.277336 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eee021-97d9-43f6-981d-a37a70b04671 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:13.277445 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eee021-97d9-43f6-981d-a37a70b04671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:13.295766 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-a6eee021-97d9-43f6-981d-a37a70b04671 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:13.296980 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-a6eee021-97d9-43f6-981d-a37a70b04671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:13.358395 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1380/2748] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:13.365840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d776821-a046-4555-b98f-940e0cd6bcf5 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:13.366131 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d776821-a046-4555-b98f-940e0cd6bcf5 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:13.366412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d776821-a046-4555-b98f-940e0cd6bcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:13.385259 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-9d776821-a046-4555-b98f-940e0cd6bcf5 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:13.386446 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9d776821-a046-4555-b98f-940e0cd6bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:13.394721 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1369/2749] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:13.398832 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eee021-97d9-43f6-981d-a37a70b04671 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:13.408950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eee021-97d9-43f6-981d-a37a70b04671 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:13.413530 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af60a2-66c7-47d4-b478-8b70055178e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:13.414174 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af60a2-66c7-47d4-b478-8b70055178e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:13.414457 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af60a2-66c7-47d4-b478-8b70055178e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:13.414733 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af60a2-66c7-47d4-b478-8b70055178e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:13.415454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af60a2-66c7-47d4-b478-8b70055178e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:47:13.415763 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af60a2-66c7-47d4-b478-8b70055178e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:13.417410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af60a2-66c7-47d4-b478-8b70055178e8 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:13.428806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1381/2750] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:47:13.432960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d776821-a046-4555-b98f-940e0cd6bcf5 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:13.441970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d776821-a046-4555-b98f-940e0cd6bcf5 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:13.446544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042e2ed-e733-4621-b7fa-5009a88793c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:13.447181 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042e2ed-e733-4621-b7fa-5009a88793c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:13.447462 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042e2ed-e733-4621-b7fa-5009a88793c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:13.447733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042e2ed-e733-4621-b7fa-5009a88793c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:13.448468 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042e2ed-e733-4621-b7fa-5009a88793c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:13.450940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042e2ed-e733-4621-b7fa-5009a88793c4 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:13.569183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1370/2751] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:47:13 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:47:13.573361 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af60a2-66c7-47d4-b478-8b70055178e8 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:13.583758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af60a2-66c7-47d4-b478-8b70055178e8 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:13.641907 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5d4e4-efc3-4cce-be77-4963b93bbd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:13.642569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5d4e4-efc3-4cce-be77-4963b93bbd6c admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:13.642850 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5d4e4-efc3-4cce-be77-4963b93bbd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:13.643123 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5d4e4-efc3-4cce-be77-4963b93bbd6c admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:13.643803 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5d4e4-efc3-4cce-be77-4963b93bbd6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:13.645742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5d4e4-efc3-4cce-be77-4963b93bbd6c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:13.728650 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1382/2752] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:47:13 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:47:13.732811 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042e2ed-e733-4621-b7fa-5009a88793c4 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:13.742701 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042e2ed-e733-4621-b7fa-5009a88793c4 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:13.747731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a775-1c36-43d6-aa69-6327475caf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:13.748412 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a775-1c36-43d6-aa69-6327475caf20 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:13.748691 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a775-1c36-43d6-aa69-6327475caf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:13.748960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a775-1c36-43d6-aa69-6327475caf20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:13.749671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460a775-1c36-43d6-aa69-6327475caf20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:13.751238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460a775-1c36-43d6-aa69-6327475caf20 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:13.761177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1371/2753] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:13.765576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5d4e4-efc3-4cce-be77-4963b93bbd6c admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:13.775412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5d4e4-efc3-4cce-be77-4963b93bbd6c admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:13.780004 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c083493-0ca2-4c81-b914-97405acfe37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:13.780672 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c083493-0ca2-4c81-b914-97405acfe37e admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:13.780958 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c083493-0ca2-4c81-b914-97405acfe37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:13.781237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c083493-0ca2-4c81-b914-97405acfe37e admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:13.781984 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c083493-0ca2-4c81-b914-97405acfe37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:13.783595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c083493-0ca2-4c81-b914-97405acfe37e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:13.793126 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1383/2754] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:13.796959 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a775-1c36-43d6-aa69-6327475caf20 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:13.806883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a775-1c36-43d6-aa69-6327475caf20 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:13.811947 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82662ac7-0c30-4fab-9504-635f174919e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:13.812812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82662ac7-0c30-4fab-9504-635f174919e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:13.813091 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82662ac7-0c30-4fab-9504-635f174919e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:13.813361 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82662ac7-0c30-4fab-9504-635f174919e7 admin admin] PATH_INFO: `/v3/projects/50a4e350f311408c85a924aa0a7c8b70/users/ab495e95d1d44f9a9e34c54dc048b9f2/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:13.827099 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82662ac7-0c30-4fab-9504-635f174919e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a4e350f311408c85a924aa0a7c8b70, user_id=ab495e95d1d44f9a9e34c54dc048b9f2, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:13.829739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82662ac7-0c30-4fab-9504-635f174919e7 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:13.878184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1372/2755] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:47:13 2022] PUT /identity/v3/projects/50a4e350f311408c85a924aa0a7c8b70/users/ab495e95d1d44f9a9e34c54dc048b9f2/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:13.888517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bcb47-08f5-47e4-95c5-e5e22ef01d18 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:13.888812 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bcb47-08f5-47e4-95c5-e5e22ef01d18 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:13.889095 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bcb47-08f5-47e4-95c5-e5e22ef01d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:13.915319 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-0b6bcb47-08f5-47e4-95c5-e5e22ef01d18 None None] MFA Rules not processed for user `ab495e95d1d44f9a9e34c54dc048b9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:13.916576 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0b6bcb47-08f5-47e4-95c5-e5e22ef01d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:13.979760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1384/2756] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:13.985618 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82662ac7-0c30-4fab-9504-635f174919e7 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:14.044678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82662ac7-0c30-4fab-9504-635f174919e7 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:14.049586 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe85a3-5b68-4cf2-81f3-1d1d6ae76c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:14.050233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe85a3-5b68-4cf2-81f3-1d1d6ae76c93 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:14.050516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe85a3-5b68-4cf2-81f3-1d1d6ae76c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:14.050795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe85a3-5b68-4cf2-81f3-1d1d6ae76c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:14.051485 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe85a3-5b68-4cf2-81f3-1d1d6ae76c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:14.053410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe85a3-5b68-4cf2-81f3-1d1d6ae76c93 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:14.134914 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1373/2757] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:47:13 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:47:14.139499 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bcb47-08f5-47e4-95c5-e5e22ef01d18 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:14.150433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bcb47-08f5-47e4-95c5-e5e22ef01d18 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:14.204633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41339ab7-df40-46da-a603-bbd18aa1c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:14.205288 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41339ab7-df40-46da-a603-bbd18aa1c5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:14.205572 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41339ab7-df40-46da-a603-bbd18aa1c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:14.205850 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41339ab7-df40-46da-a603-bbd18aa1c5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:14.206541 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41339ab7-df40-46da-a603-bbd18aa1c5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:14.208493 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41339ab7-df40-46da-a603-bbd18aa1c5c7 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:14.287930 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1385/2758] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:47:14 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:47:14.293431 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe85a3-5b68-4cf2-81f3-1d1d6ae76c93 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:14.307793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe85a3-5b68-4cf2-81f3-1d1d6ae76c93 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:14.313191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fa0c2-d011-4014-9b27-0ba21c7d23df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:14.313857 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fa0c2-d011-4014-9b27-0ba21c7d23df admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:14.314141 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fa0c2-d011-4014-9b27-0ba21c7d23df admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:14.314419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fa0c2-d011-4014-9b27-0ba21c7d23df admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:14.315142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fa0c2-d011-4014-9b27-0ba21c7d23df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:14.316794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fa0c2-d011-4014-9b27-0ba21c7d23df admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:14.327153 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1374/2759] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:14.331303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41339ab7-df40-46da-a603-bbd18aa1c5c7 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:14.341064 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41339ab7-df40-46da-a603-bbd18aa1c5c7 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:14.345631 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae674005-8be5-47f5-a114-25ec10b4b77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:14.346500 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae674005-8be5-47f5-a114-25ec10b4b77a admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:14.346789 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae674005-8be5-47f5-a114-25ec10b4b77a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:14.347065 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae674005-8be5-47f5-a114-25ec10b4b77a admin admin] PATH_INFO: `/v3/projects/fac9bc16d72441a48adfa453318083d3/users/ddacd45d7d1f4bb48660c0926db839fc/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:14.361879 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae674005-8be5-47f5-a114-25ec10b4b77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac9bc16d72441a48adfa453318083d3, user_id=ddacd45d7d1f4bb48660c0926db839fc, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:14.364622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae674005-8be5-47f5-a114-25ec10b4b77a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:14.425460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1386/2760] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:47:14 2022] PUT /identity/v3/projects/fac9bc16d72441a48adfa453318083d3/users/ddacd45d7d1f4bb48660c0926db839fc/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:14.429275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fa0c2-d011-4014-9b27-0ba21c7d23df admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:14.439226 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fa0c2-d011-4014-9b27-0ba21c7d23df admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:14.493008 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8948f-4432-41c9-a41b-1d9eceb403ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:14.493662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8948f-4432-41c9-a41b-1d9eceb403ad admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:14.493980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8948f-4432-41c9-a41b-1d9eceb403ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:14.494255 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8948f-4432-41c9-a41b-1d9eceb403ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:14.494967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8948f-4432-41c9-a41b-1d9eceb403ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:14.496584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8948f-4432-41c9-a41b-1d9eceb403ad admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:14.505970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1375/2761] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:14.510102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae674005-8be5-47f5-a114-25ec10b4b77a admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:14.520195 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae674005-8be5-47f5-a114-25ec10b4b77a admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:14.524749 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0a45c-b440-4bd9-bd3a-a40bb5887743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:14.525615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0a45c-b440-4bd9-bd3a-a40bb5887743 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:14.525897 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0a45c-b440-4bd9-bd3a-a40bb5887743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:14.526169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0a45c-b440-4bd9-bd3a-a40bb5887743 admin admin] PATH_INFO: `/v3/projects/fac9bc16d72441a48adfa453318083d3/users/ddacd45d7d1f4bb48660c0926db839fc/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:14.528134 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0a45c-b440-4bd9-bd3a-a40bb5887743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac9bc16d72441a48adfa453318083d3, user_id=ddacd45d7d1f4bb48660c0926db839fc, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:14.531301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0a45c-b440-4bd9-bd3a-a40bb5887743 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:14.541240 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1387/2762] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:47:14 2022] PUT /identity/v3/projects/fac9bc16d72441a48adfa453318083d3/users/ddacd45d7d1f4bb48660c0926db839fc/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:14.552812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106f767-f074-423d-95ad-5ef3d978d2e7 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:14.553103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106f767-f074-423d-95ad-5ef3d978d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:14.553381 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106f767-f074-423d-95ad-5ef3d978d2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:14.578646 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-1106f767-f074-423d-95ad-5ef3d978d2e7 None None] MFA Rules not processed for user `ddacd45d7d1f4bb48660c0926db839fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:14.579864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1106f767-f074-423d-95ad-5ef3d978d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:14.648267 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1376/2763] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:14.660197 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0a45c-b440-4bd9-bd3a-a40bb5887743 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:14.661919 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-cee0a45c-b440-4bd9-bd3a-a40bb5887743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:14.715959 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0a45c-b440-4bd9-bd3a-a40bb5887743 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:14.720168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c7adc-9f1c-4261-89a0-cf3001ba9934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:14.720878 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c7adc-9f1c-4261-89a0-cf3001ba9934 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:14.721166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c7adc-9f1c-4261-89a0-cf3001ba9934 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:14.721448 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c7adc-9f1c-4261-89a0-cf3001ba9934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:14.730570 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c7adc-9f1c-4261-89a0-cf3001ba9934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:14.735665 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c7adc-9f1c-4261-89a0-cf3001ba9934 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:14.741844 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1388/2764] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:47:14.874374 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106f767-f074-423d-95ad-5ef3d978d2e7 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:14.883748 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106f767-f074-423d-95ad-5ef3d978d2e7 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:14.887320 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f559ea-6473-4e18-8994-aa2c401b345f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:14.887940 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f559ea-6473-4e18-8994-aa2c401b345f service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:14.888324 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f559ea-6473-4e18-8994-aa2c401b345f service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:14.889183 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f559ea-6473-4e18-8994-aa2c401b345f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:14.954638 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f559ea-6473-4e18-8994-aa2c401b345f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:14.956083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f559ea-6473-4e18-8994-aa2c401b345f service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:14.964967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1377/2765] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:47:15.477474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c7adc-9f1c-4261-89a0-cf3001ba9934 service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:15.538514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c7adc-9f1c-4261-89a0-cf3001ba9934 service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:15.543027 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:15.543908 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:15.544213 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:15.544491 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] PATH_INFO: `/v3/users/ab495e95d1d44f9a9e34c54dc048b9f2` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:15.546178 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab495e95d1d44f9a9e34c54dc048b9f2)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:15.548364 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:15.713007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab495e95d1d44f9a9e34c54dc048b9f2'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:15.713671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab495e95d1d44f9a9e34c54dc048b9f2'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:15.796453 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab495e95d1d44f9a9e34c54dc048b9f2'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:15.797068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab495e95d1d44f9a9e34c54dc048b9f2'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:15.808988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab495e95d1d44f9a9e34c54dc048b9f2'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:15.820564 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1389/2766] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:47:15 2022] DELETE /identity/v3/users/ab495e95d1d44f9a9e34c54dc048b9f2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:15.825118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b0274-8015-4c9c-96f3-270257d31e93 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:15.826604 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b0274-8015-4c9c-96f3-270257d31e93 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:15.826604 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b0274-8015-4c9c-96f3-270257d31e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:15.843341 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-302b0274-8015-4c9c-96f3-270257d31e93 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:15.844566 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-302b0274-8015-4c9c-96f3-270257d31e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:15.899696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1378/2767] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:15.909393 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:15.910777 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:15.973168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4dc42-10bb-4415-a6fe-6626b3786e3e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:15.976719 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55927380-a1f5-4a23-8791-a2d991af9c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:15.977391 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55927380-a1f5-4a23-8791-a2d991af9c51 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:15.977709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55927380-a1f5-4a23-8791-a2d991af9c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:15.978028 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55927380-a1f5-4a23-8791-a2d991af9c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:15.987216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55927380-a1f5-4a23-8791-a2d991af9c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:15.988677 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55927380-a1f5-4a23-8791-a2d991af9c51 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:15.998355 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1390/2768] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:47:16.449664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b0274-8015-4c9c-96f3-270257d31e93 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:16.451079 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-302b0274-8015-4c9c-96f3-270257d31e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:16.463057 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b0274-8015-4c9c-96f3-270257d31e93 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:16.467964 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:16.468852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:16.469136 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:16.469411 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] PATH_INFO: `/v3/projects/50a4e350f311408c85a924aa0a7c8b70` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:16.470890 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a4e350f311408c85a924aa0a7c8b70)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:16.472938 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:16.584654 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a4e350f311408c85a924aa0a7c8b70', 'request_id': 'req-553bc3f4-72fe-4382-aeac-cefd056d6c49'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:16.589860 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a4e350f311408c85a924aa0a7c8b70', 'request_id': 'req-553bc3f4-72fe-4382-aeac-cefd056d6c49'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:16.596422 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a4e350f311408c85a924aa0a7c8b70', 'request_id': 'req-553bc3f4-72fe-4382-aeac-cefd056d6c49'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:16.663811 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] The token cache is being invalidate because project 50a4e350f311408c85a924aa0a7c8b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:47:16.664098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:16.664735 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:16.666272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1379/2769] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:47:16 2022] DELETE /identity/v3/projects/50a4e350f311408c85a924aa0a7c8b70 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:16.670392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55927380-a1f5-4a23-8791-a2d991af9c51 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:16.680051 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55927380-a1f5-4a23-8791-a2d991af9c51 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:16.733007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ef5af-022a-40a3-90ea-9681df8a9386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:16.733802 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ef5af-022a-40a3-90ea-9681df8a9386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:16.734072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ef5af-022a-40a3-90ea-9681df8a9386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:16.734344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ef5af-022a-40a3-90ea-9681df8a9386 admin admin] PATH_INFO: `/v3/users/ddacd45d7d1f4bb48660c0926db839fc` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:16.735512 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ef5af-022a-40a3-90ea-9681df8a9386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddacd45d7d1f4bb48660c0926db839fc)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:16.737428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ef5af-022a-40a3-90ea-9681df8a9386 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:16.963867 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-c86ef5af-022a-40a3-90ea-9681df8a9386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddacd45d7d1f4bb48660c0926db839fc'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:16.964569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-c86ef5af-022a-40a3-90ea-9681df8a9386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddacd45d7d1f4bb48660c0926db839fc'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:17.081837 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-c86ef5af-022a-40a3-90ea-9681df8a9386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddacd45d7d1f4bb48660c0926db839fc'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:17.082389 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-c86ef5af-022a-40a3-90ea-9681df8a9386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddacd45d7d1f4bb48660c0926db839fc'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:17.095095 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-c86ef5af-022a-40a3-90ea-9681df8a9386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddacd45d7d1f4bb48660c0926db839fc'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:17.106801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1391/2770] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:47:16 2022] DELETE /identity/v3/users/ddacd45d7d1f4bb48660c0926db839fc => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:17.495023 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:17.496563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:17.509516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bc3f4-72fe-4382-aeac-cefd056d6c49 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:17.565017 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15081e-b281-4d75-ba59-3b09934bb7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:17.565862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15081e-b281-4d75-ba59-3b09934bb7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:17.566144 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15081e-b281-4d75-ba59-3b09934bb7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:17.566419 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15081e-b281-4d75-ba59-3b09934bb7f4 admin admin] PATH_INFO: `/v3/projects/fac9bc16d72441a48adfa453318083d3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:17.567574 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15081e-b281-4d75-ba59-3b09934bb7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac9bc16d72441a48adfa453318083d3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:17.569534 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15081e-b281-4d75-ba59-3b09934bb7f4 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:17.693696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0f15081e-b281-4d75-ba59-3b09934bb7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac9bc16d72441a48adfa453318083d3', 'request_id': 'req-0f15081e-b281-4d75-ba59-3b09934bb7f4'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:17.698923 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0f15081e-b281-4d75-ba59-3b09934bb7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac9bc16d72441a48adfa453318083d3', 'request_id': 'req-0f15081e-b281-4d75-ba59-3b09934bb7f4'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:17.705264 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0f15081e-b281-4d75-ba59-3b09934bb7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac9bc16d72441a48adfa453318083d3', 'request_id': 'req-0f15081e-b281-4d75-ba59-3b09934bb7f4'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:17.772884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0f15081e-b281-4d75-ba59-3b09934bb7f4 admin admin] The token cache is being invalidate because project fac9bc16d72441a48adfa453318083d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:47:17.773241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0f15081e-b281-4d75-ba59-3b09934bb7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:17.773839 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-0f15081e-b281-4d75-ba59-3b09934bb7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:47:17.775353 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1380/2771] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:47:17 2022] DELETE /identity/v3/projects/fac9bc16d72441a48adfa453318083d3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:17.780895 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e675e-e30a-4fe6-9dfe-6fb732cdd5e0 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:17.781379 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e675e-e30a-4fe6-9dfe-6fb732cdd5e0 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:17.781495 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e675e-e30a-4fe6-9dfe-6fb732cdd5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:17.799344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-ac6e675e-e30a-4fe6-9dfe-6fb732cdd5e0 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:17.800577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ac6e675e-e30a-4fe6-9dfe-6fb732cdd5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:17.856411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1392/2772] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:17.864678 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2b07e-5992-4cb3-b080-0b291a8e6bbf None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:17.864968 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2b07e-5992-4cb3-b080-0b291a8e6bbf None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:17.865269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2b07e-5992-4cb3-b080-0b291a8e6bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:17.883732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-5ca2b07e-5992-4cb3-b080-0b291a8e6bbf None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:17.884949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-5ca2b07e-5992-4cb3-b080-0b291a8e6bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:17.893212 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1381/2773] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:17.897194 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e675e-e30a-4fe6-9dfe-6fb732cdd5e0 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:17.907335 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e675e-e30a-4fe6-9dfe-6fb732cdd5e0 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:17.911879 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5a147-f5f6-4aae-852e-acf2506bd8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:17.912556 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5a147-f5f6-4aae-852e-acf2506bd8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:17.912840 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5a147-f5f6-4aae-852e-acf2506bd8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:17.913115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5a147-f5f6-4aae-852e-acf2506bd8f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:17.913862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5a147-f5f6-4aae-852e-acf2506bd8f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:47:17.914192 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5a147-f5f6-4aae-852e-acf2506bd8f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:17.915779 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5a147-f5f6-4aae-852e-acf2506bd8f5 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:17.927148 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1393/2774] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:47:17.931390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2b07e-5992-4cb3-b080-0b291a8e6bbf None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:17.940388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2b07e-5992-4cb3-b080-0b291a8e6bbf None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:17.945750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50862594-35b8-4bc5-b5c1-3a4617563348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:17.946334 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50862594-35b8-4bc5-b5c1-3a4617563348 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:17.946612 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50862594-35b8-4bc5-b5c1-3a4617563348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:17.946883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50862594-35b8-4bc5-b5c1-3a4617563348 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:17.947561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50862594-35b8-4bc5-b5c1-3a4617563348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:17.949478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50862594-35b8-4bc5-b5c1-3a4617563348 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:18.049675 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1382/2775] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:47:17 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:47:18.053943 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5a147-f5f6-4aae-852e-acf2506bd8f5 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:18.063627 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5a147-f5f6-4aae-852e-acf2506bd8f5 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:18.118497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1034f7e-d366-41f9-a62d-cd14ead74b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:18.119162 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1034f7e-d366-41f9-a62d-cd14ead74b47 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:18.119469 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1034f7e-d366-41f9-a62d-cd14ead74b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:18.119768 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1034f7e-d366-41f9-a62d-cd14ead74b47 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:18.120529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1034f7e-d366-41f9-a62d-cd14ead74b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:18.122428 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1034f7e-d366-41f9-a62d-cd14ead74b47 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:18.202390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1394/2776] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:47:18 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:47:18.206328 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50862594-35b8-4bc5-b5c1-3a4617563348 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:18.216611 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50862594-35b8-4bc5-b5c1-3a4617563348 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:18.221943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfad6a6-d177-4672-8c66-f48bdb505170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:18.222584 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfad6a6-d177-4672-8c66-f48bdb505170 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:18.222861 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfad6a6-d177-4672-8c66-f48bdb505170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:18.223135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfad6a6-d177-4672-8c66-f48bdb505170 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:18.223886 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfad6a6-d177-4672-8c66-f48bdb505170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:18.225617 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfad6a6-d177-4672-8c66-f48bdb505170 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:18.236539 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1383/2777] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:18.240671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1034f7e-d366-41f9-a62d-cd14ead74b47 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:18.250684 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1034f7e-d366-41f9-a62d-cd14ead74b47 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:18.255427 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a73922-f0ce-40e2-bdd7-411e6300dd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:18.256067 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a73922-f0ce-40e2-bdd7-411e6300dd90 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:18.259464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a73922-f0ce-40e2-bdd7-411e6300dd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:18.259464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a73922-f0ce-40e2-bdd7-411e6300dd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:18.259464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a73922-f0ce-40e2-bdd7-411e6300dd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:18.259464 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a73922-f0ce-40e2-bdd7-411e6300dd90 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:18.268569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1395/2778] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:18.272830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfad6a6-d177-4672-8c66-f48bdb505170 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:18.283015 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfad6a6-d177-4672-8c66-f48bdb505170 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:18.287719 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93eaf1-a661-4fe2-bb56-9b597226b298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:18.288617 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93eaf1-a661-4fe2-bb56-9b597226b298 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:18.288900 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93eaf1-a661-4fe2-bb56-9b597226b298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:18.289172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93eaf1-a661-4fe2-bb56-9b597226b298 admin admin] PATH_INFO: `/v3/projects/eea5da771e2142b699fe081c5defbd69/users/609e7d0dc9a84882a2da862172940533/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:18.304281 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93eaf1-a661-4fe2-bb56-9b597226b298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea5da771e2142b699fe081c5defbd69, user_id=609e7d0dc9a84882a2da862172940533, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:18.306908 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93eaf1-a661-4fe2-bb56-9b597226b298 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:18.418911 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1384/2779] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:47:18 2022] PUT /identity/v3/projects/eea5da771e2142b699fe081c5defbd69/users/609e7d0dc9a84882a2da862172940533/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:47:18.424927 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2021a-bc1a-49d1-8adb-0c4d099ab0b6 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:18.425222 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2021a-bc1a-49d1-8adb-0c4d099ab0b6 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:18.425538 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2021a-bc1a-49d1-8adb-0c4d099ab0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:18.443460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-52c2021a-bc1a-49d1-8adb-0c4d099ab0b6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:18.444675 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-52c2021a-bc1a-49d1-8adb-0c4d099ab0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:18.502198 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1396/2780] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:18.511627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93eaf1-a661-4fe2-bb56-9b597226b298 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:18.513335 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-cb93eaf1-a661-4fe2-bb56-9b597226b298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:18.567599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93eaf1-a661-4fe2-bb56-9b597226b298 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:18.571193 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95d953-0db6-4cd1-a7e7-8947b07bbbbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:18.571826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95d953-0db6-4cd1-a7e7-8947b07bbbbf service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:18.572107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95d953-0db6-4cd1-a7e7-8947b07bbbbf service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:18.572427 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95d953-0db6-4cd1-a7e7-8947b07bbbbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:18.581187 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95d953-0db6-4cd1-a7e7-8947b07bbbbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:18.582606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95d953-0db6-4cd1-a7e7-8947b07bbbbf service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:18.591726 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1385/2781] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:47:23.952839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31247bd-f094-4e1d-9471-f6aeeee8d808 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:23.953532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31247bd-f094-4e1d-9471-f6aeeee8d808 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:23.953532 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31247bd-f094-4e1d-9471-f6aeeee8d808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:23.994577 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-f31247bd-f094-4e1d-9471-f6aeeee8d808 None None] MFA Rules not processed for user `609e7d0dc9a84882a2da862172940533`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:23.995814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f31247bd-f094-4e1d-9471-f6aeeee8d808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:24.081672 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1397/2782] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:24.082647 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95d953-0db6-4cd1-a7e7-8947b07bbbbf service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:24.093619 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95d953-0db6-4cd1-a7e7-8947b07bbbbf service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:24.099186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3503bfd-5b10-43b9-a954-f89fc91e4477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:24.100221 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3503bfd-5b10-43b9-a954-f89fc91e4477 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:24.100570 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3503bfd-5b10-43b9-a954-f89fc91e4477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:24.100915 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3503bfd-5b10-43b9-a954-f89fc91e4477 admin admin] PATH_INFO: `/v3/projects` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:24.101671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3503bfd-5b10-43b9-a954-f89fc91e4477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:24.103671 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3503bfd-5b10-43b9-a954-f89fc91e4477 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:24.226739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1386/2783] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:47:24 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:47:24.230409 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31247bd-f094-4e1d-9471-f6aeeee8d808 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:24.242890 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31247bd-f094-4e1d-9471-f6aeeee8d808 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:24.301344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb415408-4c91-4f91-b0b5-a7e5a44ae969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:24.302022 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb415408-4c91-4f91-b0b5-a7e5a44ae969 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:24.302304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb415408-4c91-4f91-b0b5-a7e5a44ae969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:24.302581 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb415408-4c91-4f91-b0b5-a7e5a44ae969 admin admin] PATH_INFO: `/v3/users` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:24.303289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb415408-4c91-4f91-b0b5-a7e5a44ae969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:24.305847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb415408-4c91-4f91-b0b5-a7e5a44ae969 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:24.440289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1398/2784] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:47:24 2022] POST /identity/v3/users => generated 296 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:47:24.441458 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3503bfd-5b10-43b9-a954-f89fc91e4477 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:24.454051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3503bfd-5b10-43b9-a954-f89fc91e4477 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:24.458732 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797237eb-8427-4dfc-9398-cda47346ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:24.459400 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797237eb-8427-4dfc-9398-cda47346ff54 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:24.459677 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797237eb-8427-4dfc-9398-cda47346ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:24.459957 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797237eb-8427-4dfc-9398-cda47346ff54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:24.460761 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797237eb-8427-4dfc-9398-cda47346ff54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:24.462488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797237eb-8427-4dfc-9398-cda47346ff54 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:24.474655 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1387/2785] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:24.478943 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb415408-4c91-4f91-b0b5-a7e5a44ae969 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:24.489731 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb415408-4c91-4f91-b0b5-a7e5a44ae969 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:24.494476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b941d5-8b9c-4214-b2dc-ce9a723c380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:24.495376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b941d5-8b9c-4214-b2dc-ce9a723c380b admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:24.495659 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b941d5-8b9c-4214-b2dc-ce9a723c380b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:24.495937 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b941d5-8b9c-4214-b2dc-ce9a723c380b admin admin] PATH_INFO: `/v3/projects/b131d17f28f242a9b1e4c7f20ef75f9e/users/39a95b5d1ec24152b8459c12474318d9/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:24.513111 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b941d5-8b9c-4214-b2dc-ce9a723c380b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b131d17f28f242a9b1e4c7f20ef75f9e, user_id=39a95b5d1ec24152b8459c12474318d9, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:24.516017 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b941d5-8b9c-4214-b2dc-ce9a723c380b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:24.614691 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1399/2786] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:47:24 2022] PUT /identity/v3/projects/b131d17f28f242a9b1e4c7f20ef75f9e/users/39a95b5d1ec24152b8459c12474318d9/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:24.618950 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797237eb-8427-4dfc-9398-cda47346ff54 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:24.629374 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797237eb-8427-4dfc-9398-cda47346ff54 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:24.690001 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402e105-5cee-4d88-82ff-705b3ed4e291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:24.690672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402e105-5cee-4d88-82ff-705b3ed4e291 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:24.690962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402e105-5cee-4d88-82ff-705b3ed4e291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:24.691241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402e105-5cee-4d88-82ff-705b3ed4e291 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:24.691970 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402e105-5cee-4d88-82ff-705b3ed4e291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:24.693608 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402e105-5cee-4d88-82ff-705b3ed4e291 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:24.704742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1388/2787] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:47:24.708586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b941d5-8b9c-4214-b2dc-ce9a723c380b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:24.719949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b941d5-8b9c-4214-b2dc-ce9a723c380b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:24.724746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3518ddc-276a-41e9-9860-d24258a5cb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:24.725628 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3518ddc-276a-41e9-9860-d24258a5cb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:24.725909 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3518ddc-276a-41e9-9860-d24258a5cb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:24.726186 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3518ddc-276a-41e9-9860-d24258a5cb49 admin admin] PATH_INFO: `/v3/projects/b131d17f28f242a9b1e4c7f20ef75f9e/users/39a95b5d1ec24152b8459c12474318d9/roles/24a7898c863141f1911792647b5274e3` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:24.728236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3518ddc-276a-41e9-9860-d24258a5cb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b131d17f28f242a9b1e4c7f20ef75f9e, user_id=39a95b5d1ec24152b8459c12474318d9, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:24.730871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3518ddc-276a-41e9-9860-d24258a5cb49 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:24.743483 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1400/2788] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:47:24 2022] PUT /identity/v3/projects/b131d17f28f242a9b1e4c7f20ef75f9e/users/39a95b5d1ec24152b8459c12474318d9/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:47:30.442294 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d27847-25a3-4448-b940-9b26ecfcf840 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:30.445020 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d27847-25a3-4448-b940-9b26ecfcf840 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:30.445334 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d27847-25a3-4448-b940-9b26ecfcf840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:30.491754 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-89d27847-25a3-4448-b940-9b26ecfcf840 None None] MFA Rules not processed for user `39a95b5d1ec24152b8459c12474318d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:30.495895 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-89d27847-25a3-4448-b940-9b26ecfcf840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:30.568672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1389/2789] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:47:30.579950 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3518ddc-276a-41e9-9860-d24258a5cb49 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:30.581888 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b3518ddc-276a-41e9-9860-d24258a5cb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:30.657135 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3518ddc-276a-41e9-9860-d24258a5cb49 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:30.662723 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e10ea-ebe8-40e1-8a72-8dfc59492f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:30.663381 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e10ea-ebe8-40e1-8a72-8dfc59492f13 service nova] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:30.663667 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e10ea-ebe8-40e1-8a72-8dfc59492f13 service nova] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:30.663944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e10ea-ebe8-40e1-8a72-8dfc59492f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:30.724529 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e10ea-ebe8-40e1-8a72-8dfc59492f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:30.726304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e10ea-ebe8-40e1-8a72-8dfc59492f13 service nova] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:30.735866 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1401/2790] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:47:46.687295 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d27847-25a3-4448-b940-9b26ecfcf840 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:46.688726 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-89d27847-25a3-4448-b940-9b26ecfcf840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:46.755460 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d27847-25a3-4448-b940-9b26ecfcf840 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:46.761187 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512a3bb-a68f-4de6-9ca7-e1a24fa936f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13471dce9430484ab46b355d1303f504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:46.761842 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512a3bb-a68f-4de6-9ca7-e1a24fa936f6 service placement] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:46.762134 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512a3bb-a68f-4de6-9ca7-e1a24fa936f6 service placement] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:46.762410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512a3bb-a68f-4de6-9ca7-e1a24fa936f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:46.764238 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-2512a3bb-a68f-4de6-9ca7-e1a24fa936f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:46.781904 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512a3bb-a68f-4de6-9ca7-e1a24fa936f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:46.783840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512a3bb-a68f-4de6-9ca7-e1a24fa936f6 service placement] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:46.796967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1390/2791] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:47:48.407602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e10ea-ebe8-40e1-8a72-8dfc59492f13 service nova] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:48.463251 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e10ea-ebe8-40e1-8a72-8dfc59492f13 service nova] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:48.467423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366ef6d-95f0-462a-b78a-f134331562da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:48.467423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366ef6d-95f0-462a-b78a-f134331562da service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:48.467723 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366ef6d-95f0-462a-b78a-f134331562da service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:48.468063 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366ef6d-95f0-462a-b78a-f134331562da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:48.470490 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f366ef6d-95f0-462a-b78a-f134331562da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:48.479985 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366ef6d-95f0-462a-b78a-f134331562da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:48.481449 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366ef6d-95f0-462a-b78a-f134331562da service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:48.489324 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1402/2792] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:47:48.565757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512a3bb-a68f-4de6-9ca7-e1a24fa936f6 service placement] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:47:48.574980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512a3bb-a68f-4de6-9ca7-e1a24fa936f6 service placement] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:47:48.579073 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5f277-78d6-4643-beb6-d3311848f2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:47:48.579687 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5f277-78d6-4643-beb6-d3311848f2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:48.579966 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5f277-78d6-4643-beb6-d3311848f2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:48.580291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5f277-78d6-4643-beb6-d3311848f2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:48.582021 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a8f5f277-78d6-4643-beb6-d3311848f2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:48.596130 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5f277-78d6-4643-beb6-d3311848f2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:47:48.603876 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5f277-78d6-4643-beb6-d3311848f2f9 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:47:48.613952 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1391/2793] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:47:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:47:50.054773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c20ea-1d86-4011-a351-0a586999cb1e None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:47:50.055249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c20ea-1d86-4011-a351-0a586999cb1e None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:47:50.055367 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c20ea-1d86-4011-a351-0a586999cb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:47:50.073520 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-088c20ea-1d86-4011-a351-0a586999cb1e None None] MFA Rules not processed for user `609e7d0dc9a84882a2da862172940533`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:47:50.074862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-088c20ea-1d86-4011-a351-0a586999cb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:47:50.084082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1403/2794] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:47:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:10.721825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5f277-78d6-4643-beb6-d3311848f2f9 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:10.723312 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a8f5f277-78d6-4643-beb6-d3311848f2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:10.733950 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5f277-78d6-4643-beb6-d3311848f2f9 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:10.737614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8075e32-a4e1-49b7-8353-4db26e81d1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:10.745415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8075e32-a4e1-49b7-8353-4db26e81d1ef service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:10.745415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8075e32-a4e1-49b7-8353-4db26e81d1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:10.745415 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8075e32-a4e1-49b7-8353-4db26e81d1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:10.747745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8075e32-a4e1-49b7-8353-4db26e81d1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:10.749208 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8075e32-a4e1-49b7-8353-4db26e81d1ef service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:10.759186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1392/2795] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:48:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:48:11.595145 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c20ea-1d86-4011-a351-0a586999cb1e None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:11.604656 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c20ea-1d86-4011-a351-0a586999cb1e None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:11.608326 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582fca4-82ef-41bc-afb2-9c9036a2d229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:11.609039 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582fca4-82ef-41bc-afb2-9c9036a2d229 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:11.610088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582fca4-82ef-41bc-afb2-9c9036a2d229 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:11.610388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582fca4-82ef-41bc-afb2-9c9036a2d229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:11.612170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-2582fca4-82ef-41bc-afb2-9c9036a2d229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:11.678728 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582fca4-82ef-41bc-afb2-9c9036a2d229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:11.680516 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582fca4-82ef-41bc-afb2-9c9036a2d229 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:11.690347 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1404/2796] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:48:15.448939 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8075e32-a4e1-49b7-8353-4db26e81d1ef service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:15.450483 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-a8075e32-a4e1-49b7-8353-4db26e81d1ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:15.465326 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8075e32-a4e1-49b7-8353-4db26e81d1ef service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:15.470564 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff7547-203d-4b3d-8372-e80387b07bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:15.471413 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff7547-203d-4b3d-8372-e80387b07bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:15.471690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff7547-203d-4b3d-8372-e80387b07bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:15.471960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff7547-203d-4b3d-8372-e80387b07bf6 admin admin] PATH_INFO: `/v3/users/c09f638d00cb4ae5b4959cf2c5c2ae71` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:15.473173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff7547-203d-4b3d-8372-e80387b07bf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09f638d00cb4ae5b4959cf2c5c2ae71)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:15.475201 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff7547-203d-4b3d-8372-e80387b07bf6 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:15.659001 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-eeff7547-203d-4b3d-8372-e80387b07bf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09f638d00cb4ae5b4959cf2c5c2ae71'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:15.730473 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-eeff7547-203d-4b3d-8372-e80387b07bf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09f638d00cb4ae5b4959cf2c5c2ae71'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:15.742637 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-eeff7547-203d-4b3d-8372-e80387b07bf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09f638d00cb4ae5b4959cf2c5c2ae71'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:15.743280 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-eeff7547-203d-4b3d-8372-e80387b07bf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09f638d00cb4ae5b4959cf2c5c2ae71'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:15.749960 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-eeff7547-203d-4b3d-8372-e80387b07bf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09f638d00cb4ae5b4959cf2c5c2ae71'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:15.755795 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1393/2797] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:48:15 2022] DELETE /identity/v3/users/c09f638d00cb4ae5b4959cf2c5c2ae71 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:16.014586 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582fca4-82ef-41bc-afb2-9c9036a2d229 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:16.025346 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582fca4-82ef-41bc-afb2-9c9036a2d229 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:16.085474 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc649ab-f2be-4f2d-9447-e02a44065e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:16.086339 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc649ab-f2be-4f2d-9447-e02a44065e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:16.086624 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc649ab-f2be-4f2d-9447-e02a44065e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:16.086900 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc649ab-f2be-4f2d-9447-e02a44065e6d admin admin] PATH_INFO: `/v3/projects/818cef031a334947986b5359839285d7` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:16.088077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc649ab-f2be-4f2d-9447-e02a44065e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=818cef031a334947986b5359839285d7)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:16.090091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc649ab-f2be-4f2d-9447-e02a44065e6d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:16.193068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7cc649ab-f2be-4f2d-9447-e02a44065e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818cef031a334947986b5359839285d7', 'request_id': 'req-7cc649ab-f2be-4f2d-9447-e02a44065e6d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:16.198218 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7cc649ab-f2be-4f2d-9447-e02a44065e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818cef031a334947986b5359839285d7', 'request_id': 'req-7cc649ab-f2be-4f2d-9447-e02a44065e6d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:16.279014 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7cc649ab-f2be-4f2d-9447-e02a44065e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818cef031a334947986b5359839285d7', 'request_id': 'req-7cc649ab-f2be-4f2d-9447-e02a44065e6d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:16.296463 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7cc649ab-f2be-4f2d-9447-e02a44065e6d admin admin] The token cache is being invalidate because project 818cef031a334947986b5359839285d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:48:16.297267 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7cc649ab-f2be-4f2d-9447-e02a44065e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:16.297948 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7cc649ab-f2be-4f2d-9447-e02a44065e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:16.299485 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1405/2798] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:48:16 2022] DELETE /identity/v3/projects/818cef031a334947986b5359839285d7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:16.304414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b3617-b092-4aba-b3ad-ec3464e52478 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:16.304712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b3617-b092-4aba-b3ad-ec3464e52478 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:16.304995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b3617-b092-4aba-b3ad-ec3464e52478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:16.323714 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-e26b3617-b092-4aba-b3ad-ec3464e52478 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:16.325779 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-e26b3617-b092-4aba-b3ad-ec3464e52478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:16.384440 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1394/2799] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:16.392330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f24c7-1b7b-41a9-b29b-150c367f8ad0 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:16.392620 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f24c7-1b7b-41a9-b29b-150c367f8ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:16.392897 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f24c7-1b7b-41a9-b29b-150c367f8ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:16.410552 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-b36f24c7-1b7b-41a9-b29b-150c367f8ad0 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:16.411738 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-b36f24c7-1b7b-41a9-b29b-150c367f8ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:16.419459 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1406/2800] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:16.424172 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b3617-b092-4aba-b3ad-ec3464e52478 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:16.433700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b3617-b092-4aba-b3ad-ec3464e52478 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:16.438924 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2223d1-ba6a-491f-8e56-9dc7ff2192ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:16.439565 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2223d1-ba6a-491f-8e56-9dc7ff2192ef admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:16.439847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2223d1-ba6a-491f-8e56-9dc7ff2192ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:16.440122 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2223d1-ba6a-491f-8e56-9dc7ff2192ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:16.440868 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2223d1-ba6a-491f-8e56-9dc7ff2192ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:48:16.441179 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2223d1-ba6a-491f-8e56-9dc7ff2192ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:16.442769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2223d1-ba6a-491f-8e56-9dc7ff2192ef admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:16.454090 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1395/2801] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:48:16.458413 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f24c7-1b7b-41a9-b29b-150c367f8ad0 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:16.467297 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f24c7-1b7b-41a9-b29b-150c367f8ad0 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:16.471929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d9a5d-029d-4148-ad82-a21fbafce20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:16.472623 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d9a5d-029d-4148-ad82-a21fbafce20e admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:16.472904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d9a5d-029d-4148-ad82-a21fbafce20e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:16.473176 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d9a5d-029d-4148-ad82-a21fbafce20e admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:16.473875 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d9a5d-029d-4148-ad82-a21fbafce20e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:16.475755 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d9a5d-029d-4148-ad82-a21fbafce20e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:16.572954 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1407/2802] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:48:16 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:48:16.576934 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2223d1-ba6a-491f-8e56-9dc7ff2192ef admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:16.586962 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2223d1-ba6a-491f-8e56-9dc7ff2192ef admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:16.644789 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7e665-13ab-4acb-af0f-ead957aaae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:16.645595 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7e665-13ab-4acb-af0f-ead957aaae9c admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:16.645879 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7e665-13ab-4acb-af0f-ead957aaae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:16.646155 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7e665-13ab-4acb-af0f-ead957aaae9c admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:16.646859 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7e665-13ab-4acb-af0f-ead957aaae9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:16.650676 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7e665-13ab-4acb-af0f-ead957aaae9c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:16.760486 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1396/2803] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:48:16 2022] POST /identity/v3/users => generated 303 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:48:16.764829 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d9a5d-029d-4148-ad82-a21fbafce20e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:16.775358 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d9a5d-029d-4148-ad82-a21fbafce20e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:16.779940 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435785c1-70c7-4ba1-8092-0f19c88c27dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:16.780628 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435785c1-70c7-4ba1-8092-0f19c88c27dd admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:16.780912 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435785c1-70c7-4ba1-8092-0f19c88c27dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:16.781696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435785c1-70c7-4ba1-8092-0f19c88c27dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:16.782411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435785c1-70c7-4ba1-8092-0f19c88c27dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:16.783997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435785c1-70c7-4ba1-8092-0f19c88c27dd admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:16.794032 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1408/2804] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:48:16.801627 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7e665-13ab-4acb-af0f-ead957aaae9c admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:16.811326 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7e665-13ab-4acb-af0f-ead957aaae9c admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:16.815906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deafe7a-bc2b-4f68-a8b7-0e3bb919c7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:16.816624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deafe7a-bc2b-4f68-a8b7-0e3bb919c7ff admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:16.816905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deafe7a-bc2b-4f68-a8b7-0e3bb919c7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:16.817180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deafe7a-bc2b-4f68-a8b7-0e3bb919c7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:16.817894 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deafe7a-bc2b-4f68-a8b7-0e3bb919c7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:16.819477 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deafe7a-bc2b-4f68-a8b7-0e3bb919c7ff admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:16.829333 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1397/2805] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:48:16.833273 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435785c1-70c7-4ba1-8092-0f19c88c27dd admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:16.842792 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435785c1-70c7-4ba1-8092-0f19c88c27dd admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:16.847852 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61082e-6001-4c19-bedd-6ad9f9d09132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:16.848751 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61082e-6001-4c19-bedd-6ad9f9d09132 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:16.849034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61082e-6001-4c19-bedd-6ad9f9d09132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:16.849308 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61082e-6001-4c19-bedd-6ad9f9d09132 admin admin] PATH_INFO: `/v3/projects/e6c86453ef894f95a4ed011660f3fae4/users/94305331e3034d6db2ba6a5361146812/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:16.863658 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61082e-6001-4c19-bedd-6ad9f9d09132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c86453ef894f95a4ed011660f3fae4, user_id=94305331e3034d6db2ba6a5361146812, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:16.866322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61082e-6001-4c19-bedd-6ad9f9d09132 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:16.936855 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1409/2806] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:48:16 2022] PUT /identity/v3/projects/e6c86453ef894f95a4ed011660f3fae4/users/94305331e3034d6db2ba6a5361146812/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:48:16.941817 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde970d8-edaf-44b0-968a-6af5916dedb6 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:16.942108 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde970d8-edaf-44b0-968a-6af5916dedb6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:16.942417 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde970d8-edaf-44b0-968a-6af5916dedb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:16.960097 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-cde970d8-edaf-44b0-968a-6af5916dedb6 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:16.961311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-cde970d8-edaf-44b0-968a-6af5916dedb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:17.017359 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1398/2807] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:17.026757 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61082e-6001-4c19-bedd-6ad9f9d09132 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:17.028535 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-6d61082e-6001-4c19-bedd-6ad9f9d09132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:17.082708 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61082e-6001-4c19-bedd-6ad9f9d09132 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:17.086235 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced26d8c-74a8-4ab1-9816-c1f31a2c0930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:17.086862 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced26d8c-74a8-4ab1-9816-c1f31a2c0930 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:17.087141 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced26d8c-74a8-4ab1-9816-c1f31a2c0930 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:17.087413 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced26d8c-74a8-4ab1-9816-c1f31a2c0930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:17.096869 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced26d8c-74a8-4ab1-9816-c1f31a2c0930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:17.098291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced26d8c-74a8-4ab1-9816-c1f31a2c0930 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:17.107574 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1410/2808] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:48:18.363051 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745a86-b091-448c-97dd-054c70d943f6 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:18.363602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745a86-b091-448c-97dd-054c70d943f6 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:18.363602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745a86-b091-448c-97dd-054c70d943f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:18.389570 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-ae745a86-b091-448c-97dd-054c70d943f6 None None] MFA Rules not processed for user `94305331e3034d6db2ba6a5361146812`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:18.390762 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ae745a86-b091-448c-97dd-054c70d943f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:18.453864 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1399/2809] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:18.458835 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced26d8c-74a8-4ab1-9816-c1f31a2c0930 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:18.468401 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced26d8c-74a8-4ab1-9816-c1f31a2c0930 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:18.473607 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3c207-00aa-4da5-81f8-59521eeecf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:18.474249 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3c207-00aa-4da5-81f8-59521eeecf95 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:18.474536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3c207-00aa-4da5-81f8-59521eeecf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:18.474812 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3c207-00aa-4da5-81f8-59521eeecf95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:18.475506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3c207-00aa-4da5-81f8-59521eeecf95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:18.477480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3c207-00aa-4da5-81f8-59521eeecf95 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:18.589579 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1411/2810] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:48:18 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:48:18.593662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745a86-b091-448c-97dd-054c70d943f6 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:18.604833 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745a86-b091-448c-97dd-054c70d943f6 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:18.659142 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56b7f7-9df6-4e84-8de0-5308fe76640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:18.659800 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56b7f7-9df6-4e84-8de0-5308fe76640b admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:18.660083 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56b7f7-9df6-4e84-8de0-5308fe76640b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:18.660404 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56b7f7-9df6-4e84-8de0-5308fe76640b admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:18.661073 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56b7f7-9df6-4e84-8de0-5308fe76640b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:18.663058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56b7f7-9df6-4e84-8de0-5308fe76640b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:18.754816 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1400/2811] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:48:18 2022] POST /identity/v3/users => generated 309 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:48:18.758813 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3c207-00aa-4da5-81f8-59521eeecf95 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:18.769692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3c207-00aa-4da5-81f8-59521eeecf95 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:18.774318 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ee0a4-e9f3-48c9-964c-346e06163d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:18.774972 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ee0a4-e9f3-48c9-964c-346e06163d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:18.775258 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ee0a4-e9f3-48c9-964c-346e06163d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:18.775565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ee0a4-e9f3-48c9-964c-346e06163d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:18.776418 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ee0a4-e9f3-48c9-964c-346e06163d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:18.778019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ee0a4-e9f3-48c9-964c-346e06163d3b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:18.788625 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1412/2812] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:48:18.792720 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56b7f7-9df6-4e84-8de0-5308fe76640b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:18.802630 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56b7f7-9df6-4e84-8de0-5308fe76640b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:18.807212 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60ae9c-bf70-4ff5-b43d-2e4b0bc494aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:18.808072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60ae9c-bf70-4ff5-b43d-2e4b0bc494aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:18.808387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60ae9c-bf70-4ff5-b43d-2e4b0bc494aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:18.808664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60ae9c-bf70-4ff5-b43d-2e4b0bc494aa admin admin] PATH_INFO: `/v3/projects/60ff19d8beda43bbaa31644803b3adcf/users/f2e607d8dc6a42c7a8efc5edc97c5c3a/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:18.823549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60ae9c-bf70-4ff5-b43d-2e4b0bc494aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ff19d8beda43bbaa31644803b3adcf, user_id=f2e607d8dc6a42c7a8efc5edc97c5c3a, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:18.826252 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60ae9c-bf70-4ff5-b43d-2e4b0bc494aa admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:18.892571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1401/2813] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:48:18 2022] PUT /identity/v3/projects/60ff19d8beda43bbaa31644803b3adcf/users/f2e607d8dc6a42c7a8efc5edc97c5c3a/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:18.896548 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ee0a4-e9f3-48c9-964c-346e06163d3b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:18.906491 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ee0a4-e9f3-48c9-964c-346e06163d3b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:18.962152 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69dba7c-4949-42a2-af5d-8ac222b2801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:18.962808 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dba7c-4949-42a2-af5d-8ac222b2801f admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:18.963091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dba7c-4949-42a2-af5d-8ac222b2801f admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:18.963366 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69dba7c-4949-42a2-af5d-8ac222b2801f admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:18.964077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69dba7c-4949-42a2-af5d-8ac222b2801f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:18.965686 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69dba7c-4949-42a2-af5d-8ac222b2801f admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:18.974990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1413/2814] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:48:18.979066 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60ae9c-bf70-4ff5-b43d-2e4b0bc494aa admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:18.989006 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60ae9c-bf70-4ff5-b43d-2e4b0bc494aa admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:18.993528 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71130e48-798b-4c2a-8a44-5731122a815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:18.994397 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71130e48-798b-4c2a-8a44-5731122a815b admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:18.994673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71130e48-798b-4c2a-8a44-5731122a815b admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:18.994946 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71130e48-798b-4c2a-8a44-5731122a815b admin admin] PATH_INFO: `/v3/projects/60ff19d8beda43bbaa31644803b3adcf/users/f2e607d8dc6a42c7a8efc5edc97c5c3a/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:18.996883 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71130e48-798b-4c2a-8a44-5731122a815b admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ff19d8beda43bbaa31644803b3adcf, user_id=f2e607d8dc6a42c7a8efc5edc97c5c3a, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:18.999516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71130e48-798b-4c2a-8a44-5731122a815b admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:19.009763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1402/2815] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:48:18 2022] PUT /identity/v3/projects/60ff19d8beda43bbaa31644803b3adcf/users/f2e607d8dc6a42c7a8efc5edc97c5c3a/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:20.264929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f17c-8ac8-4fd9-8070-528b83890ef9 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:20.265407 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f17c-8ac8-4fd9-8070-528b83890ef9 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:20.265503 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f17c-8ac8-4fd9-8070-528b83890ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:20.294169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c147f17c-8ac8-4fd9-8070-528b83890ef9 None None] MFA Rules not processed for user `f2e607d8dc6a42c7a8efc5edc97c5c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:20.295713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c147f17c-8ac8-4fd9-8070-528b83890ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:20.371642 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1414/2816] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:21.674945 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71130e48-798b-4c2a-8a44-5731122a815b admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:21.735102 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71130e48-798b-4c2a-8a44-5731122a815b admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:21.739599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:21.740486 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:21.740773 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:21.741049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] PATH_INFO: `/v3/users/94305331e3034d6db2ba6a5361146812` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:21.742224 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94305331e3034d6db2ba6a5361146812)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:21.744123 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:22.014003 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94305331e3034d6db2ba6a5361146812'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:22.074503 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94305331e3034d6db2ba6a5361146812'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:22.086763 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94305331e3034d6db2ba6a5361146812'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:22.087387 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94305331e3034d6db2ba6a5361146812'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:22.094013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94305331e3034d6db2ba6a5361146812'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:22.099844 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1403/2817] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:48:21 2022] DELETE /identity/v3/users/94305331e3034d6db2ba6a5361146812 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:22.327589 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147f17c-8ac8-4fd9-8070-528b83890ef9 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:22.338376 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147f17c-8ac8-4fd9-8070-528b83890ef9 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:22.395960 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:22.396852 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:22.397141 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:22.397417 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] PATH_INFO: `/v3/projects/e6c86453ef894f95a4ed011660f3fae4` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:22.398604 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c86453ef894f95a4ed011660f3fae4)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:22.400554 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:22.541289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c86453ef894f95a4ed011660f3fae4', 'request_id': 'req-7f30cec0-e35e-4405-ae28-d4e344f4ddef'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:22.546605 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c86453ef894f95a4ed011660f3fae4', 'request_id': 'req-7f30cec0-e35e-4405-ae28-d4e344f4ddef'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:22.646056 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c86453ef894f95a4ed011660f3fae4', 'request_id': 'req-7f30cec0-e35e-4405-ae28-d4e344f4ddef'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:22.656965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] The token cache is being invalidate because project e6c86453ef894f95a4ed011660f3fae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:48:22.657748 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:22.658367 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:22.659885 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1415/2818] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:48:22 2022] DELETE /identity/v3/projects/e6c86453ef894f95a4ed011660f3fae4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:22.663920 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:22.665325 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:22.678749 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966247e3-0158-4274-a9c7-725942e21882 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:22.732093 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d90e1d-12d1-494c-8b84-f450b10b6299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:22.738041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90e1d-12d1-494c-8b84-f450b10b6299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:22.738041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90e1d-12d1-494c-8b84-f450b10b6299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:22.738041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90e1d-12d1-494c-8b84-f450b10b6299 admin admin] PATH_INFO: `/v3/users/f2e607d8dc6a42c7a8efc5edc97c5c3a` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:22.738041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d90e1d-12d1-494c-8b84-f450b10b6299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e607d8dc6a42c7a8efc5edc97c5c3a)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:22.738041 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d90e1d-12d1-494c-8b84-f450b10b6299 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:22.928406 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-86d90e1d-12d1-494c-8b84-f450b10b6299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e607d8dc6a42c7a8efc5edc97c5c3a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:23.038645 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-86d90e1d-12d1-494c-8b84-f450b10b6299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e607d8dc6a42c7a8efc5edc97c5c3a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:23.050951 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-86d90e1d-12d1-494c-8b84-f450b10b6299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e607d8dc6a42c7a8efc5edc97c5c3a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:23.051631 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-86d90e1d-12d1-494c-8b84-f450b10b6299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e607d8dc6a42c7a8efc5edc97c5c3a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:23.058463 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-86d90e1d-12d1-494c-8b84-f450b10b6299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e607d8dc6a42c7a8efc5edc97c5c3a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:23.064222 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1404/2819] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:48:22 2022] DELETE /identity/v3/users/f2e607d8dc6a42c7a8efc5edc97c5c3a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:23.345691 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:23.347303 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:23.362091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30cec0-e35e-4405-ae28-d4e344f4ddef admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:23.419434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e77ae-3a4e-49ac-b840-4f18324c094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:23.420516 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e77ae-3a4e-49ac-b840-4f18324c094a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:23.420803 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e77ae-3a4e-49ac-b840-4f18324c094a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:23.421083 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e77ae-3a4e-49ac-b840-4f18324c094a admin admin] PATH_INFO: `/v3/projects/60ff19d8beda43bbaa31644803b3adcf` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:23.422370 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e77ae-3a4e-49ac-b840-4f18324c094a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ff19d8beda43bbaa31644803b3adcf)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:23.424365 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e77ae-3a4e-49ac-b840-4f18324c094a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:23.549412 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-592e77ae-3a4e-49ac-b840-4f18324c094a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ff19d8beda43bbaa31644803b3adcf', 'request_id': 'req-592e77ae-3a4e-49ac-b840-4f18324c094a'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:23.555321 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-592e77ae-3a4e-49ac-b840-4f18324c094a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ff19d8beda43bbaa31644803b3adcf', 'request_id': 'req-592e77ae-3a4e-49ac-b840-4f18324c094a'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:23.650473 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-592e77ae-3a4e-49ac-b840-4f18324c094a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ff19d8beda43bbaa31644803b3adcf', 'request_id': 'req-592e77ae-3a4e-49ac-b840-4f18324c094a'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:23.662250 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-592e77ae-3a4e-49ac-b840-4f18324c094a admin admin] The token cache is being invalidate because project 60ff19d8beda43bbaa31644803b3adcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:48:23.662542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-592e77ae-3a4e-49ac-b840-4f18324c094a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:23.663201 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-592e77ae-3a4e-49ac-b840-4f18324c094a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:23.664973 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1416/2820] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:48:23 2022] DELETE /identity/v3/projects/60ff19d8beda43bbaa31644803b3adcf => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:23.670376 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b5b48-dc21-4214-8349-1d8143db88bf None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:23.670608 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b5b48-dc21-4214-8349-1d8143db88bf None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:23.670884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b5b48-dc21-4214-8349-1d8143db88bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:23.691260 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-867b5b48-dc21-4214-8349-1d8143db88bf None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:23.692490 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-867b5b48-dc21-4214-8349-1d8143db88bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:23.754107 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1405/2821] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:23.762049 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eb3f4-4406-4ba0-a37f-da0c755caf3a None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:23.763615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eb3f4-4406-4ba0-a37f-da0c755caf3a None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:23.763615 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2eb3f4-4406-4ba0-a37f-da0c755caf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:23.780929 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-4f2eb3f4-4406-4ba0-a37f-da0c755caf3a None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:23.782160 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-4f2eb3f4-4406-4ba0-a37f-da0c755caf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:23.790622 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1417/2822] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:23.795293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b5b48-dc21-4214-8349-1d8143db88bf None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:23.806173 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b5b48-dc21-4214-8349-1d8143db88bf None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:23.810826 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533623a0-4bd2-4065-a1d0-99926a0283c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:23.811480 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533623a0-4bd2-4065-a1d0-99926a0283c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:23.811765 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533623a0-4bd2-4065-a1d0-99926a0283c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:23.812043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533623a0-4bd2-4065-a1d0-99926a0283c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:23.812801 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533623a0-4bd2-4065-a1d0-99926a0283c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:48:23.813115 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533623a0-4bd2-4065-a1d0-99926a0283c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:23.815311 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533623a0-4bd2-4065-a1d0-99926a0283c1 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:23.827182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1406/2823] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:48:23.833506 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2eb3f4-4406-4ba0-a37f-da0c755caf3a None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:23.840823 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2eb3f4-4406-4ba0-a37f-da0c755caf3a None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:23.845479 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d56d90-af65-4e63-b4bd-4d080882543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:23.846124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d56d90-af65-4e63-b4bd-4d080882543e admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:23.846410 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d56d90-af65-4e63-b4bd-4d080882543e admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:23.846691 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d56d90-af65-4e63-b4bd-4d080882543e admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:23.847438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d56d90-af65-4e63-b4bd-4d080882543e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:23.849390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d56d90-af65-4e63-b4bd-4d080882543e admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:23.939998 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1418/2824] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:48:23 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:48:23.944035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533623a0-4bd2-4065-a1d0-99926a0283c1 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:23.954074 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533623a0-4bd2-4065-a1d0-99926a0283c1 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:24.010906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe08076-b7e9-4c4a-adab-784de860e313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:24.011696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe08076-b7e9-4c4a-adab-784de860e313 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:24.011984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe08076-b7e9-4c4a-adab-784de860e313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:24.012289 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe08076-b7e9-4c4a-adab-784de860e313 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:24.012982 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe08076-b7e9-4c4a-adab-784de860e313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:24.014878 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe08076-b7e9-4c4a-adab-784de860e313 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:24.120227 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1407/2825] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:48:23 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:48:24.124320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d56d90-af65-4e63-b4bd-4d080882543e admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:24.134411 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d56d90-af65-4e63-b4bd-4d080882543e admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:24.139107 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681679a-70fd-46eb-9f4c-167765069ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:24.139753 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681679a-70fd-46eb-9f4c-167765069ede admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:24.140035 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681679a-70fd-46eb-9f4c-167765069ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:24.140341 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681679a-70fd-46eb-9f4c-167765069ede admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:24.141071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681679a-70fd-46eb-9f4c-167765069ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:24.142696 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681679a-70fd-46eb-9f4c-167765069ede admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:24.152949 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1419/2826] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:48:24.156906 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe08076-b7e9-4c4a-adab-784de860e313 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:24.167068 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe08076-b7e9-4c4a-adab-784de860e313 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:24.171780 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505920f0-1905-46ab-9025-8621c222b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:24.172454 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505920f0-1905-46ab-9025-8621c222b75c admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:24.172733 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505920f0-1905-46ab-9025-8621c222b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:24.173008 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505920f0-1905-46ab-9025-8621c222b75c admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:24.174388 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505920f0-1905-46ab-9025-8621c222b75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:24.175949 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505920f0-1905-46ab-9025-8621c222b75c admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:24.185516 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1408/2827] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:48:24.189497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681679a-70fd-46eb-9f4c-167765069ede admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:24.199098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681679a-70fd-46eb-9f4c-167765069ede admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:24.203618 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e790f23-089d-4729-a7f9-06bde9e80572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:24.204514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e790f23-089d-4729-a7f9-06bde9e80572 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:24.204800 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e790f23-089d-4729-a7f9-06bde9e80572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:24.205077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e790f23-089d-4729-a7f9-06bde9e80572 admin admin] PATH_INFO: `/v3/projects/30344f910da54e59911f80595f5fe336/users/ffa32404611c4fd8b6a7a8807f14661d/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:24.219122 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e790f23-089d-4729-a7f9-06bde9e80572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30344f910da54e59911f80595f5fe336, user_id=ffa32404611c4fd8b6a7a8807f14661d, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:24.222309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e790f23-089d-4729-a7f9-06bde9e80572 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:24.295672 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1420/2828] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:48:24 2022] PUT /identity/v3/projects/30344f910da54e59911f80595f5fe336/users/ffa32404611c4fd8b6a7a8807f14661d/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:48:24.307609 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11616ba7-f8e4-4e1a-af77-fd853a8664c1 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:24.307897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11616ba7-f8e4-4e1a-af77-fd853a8664c1 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:24.308204 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11616ba7-f8e4-4e1a-af77-fd853a8664c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:24.335347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-11616ba7-f8e4-4e1a-af77-fd853a8664c1 None None] MFA Rules not processed for user `ffa32404611c4fd8b6a7a8807f14661d`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:24.336631 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-11616ba7-f8e4-4e1a-af77-fd853a8664c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:24.396536 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1409/2829] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:24.400976 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e790f23-089d-4729-a7f9-06bde9e80572 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:24.459557 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e790f23-089d-4729-a7f9-06bde9e80572 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:24.464233 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750d02c-7652-4939-b8db-e986c2c8b69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:24.464903 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750d02c-7652-4939-b8db-e986c2c8b69a admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:24.465185 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750d02c-7652-4939-b8db-e986c2c8b69a admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:24.465460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750d02c-7652-4939-b8db-e986c2c8b69a admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:24.466145 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750d02c-7652-4939-b8db-e986c2c8b69a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:24.468034 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750d02c-7652-4939-b8db-e986c2c8b69a admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:24.549824 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1421/2830] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:48:24 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:48:24.553746 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11616ba7-f8e4-4e1a-af77-fd853a8664c1 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:24.564112 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11616ba7-f8e4-4e1a-af77-fd853a8664c1 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:24.620931 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d02992-6d88-4a77-9c36-4c490c566c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:24.621596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02992-6d88-4a77-9c36-4c490c566c04 admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:24.621885 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02992-6d88-4a77-9c36-4c490c566c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:24.622164 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d02992-6d88-4a77-9c36-4c490c566c04 admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:24.622852 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d02992-6d88-4a77-9c36-4c490c566c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:24.624812 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d02992-6d88-4a77-9c36-4c490c566c04 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:24.743494 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1410/2831] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:48:24 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:48:24.753029 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750d02c-7652-4939-b8db-e986c2c8b69a admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:24.763115 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750d02c-7652-4939-b8db-e986c2c8b69a admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:24.768398 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc7af2-6a56-4170-94d3-5babb5338ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:24.769047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc7af2-6a56-4170-94d3-5babb5338ccc admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:24.769330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc7af2-6a56-4170-94d3-5babb5338ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:24.769608 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc7af2-6a56-4170-94d3-5babb5338ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:24.770433 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc7af2-6a56-4170-94d3-5babb5338ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:24.771947 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc7af2-6a56-4170-94d3-5babb5338ccc admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:24.782181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1422/2832] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:48:24.793278 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d02992-6d88-4a77-9c36-4c490c566c04 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:24.803386 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d02992-6d88-4a77-9c36-4c490c566c04 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:24.808519 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401a59-7ce9-43af-905b-0c97b866b7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:24.809467 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401a59-7ce9-43af-905b-0c97b866b7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:24.809751 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401a59-7ce9-43af-905b-0c97b866b7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:24.810078 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401a59-7ce9-43af-905b-0c97b866b7ca admin admin] PATH_INFO: `/v3/projects/d5b64affb03f48e4919bdbfce6879dc0/users/4c1bfc7bda9743ef8052a1583700163a/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:24.826132 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be401a59-7ce9-43af-905b-0c97b866b7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b64affb03f48e4919bdbfce6879dc0, user_id=4c1bfc7bda9743ef8052a1583700163a, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:24.828897 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be401a59-7ce9-43af-905b-0c97b866b7ca admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:24.935433 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1411/2833] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:48:24 2022] PUT /identity/v3/projects/d5b64affb03f48e4919bdbfce6879dc0/users/4c1bfc7bda9743ef8052a1583700163a/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:24.939539 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc7af2-6a56-4170-94d3-5babb5338ccc admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:24.950141 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc7af2-6a56-4170-94d3-5babb5338ccc admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:25.003295 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3ddd2-ff7f-4f54-93ea-b5ba8981c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:25.003871 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3ddd2-ff7f-4f54-93ea-b5ba8981c61c admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:25.004167 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3ddd2-ff7f-4f54-93ea-b5ba8981c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:25.004456 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3ddd2-ff7f-4f54-93ea-b5ba8981c61c admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:25.005166 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3ddd2-ff7f-4f54-93ea-b5ba8981c61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:25.006741 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3ddd2-ff7f-4f54-93ea-b5ba8981c61c admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:25.016019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1423/2834] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:48:25.020843 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401a59-7ce9-43af-905b-0c97b866b7ca admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:25.031113 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401a59-7ce9-43af-905b-0c97b866b7ca admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:25.037177 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bedfb-548b-4051-be1e-7a7b794b5f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:25.038213 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bedfb-548b-4051-be1e-7a7b794b5f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:25.038498 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bedfb-548b-4051-be1e-7a7b794b5f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:25.038811 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bedfb-548b-4051-be1e-7a7b794b5f39 admin admin] PATH_INFO: `/v3/projects/d5b64affb03f48e4919bdbfce6879dc0/users/4c1bfc7bda9743ef8052a1583700163a/roles/24a7898c863141f1911792647b5274e3` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:25.041178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bedfb-548b-4051-be1e-7a7b794b5f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b64affb03f48e4919bdbfce6879dc0, user_id=4c1bfc7bda9743ef8052a1583700163a, role_id=24a7898c863141f1911792647b5274e3)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:25.044378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bedfb-548b-4051-be1e-7a7b794b5f39 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:25.055098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1412/2835] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:48:25 2022] PUT /identity/v3/projects/d5b64affb03f48e4919bdbfce6879dc0/users/4c1bfc7bda9743ef8052a1583700163a/roles/24a7898c863141f1911792647b5274e3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:48:25.065773 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3606bf9-dfc2-4c3b-9d84-37b8714567aa None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:25.066059 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3606bf9-dfc2-4c3b-9d84-37b8714567aa None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:25.066368 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3606bf9-dfc2-4c3b-9d84-37b8714567aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:25.091968 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-d3606bf9-dfc2-4c3b-9d84-37b8714567aa None None] MFA Rules not processed for user `4c1bfc7bda9743ef8052a1583700163a`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:25.093196 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-d3606bf9-dfc2-4c3b-9d84-37b8714567aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:25.159113 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1424/2836] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:25.170990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bedfb-548b-4051-be1e-7a7b794b5f39 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:25.172775 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-146bedfb-548b-4051-be1e-7a7b794b5f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:25.227827 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bedfb-548b-4051-be1e-7a7b794b5f39 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:25.231482 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1cf2b-3092-436d-950c-0a367d8f4f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:25.232113 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1cf2b-3092-436d-950c-0a367d8f4f09 service cinder] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:25.232431 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1cf2b-3092-436d-950c-0a367d8f4f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:25.232711 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1cf2b-3092-436d-950c-0a367d8f4f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:25.241943 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1cf2b-3092-436d-950c-0a367d8f4f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:25.243367 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1cf2b-3092-436d-950c-0a367d8f4f09 service cinder] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:25.253027 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1413/2837] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:48:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:48:25.463536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3606bf9-dfc2-4c3b-9d84-37b8714567aa None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:25.473797 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3606bf9-dfc2-4c3b-9d84-37b8714567aa None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:25.477322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a9b46-aca2-4290-bcf9-08abf9f18690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:25.477944 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a9b46-aca2-4290-bcf9-08abf9f18690 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:25.478224 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a9b46-aca2-4290-bcf9-08abf9f18690 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:25.478497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a9b46-aca2-4290-bcf9-08abf9f18690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:25.534460 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a9b46-aca2-4290-bcf9-08abf9f18690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:25.535798 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a9b46-aca2-4290-bcf9-08abf9f18690 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:25.544692 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1425/2838] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:48:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:48:37.133384 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1cf2b-3092-436d-950c-0a367d8f4f09 service cinder] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:37.192986 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1cf2b-3092-436d-950c-0a367d8f4f09 service cinder] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:37.197987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:37.198937 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:37.199216 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:37.199488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] PATH_INFO: `/v3/users/ffa32404611c4fd8b6a7a8807f14661d` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:37.200693 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa32404611c4fd8b6a7a8807f14661d)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:37.202585 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:37.384261 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa32404611c4fd8b6a7a8807f14661d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:37.466241 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa32404611c4fd8b6a7a8807f14661d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:37.478197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa32404611c4fd8b6a7a8807f14661d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:37.478858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa32404611c4fd8b6a7a8807f14661d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:37.485377 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa32404611c4fd8b6a7a8807f14661d'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:37.491662 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1414/2839] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:48:37 2022] DELETE /identity/v3/users/ffa32404611c4fd8b6a7a8807f14661d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:37.496102 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a46c5-e260-41f2-9cd0-b6235848476b None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:37.496610 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a46c5-e260-41f2-9cd0-b6235848476b None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:37.496726 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a46c5-e260-41f2-9cd0-b6235848476b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:37.513953 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-872a46c5-e260-41f2-9cd0-b6235848476b None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:37.515149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-872a46c5-e260-41f2-9cd0-b6235848476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:37.570554 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1426/2840] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:37.580112 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:37.581546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:37.636621 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbec0b5-950d-43ba-a1eb-9bb51cad68d9 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:37.640117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47f0c0-c915-41b5-a671-cd8a001727cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:37.640810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47f0c0-c915-41b5-a671-cd8a001727cf service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:37.641095 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47f0c0-c915-41b5-a671-cd8a001727cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:37.641547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47f0c0-c915-41b5-a671-cd8a001727cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:37.650287 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47f0c0-c915-41b5-a671-cd8a001727cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:37.651750 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47f0c0-c915-41b5-a671-cd8a001727cf service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:37.660995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1415/2841] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:48:38.075814 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a46c5-e260-41f2-9cd0-b6235848476b None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:38.077264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-872a46c5-e260-41f2-9cd0-b6235848476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:38.089811 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a46c5-e260-41f2-9cd0-b6235848476b None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:38.094501 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:38.095476 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:38.095842 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:38.096217 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] PATH_INFO: `/v3/projects/30344f910da54e59911f80595f5fe336` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:38.097478 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=30344f910da54e59911f80595f5fe336)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:38.099526 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:38.234173 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30344f910da54e59911f80595f5fe336', 'request_id': 'req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:38.239263 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30344f910da54e59911f80595f5fe336', 'request_id': 'req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:38.337111 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30344f910da54e59911f80595f5fe336', 'request_id': 'req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:38.348995 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] The token cache is being invalidate because project 30344f910da54e59911f80595f5fe336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:48:38.349322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:38.349983 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:38.352320 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1427/2842] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:48:38 2022] DELETE /identity/v3/projects/30344f910da54e59911f80595f5fe336 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:38.361739 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47f0c0-c915-41b5-a671-cd8a001727cf service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:38.365995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47f0c0-c915-41b5-a671-cd8a001727cf service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:38.420744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a18bb-23e4-429b-87c8-5620e0f73822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:38.421613 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a18bb-23e4-429b-87c8-5620e0f73822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:38.421919 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a18bb-23e4-429b-87c8-5620e0f73822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:38.422180 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a18bb-23e4-429b-87c8-5620e0f73822 admin admin] PATH_INFO: `/v3/users/4c1bfc7bda9743ef8052a1583700163a` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:38.423370 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a18bb-23e4-429b-87c8-5620e0f73822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1bfc7bda9743ef8052a1583700163a)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:38.425373 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a18bb-23e4-429b-87c8-5620e0f73822 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:38.650846 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c95a18bb-23e4-429b-87c8-5620e0f73822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1bfc7bda9743ef8052a1583700163a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:38.729251 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c95a18bb-23e4-429b-87c8-5620e0f73822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1bfc7bda9743ef8052a1583700163a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:38.741531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c95a18bb-23e4-429b-87c8-5620e0f73822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1bfc7bda9743ef8052a1583700163a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:38.742214 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c95a18bb-23e4-429b-87c8-5620e0f73822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1bfc7bda9743ef8052a1583700163a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:38.748905 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-c95a18bb-23e4-429b-87c8-5620e0f73822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1bfc7bda9743ef8052a1583700163a'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:38.754624 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1416/2843] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:48:38 2022] DELETE /identity/v3/users/4c1bfc7bda9743ef8052a1583700163a => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:39.143953 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:39.145465 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:39.159609 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c6d86-9db1-4d52-80bc-523650ad9fcb admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:39.212857 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:39.213713 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:39.213992 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:39.214264 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4 admin admin] PATH_INFO: `/v3/projects/d5b64affb03f48e4919bdbfce6879dc0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:39.215422 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b64affb03f48e4919bdbfce6879dc0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:39.217344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:39.318918 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b64affb03f48e4919bdbfce6879dc0', 'request_id': 'req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:39.324216 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b64affb03f48e4919bdbfce6879dc0', 'request_id': 'req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:39.394144 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b64affb03f48e4919bdbfce6879dc0', 'request_id': 'req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:39.406330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4 admin admin] The token cache is being invalidate because project d5b64affb03f48e4919bdbfce6879dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:48:39.406630 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:39.407259 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-6bf5c62b-64d4-46a3-b4c4-52bd240b44f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:39.408854 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1428/2844] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:48:39 2022] DELETE /identity/v3/projects/d5b64affb03f48e4919bdbfce6879dc0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:39.415571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01130b1e-b7f3-4904-a11b-b63595aa290b None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:39.416043 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01130b1e-b7f3-4904-a11b-b63595aa290b None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:39.416195 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01130b1e-b7f3-4904-a11b-b63595aa290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:39.434182 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-01130b1e-b7f3-4904-a11b-b63595aa290b None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:39.435378 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-01130b1e-b7f3-4904-a11b-b63595aa290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:39.490447 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1417/2845] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:39.498877 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac07e39-8b7d-48e3-b14a-c4fed9ffea13 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:39.499173 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac07e39-8b7d-48e3-b14a-c4fed9ffea13 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:39.499454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac07e39-8b7d-48e3-b14a-c4fed9ffea13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:39.517594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-aac07e39-8b7d-48e3-b14a-c4fed9ffea13 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:39.518794 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-aac07e39-8b7d-48e3-b14a-c4fed9ffea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:39.526643 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1429/2846] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:39.530764 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01130b1e-b7f3-4904-a11b-b63595aa290b None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:39.540620 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01130b1e-b7f3-4904-a11b-b63595aa290b None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:39.545362 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549aa1-ca79-4a9c-8672-4e605ef695e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:39.545995 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549aa1-ca79-4a9c-8672-4e605ef695e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:39.546283 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549aa1-ca79-4a9c-8672-4e605ef695e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:39.546559 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549aa1-ca79-4a9c-8672-4e605ef695e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:39.547272 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc549aa1-ca79-4a9c-8672-4e605ef695e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:48:39.547581 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc549aa1-ca79-4a9c-8672-4e605ef695e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:39.549214 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc549aa1-ca79-4a9c-8672-4e605ef695e7 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:39.560877 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1418/2847] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:48:39.564823 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac07e39-8b7d-48e3-b14a-c4fed9ffea13 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:39.573916 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac07e39-8b7d-48e3-b14a-c4fed9ffea13 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:39.578507 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46045594-0b2e-48b0-b929-57b60ab91383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:39.579133 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46045594-0b2e-48b0-b929-57b60ab91383 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:39.579415 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46045594-0b2e-48b0-b929-57b60ab91383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:39.579688 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46045594-0b2e-48b0-b929-57b60ab91383 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:39.580442 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46045594-0b2e-48b0-b929-57b60ab91383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:39.582301 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46045594-0b2e-48b0-b929-57b60ab91383 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:39.663641 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1430/2848] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:48:39 2022] POST /identity/v3/projects => generated 361 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 15:48:39.668347 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549aa1-ca79-4a9c-8672-4e605ef695e7 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:39.678187 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549aa1-ca79-4a9c-8672-4e605ef695e7 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:39.733840 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0aaa4a-90ad-4d2a-b5be-be3d071053dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:39.734497 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aaa4a-90ad-4d2a-b5be-be3d071053dc admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:39.734784 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aaa4a-90ad-4d2a-b5be-be3d071053dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:39.735062 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0aaa4a-90ad-4d2a-b5be-be3d071053dc admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:39.735744 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0aaa4a-90ad-4d2a-b5be-be3d071053dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:39.737700 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0aaa4a-90ad-4d2a-b5be-be3d071053dc admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:39.845191 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1419/2849] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:48:39 2022] POST /identity/v3/users => generated 281 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:48:39.849307 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46045594-0b2e-48b0-b929-57b60ab91383 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:39.860168 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46045594-0b2e-48b0-b929-57b60ab91383 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:39.864864 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ec467-229d-4b64-9495-1e5c051a4079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:39.865513 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ec467-229d-4b64-9495-1e5c051a4079 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:39.865801 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ec467-229d-4b64-9495-1e5c051a4079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:39.866082 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ec467-229d-4b64-9495-1e5c051a4079 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:39.866836 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ec467-229d-4b64-9495-1e5c051a4079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:39.868515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ec467-229d-4b64-9495-1e5c051a4079 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:39.878545 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1431/2850] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 15:48:39.882266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0aaa4a-90ad-4d2a-b5be-be3d071053dc admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:39.892070 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0aaa4a-90ad-4d2a-b5be-be3d071053dc admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:39.896670 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69ad41-4bb8-4423-9ff0-f9012f7e8a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:39.897310 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69ad41-4bb8-4423-9ff0-f9012f7e8a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:39.897592 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69ad41-4bb8-4423-9ff0-f9012f7e8a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:39.897867 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69ad41-4bb8-4423-9ff0-f9012f7e8a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:39.899114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69ad41-4bb8-4423-9ff0-f9012f7e8a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:39.900722 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69ad41-4bb8-4423-9ff0-f9012f7e8a88 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:39.910313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1420/2851] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:48:39.914254 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ec467-229d-4b64-9495-1e5c051a4079 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:39.924820 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ec467-229d-4b64-9495-1e5c051a4079 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:39.929315 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51a81d-b903-42a8-9d31-367c1ebbdd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:39.930195 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51a81d-b903-42a8-9d31-367c1ebbdd35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:39.930473 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51a81d-b903-42a8-9d31-367c1ebbdd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:39.930746 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51a81d-b903-42a8-9d31-367c1ebbdd35 admin admin] PATH_INFO: `/v3/projects/c3ac68426da24c089e59a19f9bf61a4f/users/f5243951d5d645bfad8c6782e6c505e2/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:39.944569 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51a81d-b903-42a8-9d31-367c1ebbdd35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ac68426da24c089e59a19f9bf61a4f, user_id=f5243951d5d645bfad8c6782e6c505e2, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:39.947695 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51a81d-b903-42a8-9d31-367c1ebbdd35 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:40.051337 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1432/2852] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:48:39 2022] PUT /identity/v3/projects/c3ac68426da24c089e59a19f9bf61a4f/users/f5243951d5d645bfad8c6782e6c505e2/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:48:40.062410 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fbc8b-0f68-4f9c-ae0b-0ce16e2340c7 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:40.062710 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fbc8b-0f68-4f9c-ae0b-0ce16e2340c7 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:40.063394 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fbc8b-0f68-4f9c-ae0b-0ce16e2340c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:40.089614 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-215fbc8b-0f68-4f9c-ae0b-0ce16e2340c7 None None] MFA Rules not processed for user `f5243951d5d645bfad8c6782e6c505e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:40.090820 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-215fbc8b-0f68-4f9c-ae0b-0ce16e2340c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:40.153285 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1421/2853] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 15:48:40.183594 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51a81d-b903-42a8-9d31-367c1ebbdd35 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:40.185392 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7f51a81d-b903-42a8-9d31-367c1ebbdd35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:40.239988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51a81d-b903-42a8-9d31-367c1ebbdd35 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:40.243724 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e8c51-e7d4-4a51-ac80-acdb028c4ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:40.244389 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e8c51-e7d4-4a51-ac80-acdb028c4ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:40.244676 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e8c51-e7d4-4a51-ac80-acdb028c4ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:40.244961 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e8c51-e7d4-4a51-ac80-acdb028c4ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:40.253031 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e8c51-e7d4-4a51-ac80-acdb028c4ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:40.254454 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e8c51-e7d4-4a51-ac80-acdb028c4ce9 service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:40.263514 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1433/2854] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:48:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:48:40.277793 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fbc8b-0f68-4f9c-ae0b-0ce16e2340c7 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:40.337390 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fbc8b-0f68-4f9c-ae0b-0ce16e2340c7 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:40.343397 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:40.344288 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:40.344572 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:40.344847 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] PATH_INFO: `/v3/users/f5243951d5d645bfad8c6782e6c505e2` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:40.346042 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5243951d5d645bfad8c6782e6c505e2)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:40.347980 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:40.544389 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5243951d5d645bfad8c6782e6c505e2'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:40.626103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5243951d5d645bfad8c6782e6c505e2'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:40.638600 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5243951d5d645bfad8c6782e6c505e2'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:40.639263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5243951d5d645bfad8c6782e6c505e2'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:40.645828 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5243951d5d645bfad8c6782e6c505e2'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:40.652007 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1422/2855] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:48:40 2022] DELETE /identity/v3/users/f5243951d5d645bfad8c6782e6c505e2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:40.656731 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed4232-f81c-474b-8c19-0fd9ca5179a7 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:40.657052 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed4232-f81c-474b-8c19-0fd9ca5179a7 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:40.657336 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed4232-f81c-474b-8c19-0fd9ca5179a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:40.674142 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-85ed4232-f81c-474b-8c19-0fd9ca5179a7 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:40.675328 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-85ed4232-f81c-474b-8c19-0fd9ca5179a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:40.731621 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1434/2856] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:40.741072 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:40.745531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:40.798366 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db962a1a-1a7d-4efd-a6da-06a887ffa12e admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:40.801838 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96217222-50b7-4dd2-ba0f-3a5f883a363d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:40.802466 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96217222-50b7-4dd2-ba0f-3a5f883a363d service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:40.802745 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96217222-50b7-4dd2-ba0f-3a5f883a363d service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:40.803019 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96217222-50b7-4dd2-ba0f-3a5f883a363d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:40.812439 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96217222-50b7-4dd2-ba0f-3a5f883a363d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:40.813859 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96217222-50b7-4dd2-ba0f-3a5f883a363d service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:40.823063 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1423/2857] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:48:41.219277 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed4232-f81c-474b-8c19-0fd9ca5179a7 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:41.224626 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-85ed4232-f81c-474b-8c19-0fd9ca5179a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:41.234617 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed4232-f81c-474b-8c19-0fd9ca5179a7 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:41.239169 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cbac5-4f95-49df-a7de-b34f3889da01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:41.240782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cbac5-4f95-49df-a7de-b34f3889da01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:41.241077 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cbac5-4f95-49df-a7de-b34f3889da01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:41.241356 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cbac5-4f95-49df-a7de-b34f3889da01 admin admin] PATH_INFO: `/v3/projects/c3ac68426da24c089e59a19f9bf61a4f` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:41.242592 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cbac5-4f95-49df-a7de-b34f3889da01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ac68426da24c089e59a19f9bf61a4f)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:41.244521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cbac5-4f95-49df-a7de-b34f3889da01 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:41.368815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-db7cbac5-4f95-49df-a7de-b34f3889da01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ac68426da24c089e59a19f9bf61a4f', 'request_id': 'req-db7cbac5-4f95-49df-a7de-b34f3889da01'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:41.373969 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-db7cbac5-4f95-49df-a7de-b34f3889da01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ac68426da24c089e59a19f9bf61a4f', 'request_id': 'req-db7cbac5-4f95-49df-a7de-b34f3889da01'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:41.471698 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-db7cbac5-4f95-49df-a7de-b34f3889da01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ac68426da24c089e59a19f9bf61a4f', 'request_id': 'req-db7cbac5-4f95-49df-a7de-b34f3889da01'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:41.482784 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-db7cbac5-4f95-49df-a7de-b34f3889da01 admin admin] The token cache is being invalidate because project c3ac68426da24c089e59a19f9bf61a4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:48:41.486595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-db7cbac5-4f95-49df-a7de-b34f3889da01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:41.486595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-db7cbac5-4f95-49df-a7de-b34f3889da01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:48:41.486595 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1435/2858] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:48:41 2022] DELETE /identity/v3/projects/c3ac68426da24c089e59a19f9bf61a4f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:41.490098 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04453ac-baee-4271-bd83-4afcbd33e028 None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:41.490382 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04453ac-baee-4271-bd83-4afcbd33e028 None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:41.490651 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04453ac-baee-4271-bd83-4afcbd33e028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:41.508673 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-c04453ac-baee-4271-bd83-4afcbd33e028 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:41.509841 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-c04453ac-baee-4271-bd83-4afcbd33e028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:41.565037 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1424/2859] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:41.573304 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074a1f-bd22-411c-9d96-445d902500d1 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:41.573602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074a1f-bd22-411c-9d96-445d902500d1 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:41.573876 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074a1f-bd22-411c-9d96-445d902500d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:41.593338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-c1074a1f-bd22-411c-9d96-445d902500d1 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:41.594516 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-c1074a1f-bd22-411c-9d96-445d902500d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:41.602281 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1436/2860] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:41.606265 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04453ac-baee-4271-bd83-4afcbd33e028 None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:41.615599 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04453ac-baee-4271-bd83-4afcbd33e028 None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:41.620345 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80261292-7f9b-485d-99ea-fa6b8b34cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:41.620924 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80261292-7f9b-485d-99ea-fa6b8b34cbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:41.621205 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80261292-7f9b-485d-99ea-fa6b8b34cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:41.621478 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80261292-7f9b-485d-99ea-fa6b8b34cbc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:41.622186 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80261292-7f9b-485d-99ea-fa6b8b34cbc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 15:48:41.622489 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80261292-7f9b-485d-99ea-fa6b8b34cbc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:41.624071 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80261292-7f9b-485d-99ea-fa6b8b34cbc7 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:41.635706 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1425/2861] 10.222.0.25 () {58 vars in 1152 bytes} [Tue Mar 8 15:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 15:48:41.639881 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074a1f-bd22-411c-9d96-445d902500d1 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:41.649769 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074a1f-bd22-411c-9d96-445d902500d1 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:41.654430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cd445-6e2a-437b-9b95-5991b124dda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:41.655068 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cd445-6e2a-437b-9b95-5991b124dda5 admin admin] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:41.655351 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cd445-6e2a-437b-9b95-5991b124dda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:41.655626 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cd445-6e2a-437b-9b95-5991b124dda5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:41.656351 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cd445-6e2a-437b-9b95-5991b124dda5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:41.658244 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cd445-6e2a-437b-9b95-5991b124dda5 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:41.732390 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1437/2862] 10.222.0.25 () {60 vars in 1152 bytes} [Tue Mar 8 15:48:41 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:48:41.736640 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80261292-7f9b-485d-99ea-fa6b8b34cbc7 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:41.746531 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80261292-7f9b-485d-99ea-fa6b8b34cbc7 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:41.801544 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d766eb-05b9-457f-b2d3-ad26b4f8579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:41.802197 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d766eb-05b9-457f-b2d3-ad26b4f8579f admin admin] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:41.802477 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d766eb-05b9-457f-b2d3-ad26b4f8579f admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:41.802751 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d766eb-05b9-457f-b2d3-ad26b4f8579f admin admin] PATH_INFO: `/v3/users` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:41.803433 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d766eb-05b9-457f-b2d3-ad26b4f8579f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:41.805909 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d766eb-05b9-457f-b2d3-ad26b4f8579f admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:41.942134 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1426/2863] 10.222.0.25 () {60 vars in 1143 bytes} [Tue Mar 8 15:48:41 2022] POST /identity/v3/users => generated 282 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 15:48:41.946236 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cd445-6e2a-437b-9b95-5991b124dda5 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:41.957438 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cd445-6e2a-437b-9b95-5991b124dda5 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:41.962163 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82fd40-fd27-4342-9cba-aeb9c7b75477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:41.962809 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82fd40-fd27-4342-9cba-aeb9c7b75477 admin admin] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:41.963088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82fd40-fd27-4342-9cba-aeb9c7b75477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:41.963368 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82fd40-fd27-4342-9cba-aeb9c7b75477 admin admin] PATH_INFO: `/v3/roles` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:41.964112 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82fd40-fd27-4342-9cba-aeb9c7b75477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:41.965811 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82fd40-fd27-4342-9cba-aeb9c7b75477 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:41.975891 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1438/2864] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:48:41.979804 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d766eb-05b9-457f-b2d3-ad26b4f8579f admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:41.993799 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d766eb-05b9-457f-b2d3-ad26b4f8579f admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:41.999154 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634dd5b-57b0-408f-ac6d-e8384e45e88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:41.999825 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634dd5b-57b0-408f-ac6d-e8384e45e88e admin admin] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:42.000103 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634dd5b-57b0-408f-ac6d-e8384e45e88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:42.000414 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634dd5b-57b0-408f-ac6d-e8384e45e88e admin admin] PATH_INFO: `/v3/roles` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:42.001135 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634dd5b-57b0-408f-ac6d-e8384e45e88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:42.002757 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634dd5b-57b0-408f-ac6d-e8384e45e88e admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:42.013797 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1427/2865] 10.222.0.25 () {58 vars in 1121 bytes} [Tue Mar 8 15:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 15:48:42.018389 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82fd40-fd27-4342-9cba-aeb9c7b75477 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:42.028617 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82fd40-fd27-4342-9cba-aeb9c7b75477 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:42.033092 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ce236-8a8c-420b-9a03-96c4a928cc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:42.034055 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ce236-8a8c-420b-9a03-96c4a928cc11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:42.034332 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ce236-8a8c-420b-9a03-96c4a928cc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:42.034654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ce236-8a8c-420b-9a03-96c4a928cc11 admin admin] PATH_INFO: `/v3/projects/65037f2403ae4411b07a7bc51b21e4fd/users/2db1924ae5b040ebad3fee6df047c36f/roles/ab135a02f63c4a138c6b116ad4f9c8d0` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:42.049170 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ce236-8a8c-420b-9a03-96c4a928cc11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65037f2403ae4411b07a7bc51b21e4fd, user_id=2db1924ae5b040ebad3fee6df047c36f, role_id=ab135a02f63c4a138c6b116ad4f9c8d0)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:42.051806 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ce236-8a8c-420b-9a03-96c4a928cc11 admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:42.118450 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1439/2866] 10.222.0.25 () {60 vars in 1482 bytes} [Tue Mar 8 15:48:42 2022] PUT /identity/v3/projects/65037f2403ae4411b07a7bc51b21e4fd/users/2db1924ae5b040ebad3fee6df047c36f/roles/ab135a02f63c4a138c6b116ad4f9c8d0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:48:42.134858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142526be-5ec9-4710-9a7f-06acac9e74ec None None] REQUEST_METHOD: `POST` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:42.135147 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142526be-5ec9-4710-9a7f-06acac9e74ec None None] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:42.135424 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142526be-5ec9-4710-9a7f-06acac9e74ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:42.161269 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.auth.core [None req-142526be-5ec9-4710-9a7f-06acac9e74ec None None] MFA Rules not processed for user `2db1924ae5b040ebad3fee6df047c36f`. Rule list: `[]` (Enabled: `True`). {{(pid=79757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:48:42.162458 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-142526be-5ec9-4710-9a7f-06acac9e74ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:42.222992 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1428/2867] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:48:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:48:42.234208 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ce236-8a8c-420b-9a03-96c4a928cc11 admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:48:42.235879 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e65ce236-8a8c-420b-9a03-96c4a928cc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:48:42.288978 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ce236-8a8c-420b-9a03-96c4a928cc11 admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:48:42.293087 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0bf92-5cb9-4623-8b3d-c3e84f46407d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acd143470fb416c8adc57351c5d0324', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:48:42.293709 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0bf92-5cb9-4623-8b3d-c3e84f46407d service cinder] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:48:42.293988 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0bf92-5cb9-4623-8b3d-c3e84f46407d service cinder] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:48:42.294517 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0bf92-5cb9-4623-8b3d-c3e84f46407d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:48:42.302497 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0bf92-5cb9-4623-8b3d-c3e84f46407d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:48:42.303911 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0bf92-5cb9-4623-8b3d-c3e84f46407d service cinder] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:48:42.313007 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1440/2868] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:48:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:49:21.064488 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142526be-5ec9-4710-9a7f-06acac9e74ec None None] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:49:21.127130 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0bf92-5cb9-4623-8b3d-c3e84f46407d service cinder] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:49:21.128632 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-f6f0bf92-5cb9-4623-8b3d-c3e84f46407d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:21.142658 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142526be-5ec9-4710-9a7f-06acac9e74ec None None] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:49:21.148013 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:49:21.149035 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:49:21.149418 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:49:21.149794 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] PATH_INFO: `/v3/users/2db1924ae5b040ebad3fee6df047c36f` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:49:21.151239 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db1924ae5b040ebad3fee6df047c36f)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:49:21.153328 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:49:21.197220 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0bf92-5cb9-4623-8b3d-c3e84f46407d service cinder] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:49:21.200904 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dc7c2-ec29-48d7-a443-83671e729467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:49:21.201536 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc7c2-ec29-48d7-a443-83671e729467 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:49:21.201819 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc7c2-ec29-48d7-a443-83671e729467 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:49:21.202091 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc7c2-ec29-48d7-a443-83671e729467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:49:21.203847 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-382dc7c2-ec29-48d7-a443-83671e729467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:21.213080 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc7c2-ec29-48d7-a443-83671e729467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:49:21.214509 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc7c2-ec29-48d7-a443-83671e729467 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:49:21.222935 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1441/2869] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:49:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:49:21.404829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db1924ae5b040ebad3fee6df047c36f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:21.510117 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db1924ae5b040ebad3fee6df047c36f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:21.523510 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db1924ae5b040ebad3fee6df047c36f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:21.524767 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db1924ae5b040ebad3fee6df047c36f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:21.535810 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db1924ae5b040ebad3fee6df047c36f'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:21.546299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1429/2870] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:49:21 2022] DELETE /identity/v3/users/2db1924ae5b040ebad3fee6df047c36f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:49:21.547781 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b43f44-f859-4bba-b9c6-89754a831db1 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:49:21.548081 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b43f44-f859-4bba-b9c6-89754a831db1 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:49:21.548434 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b43f44-f859-4bba-b9c6-89754a831db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:49:21.571020 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-70b43f44-f859-4bba-b9c6-89754a831db1 None None] MFA Rules not processed for user `bbb6b460327949a18b1de23a04493ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:49:21.573019 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-70b43f44-f859-4bba-b9c6-89754a831db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:21.608971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:49:21.610602 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:21.647776 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1442/2871] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:49:21.654481 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b43f44-f859-4bba-b9c6-89754a831db1 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:49:21.655933 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-70b43f44-f859-4bba-b9c6-89754a831db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:21.681967 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf1f41-9ff5-4bb5-9880-d7bc5be677a5 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:49:21.686185 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212220b-69b4-4000-b470-da4889da022a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:49:21.686829 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212220b-69b4-4000-b470-da4889da022a service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:49:21.687114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212220b-69b4-4000-b470-da4889da022a service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:49:21.687391 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212220b-69b4-4000-b470-da4889da022a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:49:21.691521 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-b212220b-69b4-4000-b470-da4889da022a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:21.742181 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b43f44-f859-4bba-b9c6-89754a831db1 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:49:21.746088 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fb794-3fe6-453b-8628-5aeb034a638b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:49:21.746547 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fb794-3fe6-453b-8628-5aeb034a638b service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:49:21.746834 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fb794-3fe6-453b-8628-5aeb034a638b service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:49:21.747111 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fb794-3fe6-453b-8628-5aeb034a638b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:49:21.759573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fb794-3fe6-453b-8628-5aeb034a638b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:49:21.767330 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fb794-3fe6-453b-8628-5aeb034a638b service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:49:21.773283 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1443/2872] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:49:21.787284 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212220b-69b4-4000-b470-da4889da022a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:49:21.788922 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212220b-69b4-4000-b470-da4889da022a service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:49:21.803092 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1430/2873] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:49:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:49:22.212430 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fb794-3fe6-453b-8628-5aeb034a638b service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:49:22.214338 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-390fb794-3fe6-453b-8628-5aeb034a638b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:22.234136 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fb794-3fe6-453b-8628-5aeb034a638b service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:49:22.240574 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:49:22.241480 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:49:22.241758 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:49:22.242071 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] PATH_INFO: `/v3/projects/65037f2403ae4411b07a7bc51b21e4fd` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:49:22.243257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=65037f2403ae4411b07a7bc51b21e4fd)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:49:22.245297 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:49:22.338380 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65037f2403ae4411b07a7bc51b21e4fd', 'request_id': 'req-61d1b661-c626-4e64-9567-5c6f24c7b99d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:22.343565 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65037f2403ae4411b07a7bc51b21e4fd', 'request_id': 'req-61d1b661-c626-4e64-9567-5c6f24c7b99d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:22.421078 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65037f2403ae4411b07a7bc51b21e4fd', 'request_id': 'req-61d1b661-c626-4e64-9567-5c6f24c7b99d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:22.432120 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] The token cache is being invalidate because project 65037f2403ae4411b07a7bc51b21e4fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:49:22.436505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:22.436505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:22.436505 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1444/2874] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:49:22 2022] DELETE /identity/v3/projects/65037f2403ae4411b07a7bc51b21e4fd => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:49:22.983188 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212220b-69b4-4000-b470-da4889da022a service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:49:22.992118 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212220b-69b4-4000-b470-da4889da022a service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:49:23.037354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cc6a3-9016-4af4-99c5-334c427d817e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:49:23.042771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cc6a3-9016-4af4-99c5-334c427d817e service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:49:23.042771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cc6a3-9016-4af4-99c5-334c427d817e service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:49:23.042771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8cc6a3-9016-4af4-99c5-334c427d817e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:49:23.042771 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8c8cc6a3-9016-4af4-99c5-334c427d817e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:23.106830 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cc6a3-9016-4af4-99c5-334c427d817e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:49:23.108304 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8cc6a3-9016-4af4-99c5-334c427d817e service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:49:23.120266 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1431/2875] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:49:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:49:25.746103 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:49:25.747511 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:25.759578 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1b661-c626-4e64-9567-5c6f24c7b99d admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:49:25.763179 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8cbe1-0b17-45d5-a732-d0899b93cc80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:49:25.763815 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8cbe1-0b17-45d5-a732-d0899b93cc80 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:49:25.764100 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8cbe1-0b17-45d5-a732-d0899b93cc80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:49:25.764413 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8cbe1-0b17-45d5-a732-d0899b93cc80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:49:25.766159 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-bae8cbe1-0b17-45d5-a732-d0899b93cc80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:25.826712 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8cbe1-0b17-45d5-a732-d0899b93cc80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:49:25.828191 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae8cbe1-0b17-45d5-a732-d0899b93cc80 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:49:25.838257 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1445/2876] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:49:32.905157 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cc6a3-9016-4af4-99c5-334c427d817e service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:49:32.906696 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-8c8cc6a3-9016-4af4-99c5-334c427d817e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:32.922065 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8cc6a3-9016-4af4-99c5-334c427d817e service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:49:32.927561 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:49:32.928453 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:49:32.928731 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:49:32.928998 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] PATH_INFO: `/v3/users/6c3f1618f68f4920aa71db3751b8f96c` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:49:32.930313 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3f1618f68f4920aa71db3751b8f96c)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:49:32.932176 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:49:33.100815 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3f1618f68f4920aa71db3751b8f96c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.161244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3f1618f68f4920aa71db3751b8f96c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.173202 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3f1618f68f4920aa71db3751b8f96c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.173823 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3f1618f68f4920aa71db3751b8f96c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.181214 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3f1618f68f4920aa71db3751b8f96c'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.187073 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1432/2877] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:49:32 2022] DELETE /identity/v3/users/6c3f1618f68f4920aa71db3751b8f96c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:49:33.402727 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8cbe1-0b17-45d5-a732-d0899b93cc80 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:49:33.414124 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8cbe1-0b17-45d5-a732-d0899b93cc80 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:49:33.469660 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:49:33.470521 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:49:33.470863 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:49:33.471671 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] PATH_INFO: `/v3/projects/446fa0e6566c4e8abfe18b45a5e42110` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:49:33.472876 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] RBAC: Authorizing `identity:delete_project(project_id=446fa0e6566c4e8abfe18b45a5e42110)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:49:33.474790 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:49:33.559633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446fa0e6566c4e8abfe18b45a5e42110', 'request_id': 'req-698457f0-b18f-4407-8b9b-4bfafbda058b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.564876 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446fa0e6566c4e8abfe18b45a5e42110', 'request_id': 'req-698457f0-b18f-4407-8b9b-4bfafbda058b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.652515 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446fa0e6566c4e8abfe18b45a5e42110', 'request_id': 'req-698457f0-b18f-4407-8b9b-4bfafbda058b'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.664072 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] The token cache is being invalidate because project 446fa0e6566c4e8abfe18b45a5e42110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:49:33.664388 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.665006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.666551 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1446/2878] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:49:33 2022] DELETE /identity/v3/projects/446fa0e6566c4e8abfe18b45a5e42110 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:49:33.670755 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:49:33.672169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:33.685492 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70650c35-df3f-4357-a8d6-4c07ff20894d admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:49:33.739126 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:49:33.739984 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:49:33.740299 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:49:33.740578 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] PATH_INFO: `/v3/users/0734ed93182344c98bb1426f91d8c6aa` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:49:33.741752 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0734ed93182344c98bb1426f91d8c6aa)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:49:33.743664 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:49:33.905129 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0734ed93182344c98bb1426f91d8c6aa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.954690 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0734ed93182344c98bb1426f91d8c6aa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.967465 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0734ed93182344c98bb1426f91d8c6aa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.968200 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0734ed93182344c98bb1426f91d8c6aa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.975054 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0734ed93182344c98bb1426f91d8c6aa'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:33.981169 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1433/2879] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:49:33 2022] DELETE /identity/v3/users/0734ed93182344c98bb1426f91d8c6aa => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:49:34.222310 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:49:34.223760 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:49:34.238654 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698457f0-b18f-4407-8b9b-4bfafbda058b admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:49:34.296393 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75fa42-ce8b-49f5-886f-7ca62b53830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:49:34.297260 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75fa42-ce8b-49f5-886f-7ca62b53830d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:49:34.297542 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75fa42-ce8b-49f5-886f-7ca62b53830d admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:49:34.297818 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75fa42-ce8b-49f5-886f-7ca62b53830d admin admin] PATH_INFO: `/v3/projects/48e98a3b49c44e2ca1c25c78ca0c5a47` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:49:34.299580 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75fa42-ce8b-49f5-886f-7ca62b53830d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e98a3b49c44e2ca1c25c78ca0c5a47)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:49:34.301543 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75fa42-ce8b-49f5-886f-7ca62b53830d admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:49:34.396633 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ec75fa42-ce8b-49f5-886f-7ca62b53830d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e98a3b49c44e2ca1c25c78ca0c5a47', 'request_id': 'req-ec75fa42-ce8b-49f5-886f-7ca62b53830d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:34.401818 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ec75fa42-ce8b-49f5-886f-7ca62b53830d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e98a3b49c44e2ca1c25c78ca0c5a47', 'request_id': 'req-ec75fa42-ce8b-49f5-886f-7ca62b53830d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:34.455189 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ec75fa42-ce8b-49f5-886f-7ca62b53830d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e98a3b49c44e2ca1c25c78ca0c5a47', 'request_id': 'req-ec75fa42-ce8b-49f5-886f-7ca62b53830d'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:34.471573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ec75fa42-ce8b-49f5-886f-7ca62b53830d admin admin] The token cache is being invalidate because project 48e98a3b49c44e2ca1c25c78ca0c5a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:49:34.471573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ec75fa42-ce8b-49f5-886f-7ca62b53830d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:34.471573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-ec75fa42-ce8b-49f5-886f-7ca62b53830d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:49:34.471573 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1447/2880] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:49:34 2022] DELETE /identity/v3/projects/48e98a3b49c44e2ca1c25c78ca0c5a47 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:50:12.892688 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:50:12.893644 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:50:12.977571 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcd119-ca55-4932-8069-e52dbdfb8390 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:50:13.047050 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c9cc6-6519-4ce3-b577-cda36bef3074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:50:13.047849 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c9cc6-6519-4ce3-b577-cda36bef3074 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:50:13.048233 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c9cc6-6519-4ce3-b577-cda36bef3074 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:50:13.048740 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c9cc6-6519-4ce3-b577-cda36bef3074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:50:13.050742 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d42c9cc6-6519-4ce3-b577-cda36bef3074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:50:13.066105 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c9cc6-6519-4ce3-b577-cda36bef3074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:50:13.071291 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c9cc6-6519-4ce3-b577-cda36bef3074 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:50:13.088360 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1434/2881] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:50:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:50:14.287423 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5717e-07fc-4c6c-b70b-a882e4c8c46d None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:50:14.287981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5717e-07fc-4c6c-b70b-a882e4c8c46d None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:50:14.287981 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5717e-07fc-4c6c-b70b-a882e4c8c46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:50:14.306387 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-93e5717e-07fc-4c6c-b70b-a882e4c8c46d None None] MFA Rules not processed for user `609e7d0dc9a84882a2da862172940533`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:50:14.310149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-93e5717e-07fc-4c6c-b70b-a882e4c8c46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:50:14.360253 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1448/2882] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:50:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:50:14.712002 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c9cc6-6519-4ce3-b577-cda36bef3074 service nova] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:50:14.713406 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-d42c9cc6-6519-4ce3-b577-cda36bef3074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:50:14.766504 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c9cc6-6519-4ce3-b577-cda36bef3074 service nova] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:50:14.770089 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8dd80-9144-495a-a472-d104040facb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:50:14.770712 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8dd80-9144-495a-a472-d104040facb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:50:14.770990 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8dd80-9144-495a-a472-d104040facb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:50:14.771263 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8dd80-9144-495a-a472-d104040facb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:50:14.773009 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1cd8dd80-9144-495a-a472-d104040facb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:50:14.782025 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8dd80-9144-495a-a472-d104040facb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:50:14.783437 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8dd80-9144-495a-a472-d104040facb5 service neutron] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:50:14.791484 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1435/2883] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:50:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:50:17.567300 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5717e-07fc-4c6c-b70b-a882e4c8c46d None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:50:17.571596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-93e5717e-07fc-4c6c-b70b-a882e4c8c46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:50:17.636045 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5717e-07fc-4c6c-b70b-a882e4c8c46d None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:50:17.641098 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd004ae-9769-48bb-b91d-33decac1619a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13471dce9430484ab46b355d1303f504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:50:17.641739 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd004ae-9769-48bb-b91d-33decac1619a service placement] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:50:17.642030 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd004ae-9769-48bb-b91d-33decac1619a service placement] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:50:17.642309 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd004ae-9769-48bb-b91d-33decac1619a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:50:17.644759 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-0cd004ae-9769-48bb-b91d-33decac1619a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:50:17.656545 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd004ae-9769-48bb-b91d-33decac1619a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:50:17.658131 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd004ae-9769-48bb-b91d-33decac1619a service placement] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:50:17.668537 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1449/2884] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:50:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:50:34.796054 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8dd80-9144-495a-a472-d104040facb5 service neutron] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:50:34.799047 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1cd8dd80-9144-495a-a472-d104040facb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:50:34.818285 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8dd80-9144-495a-a472-d104040facb5 service neutron] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:50:34.824577 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0c761-868f-40ea-a78f-5df965fdcac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:50:34.825244 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0c761-868f-40ea-a78f-5df965fdcac1 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:50:34.825491 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0c761-868f-40ea-a78f-5df965fdcac1 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:50:34.825769 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0c761-868f-40ea-a78f-5df965fdcac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:50:34.827563 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-65f0c761-868f-40ea-a78f-5df965fdcac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:50:34.840884 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0c761-868f-40ea-a78f-5df965fdcac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:50:34.842605 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0c761-868f-40ea-a78f-5df965fdcac1 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:50:34.854178 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1436/2885] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:50:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:52:14.905716 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48a74a-ac10-49d0-a59d-2dde87640b96 None None] REQUEST_METHOD: `POST` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:52:14.906322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48a74a-ac10-49d0-a59d-2dde87640b96 None None] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:52:14.906322 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48a74a-ac10-49d0-a59d-2dde87640b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:52:14.932795 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.auth.core [None req-7c48a74a-ac10-49d0-a59d-2dde87640b96 None None] MFA Rules not processed for user `609e7d0dc9a84882a2da862172940533`. Rule list: `[]` (Enabled: `True`). {{(pid=79756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 15:52:14.933984 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-7c48a74a-ac10-49d0-a59d-2dde87640b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:52:14.956657 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1450/2886] 10.222.0.25 () {58 vars in 957 bytes} [Tue Mar 8 15:52:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 15:52:30.955049 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0c761-868f-40ea-a78f-5df965fdcac1 service nova] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:52:31.018297 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0c761-868f-40ea-a78f-5df965fdcac1 service nova] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:52:31.023882 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b24c7-9778-4e83-bcd6-bf9d269f2194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:52:31.024549 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b24c7-9778-4e83-bcd6-bf9d269f2194 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:52:31.024836 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b24c7-9778-4e83-bcd6-bf9d269f2194 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:52:31.025114 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b24c7-9778-4e83-bcd6-bf9d269f2194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:52:31.026870 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-7f8b24c7-9778-4e83-bcd6-bf9d269f2194 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:52:31.040715 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b24c7-9778-4e83-bcd6-bf9d269f2194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:52:31.042464 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b24c7-9778-4e83-bcd6-bf9d269f2194 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:52:31.052201 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1437/2887] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:52:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:52:56.425639 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48a74a-ac10-49d0-a59d-2dde87640b96 None None] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:52:56.446297 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48a74a-ac10-49d0-a59d-2dde87640b96 None None] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:52:56.452237 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759f936-8c6a-4eca-8860-523a740d2d84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13471dce9430484ab46b355d1303f504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:52:56.453101 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759f936-8c6a-4eca-8860-523a740d2d84 service placement] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:52:56.453602 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759f936-8c6a-4eca-8860-523a740d2d84 service placement] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:52:56.454109 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759f936-8c6a-4eca-8860-523a740d2d84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:52:56.456593 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-9759f936-8c6a-4eca-8860-523a740d2d84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:52:56.482047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759f936-8c6a-4eca-8860-523a740d2d84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:52:56.483635 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759f936-8c6a-4eca-8860-523a740d2d84 service placement] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:52:56.493467 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1451/2888] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:52:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:54:01.706166 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b24c7-9778-4e83-bcd6-bf9d269f2194 service nova] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:54:01.719184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b24c7-9778-4e83-bcd6-bf9d269f2194 service nova] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:54:01.725005 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1603cd-4edd-4b11-925e-87a8b0aa46f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4fb404cc61d49d3aaec429f4f9f4f94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:54:01.725848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1603cd-4edd-4b11-925e-87a8b0aa46f3 service nova] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:54:01.726293 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1603cd-4edd-4b11-925e-87a8b0aa46f3 service nova] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:54:01.726737 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1603cd-4edd-4b11-925e-87a8b0aa46f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:54:01.729184 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9a1603cd-4edd-4b11-925e-87a8b0aa46f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:54:01.758858 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1603cd-4edd-4b11-925e-87a8b0aa46f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:54:01.760848 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1603cd-4edd-4b11-925e-87a8b0aa46f3 service nova] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:54:01.772603 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1438/2889] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:54:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 15:54:15.110596 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759f936-8c6a-4eca-8860-523a740d2d84 service placement] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:54:15.129764 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759f936-8c6a-4eca-8860-523a740d2d84 service placement] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:54:15.133344 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f18895-767f-4433-abb0-1798579f3f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '028d499ea279442d822c6723c367f459', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:54:15.133965 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f18895-767f-4433-abb0-1798579f3f91 service neutron] REQUEST_METHOD: `GET` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:54:15.134248 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f18895-767f-4433-abb0-1798579f3f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:54:15.134516 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f18895-767f-4433-abb0-1798579f3f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:54:15.136316 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-12f18895-767f-4433-abb0-1798579f3f91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:54:15.215839 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f18895-767f-4433-abb0-1798579f3f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:54:15.217299 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f18895-767f-4433-abb0-1798579f3f91 service neutron] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:54:15.235657 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1452/2890] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 15:54:22.445774 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1603cd-4edd-4b11-925e-87a8b0aa46f3 service nova] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:54:22.447327 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-9a1603cd-4edd-4b11-925e-87a8b0aa46f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:54:22.462176 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1603cd-4edd-4b11-925e-87a8b0aa46f3 service nova] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:54:22.466704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:54:22.467862 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:54:22.468156 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:54:22.468438 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] PATH_INFO: `/v3/users/609e7d0dc9a84882a2da862172940533` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:54:22.469606 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=609e7d0dc9a84882a2da862172940533)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:54:22.471500 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:54:22.629437 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609e7d0dc9a84882a2da862172940533'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:22.690987 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609e7d0dc9a84882a2da862172940533'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:22.702579 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609e7d0dc9a84882a2da862172940533'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:22.703275 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609e7d0dc9a84882a2da862172940533'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:22.709901 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609e7d0dc9a84882a2da862172940533'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:22.715596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1439/2891] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:54:22 2022] DELETE /identity/v3/users/609e7d0dc9a84882a2da862172940533 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:54:22.947195 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f18895-767f-4433-abb0-1798579f3f91 service neutron] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:54:22.959645 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f18895-767f-4433-abb0-1798579f3f91 service neutron] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:54:23.016047 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:54:23.017006 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:54:23.017291 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:54:23.017567 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] PATH_INFO: `/v3/projects/eea5da771e2142b699fe081c5defbd69` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:54:23.018742 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea5da771e2142b699fe081c5defbd69)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:54:23.020679 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:54:23.120408 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea5da771e2142b699fe081c5defbd69', 'request_id': 'req-e2e048d9-2fb2-4ae5-b803-d83436966eed'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:23.125937 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea5da771e2142b699fe081c5defbd69', 'request_id': 'req-e2e048d9-2fb2-4ae5-b803-d83436966eed'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:23.182874 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea5da771e2142b699fe081c5defbd69', 'request_id': 'req-e2e048d9-2fb2-4ae5-b803-d83436966eed'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:23.194271 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] The token cache is being invalidate because project eea5da771e2142b699fe081c5defbd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:54:23.194525 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:23.195149 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:23.196702 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1453/2892] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:54:22 2022] DELETE /identity/v3/projects/eea5da771e2142b699fe081c5defbd69 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 15:54:23.200722 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:54:23.202145 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:54:23.215418 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f445c1-4eaa-4888-812f-8728cc23c1cf admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:54:23.269546 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:54:23.270408 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:54:23.270694 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:54:23.270971 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] PATH_INFO: `/v3/users/39a95b5d1ec24152b8459c12474318d9` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:54:23.272167 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a95b5d1ec24152b8459c12474318d9)` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:54:23.274080 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:54:23.452924 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a95b5d1ec24152b8459c12474318d9'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:23.536704 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a95b5d1ec24152b8459c12474318d9'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:23.548426 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a95b5d1ec24152b8459c12474318d9'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:23.549058 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a95b5d1ec24152b8459c12474318d9'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:23.555596 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.notifications [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a95b5d1ec24152b8459c12474318d9'} {{(pid=79757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:23.561340 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1440/2893] 10.222.0.25 () {58 vars in 1223 bytes} [Tue Mar 8 15:54:23 2022] DELETE /identity/v3/users/39a95b5d1ec24152b8459c12474318d9 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:54:23.795990 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] Authenticating user token {{(pid=79756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:54:23.797426 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.fernet_utils [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:54:23.810782 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e048d9-2fb2-4ae5-b803-d83436966eed admin admin] Validating token access rules against request {{(pid=79756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:54:23.864787 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb6b460327949a18b1de23a04493ec0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8327b1557fad4b78a6361ee1a7f6b2e4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:54:23.865653 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:54:23.865920 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:54:23.866188 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa admin admin] PATH_INFO: `/v3/projects/b131d17f28f242a9b1e4c7f20ef75f9e` {{(pid=79756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:54:23.867345 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b131d17f28f242a9b1e4c7f20ef75f9e)` {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:54:23.869289 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa admin admin] RBAC: Authorization granted {{(pid=79756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:54:23.980062 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b131d17f28f242a9b1e4c7f20ef75f9e', 'request_id': 'req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:23.985581 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b131d17f28f242a9b1e4c7f20ef75f9e', 'request_id': 'req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:24.056458 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b131d17f28f242a9b1e4c7f20ef75f9e', 'request_id': 'req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa'} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:24.067707 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa admin admin] The token cache is being invalidate because project b131d17f28f242a9b1e4c7f20ef75f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 15:54:24.067997 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:24.068648 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: DEBUG keystone.notifications [None req-0f29dc3d-f98f-4720-828b-1c0960fcd9fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 15:54:24.070175 dv-cinder-830097-2-iscsi devstack@keystone.service[79756]: [pid: 79756|app: 0|req: 1454/2894] 10.222.0.25 () {58 vars in 1232 bytes} [Tue Mar 8 15:54:23 2022] DELETE /identity/v3/projects/b131d17f28f242a9b1e4c7f20ef75f9e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 15:58:01.380046 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] Authenticating user token {{(pid=79757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 15:58:01.381483 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:58:01.448322 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81e807-a57c-43b2-b4d9-428f8d829270 admin admin] Validating token access rules against request {{(pid=79757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 15:58:01.509672 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a32a7-f850-4768-9306-626b460ec8ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13471dce9430484ab46b355d1303f504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bdaa0405e224334ac42dc4cde1c01c5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 15:58:01.510314 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a32a7-f850-4768-9306-626b460ec8ac service placement] REQUEST_METHOD: `GET` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 15:58:01.510598 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a32a7-f850-4768-9306-626b460ec8ac service placement] SCRIPT_NAME: `/identity` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 15:58:01.510875 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a32a7-f850-4768-9306-626b460ec8ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 15:58:01.512674 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.fernet_utils [None req-0b3a32a7-f850-4768-9306-626b460ec8ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 15:58:01.524354 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a32a7-f850-4768-9306-626b460ec8ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 15:58:01.525928 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a32a7-f850-4768-9306-626b460ec8ac service placement] RBAC: Authorization granted {{(pid=79757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 15:58:01.535547 dv-cinder-830097-2-iscsi devstack@keystone.service[79757]: [pid: 79757|app: 0|req: 1441/2895] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Mar 8 15:58:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)